Tag

Gpu

Quantisation Explained: GGUF, GPTQ and Small VRAM2025-10-14

vLLM: Serving Local Models Fast Enough to Use2025-08-12

Running AI Inference on Kubernetes: GPU Scheduling, Ollama, and Resource Sharing2025-01-09

Stable Diffusion on Consumer Hardware: The Home Image Lab2024-12-19

Immich Machine Learning on a Spare GPU2024-10-11

Running Whisper Locally for Offline Transcription2024-09-16

Proxmox GPU Passthrough for a Local LLM Box2024-08-27

Running Stable Diffusion on a Budget GPU: What Actually Works Below 8GB VRAM2024-02-27