Tag

Self-Hosted-Ai

llama.cpp Deep Dive: Inference on a CPU2025-11-18
Quantisation Explained: GGUF, GPTQ and Small VRAM2025-10-14
LiteLLM: One API Gateway for Every Model2025-09-09
vLLM: Serving Local Models Fast Enough to Use2025-08-12