Running Gemma 3 Locally: Google's Small Model on Consumer Hardware

Wed, 25 Jun 2025 11:00:00 +0000

Every few months a new open-weights model lands and the homelab forums fill with breathless claims that this one finally dethrones the cloud. Most of the time it’s hype. Gemma 3, which Google released in March, is one of the rare cases where the claims are roughly fair — not because it beats the frontier models, but because it’s the first small model I’ve run that I actually leave switched on.

Gemma - Tag - vo.rs

Running Gemma 3 Locally: Google's Small Model on Consumer Hardware