Tagged
#quantization
2 articles
tools
Running LLMs locally: a practical primer for a single laptop
You can run a capable open-weight model on one laptop today. Here is what actually determines whether it works — memory, quantization, tooling — and honest expectations for each.
#local-llm#quantization#on-device
05-14 09:12·7 min read
models
Quantization and distillation: making models smaller
"Two different ways to shrink a model — one changes its numbers, the other trains a smaller copy. Here is how each works and when to reach for it."
#quantization#distillation#model-compression
04-12 16:37·7 min read