Tagged
#on-device
2 articles
tools
Running LLMs locally: a practical primer for a single laptop
You can run a capable open-weight model on one laptop today. Here is what actually determines whether it works — memory, quantization, tooling — and honest expectations for each.
#local-llm#quantization#on-device
05-14 09:12·7 min read
models
Small models, big jobs: when on-device beats the cloud
The biggest model is rarely the right one. Here is why small, on-device models win whole classes of jobs — and how to tell when yours is one of them.
#small-models#on-device#edge-ai
04-01 12:28·7 min read