Tagged
#benchmarks
3 articles
models
What a "frontier model" actually means — and why benchmarks mislead
"Frontier model" is a moving label, not a spec. Here is what it really points to, why leaderboard scores rarely tell you what you need, and how to choose well anyway.
#frontier-models#benchmarks#evaluation
06-01 19:11·7 min read
research
Evaluation beyond benchmarks: human and model judges
Benchmarks measure what is easy to score. For open-ended work you need judgment — from people, or from a model standing in for them. Both can mislead.
#evaluation#llm-as-judge#benchmarks
05-06 16:53·7 min read
research
How models are evaluated: benchmarks, and why they lie
Benchmark scores look like measurements, but they are arguments. Here is how model evaluation actually works, and why a high number can still mislead you.
#benchmarks#evaluation#leaderboards
05-06 16:14·7 min read