Tagged
#inference
6 articles
Aramco's AI Bet: Together AI Raises $800M as Open-Source Inference Crosses $1B
Together AI's $800M Series C, led by Aramco Ventures at an $8.3B valuation, is a bet that open models beat closed ones on cost.
OpenAI Bites Into Silicon: Inside 'Jalapeño,' Its First Custom Chip
OpenAI and Broadcom unveiled Jalapeño, an inference-only ASIC built in nine months. What's confirmed, and what's still vendor hype.
Chain-of-thought: why reasoning steps help
Asking a model to "think step by step" makes it noticeably better at hard problems. That is strange if you think about it. Here is why it works.
Reasoning models: what "thinking" tokens do
"Reasoning models work through a problem before answering. That hidden working costs time and tokens — and pays off only on the right kind of task."
The economics of inference: why "cheap AI" still adds up
A single AI call looks almost free. So why do AI bills balloon? A plain-language tour of the economics that turn pennies into real money.
Temperature, top-p, and sampling: controlling model output
Temperature and top-p decide how a model picks its next word. Knowing what each one really does lets you dial output from rigid to creative on purpose.