Tag: inference
All the articles with the tag "inference".
The Token Metric Is Dead
Tokens are still useful for billing and I/O. But as reasoning moves behind opaque summaries — and increasingly into latent computation — they may be becoming a terrible proxy for how much work a model actually did.