As decision model use skyrockets, is customization the next
In October, more than one in four requests on Vercel’s AI model router went to decision models, not LLMs — an enormous share of work for a kind of…
Summary
In October, more than one in four requests on Vercel’s AI model router went to decision models, not LLMs — an enormous share of work for a kind of computerized intelligence that was invented only a month earlier. Decision models are LLMs that don’t produce output tokens; instead, they’re tuned to use their general intelligence to quickly and cheaply decide between preset options, while registering its level of confidence in the choice. They’re useful in production environments, where fast decisions can be more important than the reasoning provided by a slower and more expensive frontier model. 5 billion company after releasing its Jev family of models, which continues to dominate usage (at least where we can see metrics from services like OpenRouter, which handled more than 1.
Positives
- 5 billion company after releasing its Jev family of models, which continues to dominate usage (at least where we can see metrics from services like OpenRouter, which handled more than 1.
- However, it’s easy to make a decision model, and dozens were released in the wake of Jev.
Risks & concerns
- The article may not provide enough evidence to validate every implication.
- Execution, cost, adoption, regulation, or security could change the outcome.