Plurai wants to help AI agents work better using the same approach
AI agents are all the rage, but they’re not quite as capable as their purveyors would have you believe. Efforts to benchmark agents tasked with complex work…
Summary
AI agents are all the rage, but they’re not quite as capable as their purveyors would have you believe. Efforts to benchmark agents tasked with complex work show that they aren’t typically reliable enough to function without close supervision. 6 out of 100 tasks, respectively, and an effort by the AI infrastructure company EON to test agents in a simulated corporate environment found the most successful model tested, Claude Opus 4. Now, a startup known as Plurai wants to boost those numbers with the same techniques that put self-driving cars on the street: Simulations using synthetic data based on a company’s own digital systems, meant to prepare models to tackle difficult edge cases.
Positives
- 6 out of 100 tasks, respectively, and an effort by the AI infrastructure company EON to test agents in a simulated corporate environment found the most successful model tested, Claude Opus 4.
Risks & concerns
- “The moment that we saw the wave of AI agents, we saw the same pattern: That it is very easy to build a demo, but [hard] to get something that will be reliable and cost effective,” Kadar told TechCrunch.