Chris Clark, Co-Founder and COO of Open Router, provides key insights into the current state of AI, particularly regarding production agents. Open Router processes over a trillion tokens daily from various models, revealing significant trends in AI usage. Notably, tool call rates have surged from under 5% to over 25% within a year, indicating a shift from experimentation to production. By mid-2024, companies began prioritizing Service Level Agreements (SLAs), signifying the importance of operational reliability. Additionally, reasoning tokens now constitute 50% of output, showcasing rapid adoption of reasoning models. The architecture for building production agents is evolving, with companies utilizing advanced reasoning models for planning and specialized models for execution. Clark warns against infrastructure lock-in while emphasizing the importance of data governance, especially for enterprise use, where data sensitivity is paramount. In conclusion, as tool call rates rise, companies capable of orchestrating multi-model strategies will have a competitive edge.
Source link
Share
Read more