What's Happening?
EY has implemented an 'invisible' AI router to manage internal AI spending, which has helped reduce token consumption by up to 60%. The router directs employees to the most suitable AI model for their tasks, optimizing resource use and reducing costs.
This initiative comes as companies face growing concerns over token usage costs, with many AI providers now charging based on usage rather than flat rates. EY's approach includes setting token budgets and monitoring usage to ensure efficient AI deployment.
Why It's Important?
As AI usage becomes more prevalent in business operations, managing costs associated with AI token consumption is crucial. EY's strategy to optimize AI model usage can serve as a model for other companies looking to control AI-related expenses. This approach not only reduces costs but also ensures that AI resources are used effectively, potentially leading to better business outcomes and increased productivity.
What's Next?
EY plans to continue refining its AI deployment strategies, focusing on maximizing value and outcomes from AI investments. The company may expand the use of its AI router across more departments and continue to develop governance strategies to manage AI usage effectively.
