What's Happening?
Cisco is emphasizing the growing importance of service providers in the AI inferencing era, as AI traffic is expected to significantly impact network infrastructure. At the Cisco Live event, executives discussed how AI inferencing, which requires less
power and latency than traditional AI training, presents new opportunities for network access players like cable operators and telcos. Cisco's study forecasts that AI inference traffic could account for 25% of total network traffic by 2035. The company is collaborating with AT&T and Nvidia to bring AI inference closer to the edge, where data is generated. This shift is prompting service providers to consider establishing 'inferencing clouds' to capitalize on AI traffic trends.
Why It's Important?
The shift towards AI inferencing represents a significant opportunity for service providers to expand beyond traditional connectivity roles. As AI traffic grows, service providers can leverage their infrastructure to offer inferencing services, potentially increasing their market share in the AI space. This development could lead to a more distributed network architecture, enhancing the ability of service providers to compete with hyperscalers. The move also aligns with the broader trend of edge computing, which aims to reduce latency by processing data closer to its source. For the U.S. economy, this could mean increased investment in network infrastructure and new revenue streams for telecom companies.
What's Next?
Service providers are likely to continue exploring partnerships and investments in AI infrastructure to position themselves as key players in the inferencing market. Cisco plans to expand its network sensors to better track AI traffic, with regular reports to guide service providers. As AI inferencing becomes more prevalent, service providers may need to adapt their business models to include cloud-based AI services. This could involve significant capital investment and strategic partnerships with technology companies to develop and deploy AI solutions effectively.
