{"id":"f-86c21c4f86-1b8d94e0-72c1-59e1-bf53-b879621728f2","title":"Nvidia bets on AI inference as chip revenue opportunity hits $1 trillion","description":"CEO Jensen Huang unveiled a new central processor and an AI system built on technology from Groq - a chip startup from which Nvidia licensed technology for $17 billion in December at its annual GTC developer conference in San Jose, California.","timestamp":1773746127,"category":"technology","headline":"Nvidia bets on AI inference as chip revenue opportunity hits $1 trillion","modifiedHeadline":"Nvidia Sees $1 Trillion AI Chip Opportunity","subCategories":["scid_bfd77859"],"subcategoriesName":["Big Tech"],"region":"IN","bundleMetaData":{"bundleId":"c35cfc57-1bba-4539-a24c-695ea99ac023","bundleTitle":"Mastering AI","cardData":null},"iabCategoryId":"597","iabCategoryName":"Artificial Intelligence","fcSummary":"nvidia anticipates a $1 trillion revenue opportunity by 2027, fueled by the growing demand for real-time ai systems and inference computing. ceo jensen huang unveiled new chips, including a cpu and technology licensed from groq, to compete in this expanding market. the moves address investor concerns and highlight nvidia’s commitment to ai infrastructure leadership amidst increasing cpu competition.","summary":"Nvidia forecasts $1T AI revenue by 2027, unveils new chips & partners with Groq. Focus shifts to real-time AI inference.","ctaUrl":"https://trends.glance.com/newz/news/IN/en/firstpost/f-86c21c4f86-1b8d94e0-72c1-59e1-bf53-b879621728f2","sourceUrl":"https://www.firstpost.com/tech/nvidia-bets-on-ai-inference-as-chip-revenue-opportunity-hits-1-trillion-13990234.html","bannerImage":"https://g-mob.glance-cdn.com/public/fc/image/WYJvC4A3n6y0.webp","content":"Nvidia said the revenue opportunity for its artificial intelligence chips may reach at least $1 trillion through 2027, as the company outlined a strategy to compete more aggressively in the fast-growing market for running AI systems in real time.\n\n
\n
\n CEO Jensen Huang unveiled a new central processor and an AI system built on technology from Groq - a chip startup from which Nvidia licensed technology for $17 billion in December at its annual GTC developer conference in San Jose, California.\n
\n
\n The moves are part of Huang's bid to firm up the company's position in so-called inference computing, the process of answering queries, where its graphics processors face greater competition from central processing units and custom processors built by the likes of Google. Nvidia chips have dominated the process of AI model training, which has been the focus of recent years.\n\n
\n
\n \"The inference inflection has arrived,\" Huang said. \"And demand just keeps on going up,\" he added.\n
\n
\n Dressed in his signature black leather jacket, Huang was speaking at a hockey arena with a capacity of more than 18,000 at the four-day conference that has become one of the biggest showcases of AI technology. \"I just want to remind you, this is a tech conference,\" he told the audience.\n
\n
\n But after a dazzling rally that made Nvidia the first company to hit a $5 trillion valuation last October, doubts have risen about its growth. Investors have also questioned if its plan of plowing back profits into the AI ecosystem will pay off. Huang's comments allayed some fears.\n\n
\n
\n The $1 trillion forecast is up from the $500 billion revenue opportunity through 2026 that Nvidia cited for its Blackwell and Rubin AI chips on its last earnings call in February.\n
\n
\n Shares of Nvidia briefly jumped on the new forecast but pared those gains to close up 1.2%.\n
\n
\n \"Huang mapping out a $1 trillion opportunity through 2027 underscores the durable demand for Nvidia’s AI infrastructure despite investor concerns,\" Emarketer analyst Jacob Bourne said.\n
\n
\n \"It signals Nvidia is sustaining its leadership in the AI chip market while the overall AI industry expands beyond early experimentation into large-scale deployment.\"\n\n
\n

Inference Boom

\n\n
\n Huang said that inference, where AI systems answer questions or carry out tasks, will be split up into two steps.\n
\n
\n Nvidia's Vera Rubin chips will handle a first step called \"prefill,\" where the user's request is transformed from human words into ‌the language of \"tokens\" that AI computers use.\n
\n
\n Groq's new chips will handle a second \"decode\" stage where the AI computer provides the answer the user is looking for.\n
\n
\n After spending hundreds of billions of dollars in recent years on chips for training their AI models, companies such as OpenAI, Anthropic and Meta are shifting toward serving hundreds of millions of users who are tapping those AI systems.\n\n
\n
\n That is also driving demand for CPUs - which are dominated by Intel and are increasingly seen as a viable alternative to graphics processors from Nvidia for deploying AI models.\n
\n
\n \"We are selling a lot of CPU standalone,\" Huang said as he unveiled the new Vera CPU. \"This is already for sure going to be a multi-billion-dollar business for us,\" he added.\n
\n
\n Huang also showed off the company's Feynman roadmap but offered few details beyond a list of the various chips Nvidia plans to include in the platform, including AI processors and several networking chips. The Feynman architecture is expected in 2028, following the company's Rubin Ultra chips.\n\n
\n
\n The company is also targeting the market for autonomous AI agents with NemoClaw, which integrates with the viral OpenClaw platform to add privacy and safety controls to the tool that can autonomously execute a wide range of tasks with minimal human guidance and has generated global buzz.\n
\n
\n \"It's kind of upleveled the entire discussion. It's up leveled the entire thought of how they do infrastructure,\" said Technalysis Research president Bob O'Donnell, referring to the announcements.\n
\n
\n \"He (Huang) used to come out with a new GPU chip and say, look, here's my new chip. Now he's got, you know, five racks of equipment that make up these systems.\"\n","readDurationInMinutes":"7","author":{"name":"Firstpost","logo":"https://glance-mob.glance-cdn.com/public/bubble/png/28d65284-7c7e-4e74-a1da-84b4daef1e4c.jpeg"},"ism":false,"analyticsResponses":[{"measurementId":"DUMMy","type":"GA"}],"pointerSummary":["Nvidia projects $1 trillion AI revenue by 2027, signalling continued growth.","CEO Huang unveiled Vera Rubin chips & licensed tech from Groq for $17bn.","Companies shift to inference computing, driving CPU demand; NemoClaw targets autonomous AI agents."],"tags":["Nvidia","AIInference","JensenHuang","GTC2024","AIChips","Groq","TrillionDollarOpportunity","SanJose","Technology","Semiconductors","CPUs","GPUs","AIModelTraining","VeraRubin","FeynmanRoadmap","NemoClaw","AutonomousAI","TechConference","StockMarket","OpenAI","Anthropic","Meta"],"redirectionEnabled":false,"consent":true}

Nvidia bets on AI inference as chip revenue opportunity hits $1 trillion

SUMMARY