What's Happening?
New research from IDC reveals that the primary barrier to achieving successful business outcomes from AI is not the AI models themselves, but rather the underlying data foundations of organizations. The study distinguishes between 'IT Modernization Experts'
and 'Explorers,' finding that Experts, who have unified data sources, established governance, and modernized their systems, extract 59% of the potential business value from their data, compared to only 22% for Explorers. This gap is attributed to data accessibility, with Experts increasing internal data accessible to AI by 27%, versus 14% for Explorers. The research emphasizes that strong data governance, security, and access controls are prerequisites for scaling AI responsibly, especially with the emergence of 'agentic AI' systems capable of autonomous action. Organizations with weak data foundations risk agentic systems acting on incomplete or poorly governed data, leading to compounded negative consequences.
Why It's Important?
This IDC research is crucial for U.S. businesses and IT leaders, as it redefines the focus for AI investment and strategy. Instead of solely concentrating on acquiring the latest AI models, organizations must prioritize foundational data modernization and governance. For industries heavily reliant on data, such as finance, healthcare, and retail, this insight highlights a critical competitive differentiator. Companies that neglect their data infrastructure will likely fall behind, experiencing slower AI adoption and potentially costly errors from flawed AI outputs. The findings also challenge the conventional narrative that legacy systems are liabilities, suggesting that evolving them into 'systems of intelligence' by making their data accessible and governed is a more effective approach than complete replacement. This shift in perspective can guide strategic investments, workforce development, and risk management in the U.S. enterprise sector, ensuring that AI initiatives deliver tangible business value.
What's Next?
Organizations are now faced with the imperative to assess and strengthen their data foundations before deploying AI at scale. This will involve significant investment in data unification, governance frameworks, and modernization of existing IT infrastructure, including mainframe-centric environments. IT leaders will need to move beyond pilot projects and focus on building robust, scalable data ecosystems that can support agentic AI. The research suggests that a capability-led approach, which involves replatforming and refactoring core applications rather than rewriting them, can preserve proven business logic while making data accessible to modern AI tools. Furthermore, the emphasis on governance will likely lead to increased demand for data governance specialists and technologies that ensure data quality, security, and compliance. The success of AI adoption in the coming years will largely depend on how effectively businesses address this foundational data readiness gap.
Beyond the Headlines
Beyond the technical and business implications, IDC's findings highlight a deeper organizational challenge: the need for a cultural shift towards data-centric thinking. Many organizations have historically viewed data as a byproduct of operations rather than a strategic asset. This research underscores that a fragmented, ungoverned data landscape can cripple even the most advanced AI initiatives. The ethical dimension of data governance also becomes more pronounced with agentic AI, as autonomous systems acting on poor data can lead to biased outcomes, privacy breaches, or even operational failures with significant societal impact. This necessitates a holistic approach that integrates data ethics, responsible AI principles, and robust governance into every stage of AI development and deployment. The long-term success of AI in the U.S. will not only depend on technological prowess but also on the maturity of organizational data practices and a commitment to ethical data stewardship.
