The
world is rushing to artificial intelligence (AI) tools to find solutions to their problems, but what if the AI are giving them wrong answers? A new research has raised concerns about how accurately chatbots like ChatGPT, Gemini and Claude can predict which jobs are most at risk from AI. The research from Northwestern University and American University (first spotted by The Wall Street Journal) posted on the National Bureau of Economic Research website found that major AI models frequently gave different answers when asked which profession could be most affected by automation.
All About The Study
Researchers Michelle Yin, Hoa Vu and Claudia Persico highlighted how AI tools calculate ‘exposure scores', a method that has been widely used by economists and consulting firms to estimate how critical jobs are to
AI tools. These scores depend on workplace tasks. For example, bakers make dough and work with ovens, while financial analysts study company performance and market trends. The experts estimated how much AI tools could help speed up or complete those tasks. Jobs with a larger share of AI-manageable tasks are considered more exposed to automation.Notably, the study asserts that these rankings might always be dependable. The economists found major differences between the responses of different AI tools. As per the research, Claude identified accountants as highly vulnerable to AI disruption, while Gemini ranked the profession much lower. Although Gemini and ChatGPT showed the closest results overall, they had different thoughts in nearly one out of every four cases. The research suggests these differences are fundamentally linked to how each AI is trained and what type of data it receives.
Initial AI Users May Influence The Rankings
The study noted that professionals who are already using AI tools heavily could appear more exposed simply because they generate more AI-related training data. It adds how this cycle could possibly distort rankings and produce misleading conclusions about which careers are truly at risk. What lies ahead is the debate on
AI replacing humans at work is ongoing as more industries are adopting AI rapidly. Yet the study found that even AI systems might not fully agree on how big that impact could be. As of now, the usage and predictions of AI must be treated carefully.