Methodology: The new focus for data

• Public scrutiny shifts from final data results to the methods used.
• Debates over indices and GDP focus on how data is weighed and sourced.
• This transparency aids accountability but risks political misuse.

Not long ago, a headline figure—a GDP growth rate, a university ranking, a global index score—was the end of the story. Today, it’s just the beginning. A new, more critical conversation is emerging, one that looks past the result to ask: how?

What's in a Method?

Methodology is simply the 'how' behind the 'what'. Think of it as the recipe for a conclusion. It dictates who was surveyed, what questions were asked, which data points were included or excluded, and how they were all weighed. For decades, these technical details were confined to academic papers and footnotes, seen as the dry, uninteresting plumbing of a report. The public was expected to trust the final output, whether it was a poverty estimate or a global freedom ranking. An independent assessment was valued for its impartiality, and the methods were assumed to be sound. That assumption, however, is no longer a given. Today, the recipe itself is under intense scrutiny.

From the Margins to the Mainstream

This shift is visible everywhere. When international bodies release indices ranking countries on democracy or freedom, the Indian government and public alike have begun to push back, not just on the ranking itself, but on the methods used. Questions are raised about the small, opaque groups of 'experts' whose opinions form the basis of these scores. Similarly, when new Gross Domestic Product (GDP) figures are released, debates erupt over base year changes and statistical models. These conversations, once the preserve of economists and statisticians, now play out in primetime news and social media feeds. The public is increasingly aware that changing the methodology can change the outcome, as seen in historical debates over how poverty lines are calculated, which directly impacts how many citizens are considered below the poverty line.

The Upside of Openness

This newfound focus on methodology is a powerful tool for accountability. When institutions know their methods will be examined, they are incentivised to be more rigorous and transparent. It fosters public trust, which is crucial for governance. When citizens and experts can see how a conclusion was reached, they are more likely to have confidence in it, even if they disagree with the findings. This open scrutiny can also lead to better assessments over time. By inviting public debate on their methods, organisations like NITI Aayog with its SDG India Index or other bodies conducting health and social impact assessments can refine their approaches. It creates a feedback loop that strengthens the entire process, turning a simple measurement into a collaborative tool for progress. This transparency is seen as key to the legitimacy of any investigation or assessment.

A Double-Edged Sword

However, making methodology a central part of the conversation has its challenges. Complex statistical arguments can be easily misrepresented or politicised. A government or corporation might dismiss an unfavourable report by launching a technical critique of its methodology, confusing the public and deflecting from the core findings. This can lead to a situation where, instead of debating the issue at hand—be it unemployment, pollution, or press freedom—the entire conversation gets bogged down in a proxy war over statistical techniques. There is also the risk that transparency rankings do not reflect the on-the-ground reality, creating a false sense of security or progress. If every finding is endlessly debatable based on its methods, it can lead to a sense of cynicism where the public begins to believe there is no objective truth, only competing narratives.