Why We Love a Good Ranking
There's an undeniable attraction to a well-ordered list. In a world saturated with information, rankings offer a shortcut to a decision. They promise clarity, cutting through complexity to declare a winner. This psychological comfort is powerful; it feels
good to have a simple answer to the question, "Which is the best?" Whether choosing a college for your child, assessing your city’s performance, or even picking a new phone, a numbered list provides a sense of certainty and authority. It simplifies the world into a clear hierarchy of good, better, and best. This appeal, however, is also a ranking’s biggest vulnerability. By boiling down multifaceted entities into a single number, crucial details and nuances are inevitably lost.
The University Ranking Maze
Consider the world of university rankings, a high-stakes arena for students and institutions alike. In India, the National Institutional Ranking Framework (NIRF) is the government-backed benchmark. It assesses institutions on parameters like Teaching, Learning & Resources (TLR), Research and Professional Practice (RP), and Graduation Outcomes (GO). But one of the most debated parameters is 'Perception' (PR), which carries a 10% weightage. This is essentially a reputation survey among academics and employers. Critics argue this creates a self-fulfilling prophecy: a university is ranked well because it has a good reputation, and it has a good reputation because it is ranked well. It often fails to capture the actual quality of teaching or student experience, instead rewarding historical prestige over current performance. An institution could be making huge strides in innovation, but if its 'perception' score lags, its overall rank will suffer.
Goodhart's Law in Action
There's a concept in economics called Goodhart's Law, which states: "When a measure becomes a target, it ceases to be a good measure." This principle perfectly explains the pitfalls of rankings. Once institutions know exactly how they are being judged, they may focus on improving the metrics rather than the underlying reality. For example, some universities have been criticised for encouraging unqualified students to apply just to be able to reject them and improve their 'selectivity' score. A more local example can be seen with city cleanliness rankings like Swachh Survekshan. While the initiative has successfully promoted sanitation, some critics note that municipalities may engage in a 'survey season deep clean,' focusing resources on beautifying main roads where surveyors are likely to visit, while neglecting interior lanes. The metric (a clean-looking city) is achieved, but the goal (consistent, city-wide cleanliness) may be compromised.
What Aren't They Telling You?
The most useful rankings are the most transparent. If a list doesn't clearly explain its methodology—the criteria used, the sources of its data, and the weight given to each factor—it should be treated with deep scepticism. Some 'Best Places to Live' rankings are notorious for this, blending objective data like crime rates with subjective notions of 'livability' without revealing how they are combined. A city might be ranked highly for its green spaces and cultural institutions, but the ranking might ignore that it's unaffordable for an average family. The criteria chosen reflect a set of values. By prioritising certain metrics, a ranking is making an argument for what is important. A good ranking is honest about its biases; a poor one hides them behind an authoritative-looking number.
How to Read a Ranking Intelligently
So, should we dismiss all rankings? Not necessarily. They can be a useful starting point, provided you approach them with a critical eye. First, always hunt for the 'Methodology' section. Understand what is being measured and, just as importantly, what is being ignored. Does a business school ranking value starting salaries above all else, or does it consider work-life balance? Second, consider the source. Who is publishing the ranking, and what are their interests? A ranking is a product, and it is often designed to generate headlines. Third, use rankings as just one tool in your decision-making toolkit. Don't let a number replace your own research and judgment. If a university is ranked #1 but doesn't have a strong program in your field of interest, its top rank is irrelevant to you. A ranking is a map, but it is not the territory.
