Every month, headlines announce the latest business confidence or Purchasing Managers’ Index (PMI) numbers, shaping market sentiment. But what do these private-sector surveys really tell us? They are a vital tool, but they have their limits.
What Are These Surveys, Anyway?
Private-sector
business surveys are questionnaires sent to a panel of companies to gauge their sentiment on the economy. One of the most-watched is the Purchasing Managers' Index (PMI), which asks managers about business conditions. These surveys measure metrics like new orders, production levels, employment, and supplier deliveries. The results are compiled into a single index number. For a PMI, a reading above 50 suggests the sector is expanding, while a reading below 50 indicates a contraction. Their main advantage is timeliness; they are often the first piece of economic data available for a given month, released long before official government statistics like GDP.
Feeling vs. Fact: Soft vs. Hard Data
Business surveys provide what economists call 'soft data'—they measure sentiment, opinions, and expectations. This contrasts with 'hard data', which are concrete, measurable figures like actual production output or retail sales figures published by government agencies. While the two usually move in the same direction, they can diverge, especially during times of uncertainty. For example, business leaders might report feeling pessimistic (soft data) even while consumer spending remains strong (hard data). Relying only on sentiment can be misleading because it reflects how businesses feel about the future, not necessarily what is actually happening on the ground.
The Problem of Who Responds
A major limitation of any survey is sampling bias, which occurs when the group of respondents isn't representative of the entire economy. For instance, a survey might over-represent large manufacturing firms while missing the nuances of the vast services sector or smaller businesses. Furthermore, there's non-response bias. Companies that are thriving might be more inclined to respond than those that are struggling, or vice-versa, skewing the overall picture. If the businesses that choose not to participate have significantly different outlooks from those that do, the final result won't be accurate.
It’s Not What You Say, It’s How You Say It
The design of the survey itself can create limitations. Many PMI surveys ask managers if conditions are 'better', 'the same', or 'worse' compared to the previous month. This approach has a critical flaw: it measures the breadth of change, not the magnitude. For instance, a survey could show a strong expansionary reading simply because a vast majority of businesses reported a tiny improvement. Conversely, a contractionary reading could happen even if the economy is growing, provided that the companies shrinking did so by more than the growing companies expanded. This means a headline PMI number doesn't tell you how much better or worse things are, just the direction.
Beware of Hidden Motives
It's also crucial to consider the source of the survey. Some business surveys are conducted by organisations with a commercial interest in the results. A financial services company that provides business loans, for example, might publish a survey highlighting that small businesses are facing cash-flow problems. While not necessarily inaccurate, the framing of such surveys can be designed to promote a particular service or agenda. This doesn't invalidate the data, but it does mean readers should maintain a healthy dose of skepticism and consider who sponsored the research and why.
