First, What Is a Preprint?
Think of a preprint as a researcher's draft manuscript, made public on servers like bioRxiv or medRxiv before it has undergone formal peer review. Peer review is the traditional process where a study is scrutinized by other experts in the field before being
published in a scientific journal. Preprints skip this initial step, allowing scientists to share their work almost instantly. The practice became especially widespread during the COVID-19 pandemic, when the need to share findings about the virus was urgent. It’s science in real-time, giving researchers a chance to establish their findings and get early feedback from a global community.
What the 72,000-Preprint Study Revealed
To understand how reliable these drafts are, researchers recently conducted a huge analysis comparing 72,644 biomedical preprints to their final, peer-reviewed versions. The findings, which were themselves posted as a preprint, were largely reassuring. The study found that for the vast majority of papers, the main conclusions did not change significantly after peer review. In about 40% of cases, the core claim was identical, and in another 50%, it was only revised slightly. Only about 10% of studies had their conclusions substantially rewritten. Interestingly, when changes did occur, they tended to make the claims more cautious, not more sensational.
The Benefit: Science at High Speed
The primary advantage of preprints is speed. The traditional journal publication process can take months or even years. During a public health crisis like a pandemic, that delay is not feasible. Preprints allow crucial data on everything from viral transmission to vaccine effectiveness to be shared with the global scientific community immediately, accelerating collaboration and discovery. This open access also democratizes science, making new research available to everyone, not just those with expensive journal subscriptions. For early-career scientists, it's also a way to get credit for their ideas quickly and receive feedback to improve their work.
The Limit: A High-Stakes First Draft
The biggest drawback is the lack of formal vetting. Since preprints haven't been peer-reviewed, they can contain honest errors, flawed methodologies, or overstated claims. During the pandemic, this sometimes led to the rapid spread of unverified information by news outlets and on social media, creating public confusion. While many studies show that most preprints hold up well, some do undergo major changes to their conclusions after peer review. One study found that about 17% of COVID-19 preprints had major changes in their conclusions upon final publication. This highlights the risk of treating a preliminary finding as a final, established fact.
How to Be a Smarter Science Reader
In an age of information overload, understanding preprints is crucial. When you encounter a new scientific claim, first check the source. Is it a peer-reviewed journal or a preprint server? If it's a preprint, treat it as a preliminary, unvetted report. Look for comments or reactions from other experts in the field, who often provide crucial context. Be skeptical of sensational headlines based on a single preprint study. Science is a process of revision and refinement; a preprint is just the first public step. The reassuring takeaway from large analyses is that most preprints are reliable starting points, but they are not the final word.
