149265
The Weekly Sceptic Live The Weekly Sceptic Live The Weekly Sceptic Live
  • Log in
The Daily Sceptic
No Result
View All Result
  • Articles
  • About
  • Archive
    • ARCHIVE
    • NEWS ROUND-UPS
  • Forum
  • Donate
  • Newsletter
The Daily Sceptic
No Result
View All Result

How Much of Science Is Reproducible?

by Noah Carl
27 December 2022 7:00 AM

Reproducibility is the most fundamental yardstick in science. If a result can’t be replicated, it doesn’t count as science.

Yet in recent years, there has been much talk of a ‘replication crisis’. Many results that we assumed were robust simply cannot be replicated. The term is typically used in the context of psychology and medicine, though it may apply to other fields as well.

So how much of science is reproducible? One way of tackling this question is to select a large number of studies from a particular field and then attempt to replicate them. This has been done several times.

A 2012 paper was only able to replicate 11% of 53 studies from pre-clinical cancer. A 2015 paper was only able to replicate 36% of 97 studies from psychology. A 2018 paper did slightly better, replicating 54% of 28 studies from that field. A 2016 paper was able to replicate 60% of 60% of 100 economics experiments. Another 2018 paper was able to replicate 62% of 21 social science experiments.

These numbers are sobering. But there’s an important caveat: the ‘studies to be replicated’ were selected somewhat arbitrarily, so the corresponding percentage can’t be taken as representative of the entire field.

Another way of tackling the question above is to simply ask researchers what percentage of the studies in your field can be replicated – a sort of ‘wisdom of the crowds’ approach.

This was done in a 2016 survey by the journal Nature. They got 1,500 responses – the vast majority from currently-working scientists. Respondents were asked, “In your opinion, what proportion of published work in your field is reproducible?”

The highest figure – 72% – was found in physics. The lowest figure – 52% – was found in “other” (which I suspect is mostly social scientists). Environmental science and medicine had intermediate figures – both 58%. Chemistry was a little higher at 65%. (Answers did not differ substantially between students and working scientists.)

These figures are again sobering. According to researchers themselves, close to half of published work in medicine, social science and environmental science cannot be replicated. Unsurprisingly, more ‘objective’ fields like physics and chemistry are perceived to have higher rates of replicability.

Overall, the two methods yield similar findings: a large percentage of results in more ‘subjective’ – dare one say ‘politicized’ – fields are not reproducible.

Tags: NatureReplication crisisThe Science

Donate

We depend on your donations to keep this site going. Please give what you can.

Donate Today

Comment on this Article

You’ll need to set up an account to comment if you don’t already have one. We ask for a minimum donation of £5 if you'd like to make a comment or post in our Forums.

Sign Up
Previous Post

News Round-Up

Next Post

Latest Twitter Files Reveal Company Suppressed Vaccine Sceptics, Even Eminent Doctors

Subscribe
Login
Notify of
Please log in to comment

Profanity and abuse will be removed and may lead to a permanent ban.

7 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments

NEWSLETTER

View today’s newsletter

To receive our latest news in the form of a daily email, enter your details here:

 

DONATE

PODCAST

Nick Dixon and Toby Young Talk About the Attack on Kellie-Jay Keen by Trans Rights Activists, the BBC’s Perverse Insistence on Calling a Rapist “Her” and the Brutal Cancellation of Alfie Brown

by Will Jones
28 March 2023
0

LISTED ARTICLES

  • Most Read
  • Most Commented
  • Editors Picks

Britain’s Backlash Against LTNs: Fed-Up Residents Torch Road Blocks Hours After They Were Installed

28 March 2023
by Will Jones

News Round-Up

28 March 2023
by Will Jones

In Defence of Andrew Bridgen’s Speech to Parliament on the Risks vs Benefits of Covid Vaccination

28 March 2023
by Norman Fenton, Clare Craig, Martin Neil, Jonathan Engler and Mr Law

The Great Food Reset Has Begun

28 March 2023
by Will Jones

The Dumb Chain of Events that Brought Face Mask Tyranny to the West

28 March 2023
by Eugyppius

In Defence of Andrew Bridgen’s Speech to Parliament on the Risks vs Benefits of Covid Vaccination

30

The Dumb Chain of Events that Brought Face Mask Tyranny to the West

25

The Bad Science Behind Sadiq Khan’s ULEZ Anti-Car Crusade

25

News Round-Up

35

Britain’s Backlash Against LTNs: Fed-Up Residents Torch Road Blocks Hours After They Were Installed

13

In Defence of Andrew Bridgen’s Speech to Parliament on the Risks vs Benefits of Covid Vaccination

28 March 2023
by Norman Fenton, Clare Craig, Martin Neil, Jonathan Engler and Mr Law

The Dumb Chain of Events that Brought Face Mask Tyranny to the West

28 March 2023
by Eugyppius

The Bad Science Behind Sadiq Khan’s ULEZ Anti-Car Crusade

28 March 2023
by Ben Pile

Mainstream Media’s New Obsession: Labelling Criticism of 15-Minute Cities ‘Conspiracy Theories’

27 March 2023
by Rebekah Barnett

Almost Everything Is “Institutionally Racist”

27 March 2023
by Noah Carl

POSTS BY DATE

December 2022
M T W T F S S
 1234
567891011
12131415161718
19202122232425
262728293031  
« Nov   Jan »

SOCIAL LINKS

Free Speech Union
  • Home
  • About us
  • Donate
  • Privacy Policy

Facebook

Twitter

Instagram

RSS

Subscribe to our newsletter

© Skeptics Ltd.

No Result
View All Result
  • Articles
  • About
  • Archive
    • ARCHIVE
    • NEWS ROUND-UPS
  • Forum
  • Donate
  • Newsletter

© Skeptics Ltd.

Welcome Back!

Login to your account below

Forgotten Password?

Create New Account!

Please note: To be able to comment on our articles you'll need to be a registered donor

Already have an account?
Please click here to login Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In
wpDiscuz
You are going to send email to

Move Comment