149265
  • Log in
The Daily Sceptic
No Result
View All Result
  • Articles
  • About
  • Archive
    • ARCHIVE
    • NEWS ROUND-UPS
  • Forum
  • Donate
  • Newsletter
The Daily Sceptic
No Result
View All Result

How Much of Science Is Reproducible?

by Noah Carl
27 December 2022 7:00 AM

Reproducibility is the most fundamental yardstick in science. If a result can’t be replicated, it doesn’t count as science.

Yet in recent years, there has been much talk of a ‘replication crisis’. Many results that we assumed were robust simply cannot be replicated. The term is typically used in the context of psychology and medicine, though it may apply to other fields as well.

So how much of science is reproducible? One way of tackling this question is to select a large number of studies from a particular field and then attempt to replicate them. This has been done several times.

A 2012 paper was only able to replicate 11% of 53 studies from pre-clinical cancer. A 2015 paper was only able to replicate 36% of 97 studies from psychology. A 2018 paper did slightly better, replicating 54% of 28 studies from that field. A 2016 paper was able to replicate 60% of 60% of 100 economics experiments. Another 2018 paper was able to replicate 62% of 21 social science experiments.

These numbers are sobering. But there’s an important caveat: the ‘studies to be replicated’ were selected somewhat arbitrarily, so the corresponding percentage can’t be taken as representative of the entire field.

Another way of tackling the question above is to simply ask researchers what percentage of the studies in your field can be replicated – a sort of ‘wisdom of the crowds’ approach.

This was done in a 2016 survey by the journal Nature. They got 1,500 responses – the vast majority from currently-working scientists. Respondents were asked, “In your opinion, what proportion of published work in your field is reproducible?”

The highest figure – 72% – was found in physics. The lowest figure – 52% – was found in “other” (which I suspect is mostly social scientists). Environmental science and medicine had intermediate figures – both 58%. Chemistry was a little higher at 65%. (Answers did not differ substantially between students and working scientists.)

These figures are again sobering. According to researchers themselves, close to half of published work in medicine, social science and environmental science cannot be replicated. Unsurprisingly, more ‘objective’ fields like physics and chemistry are perceived to have higher rates of replicability.

Overall, the two methods yield similar findings: a large percentage of results in more ‘subjective’ – dare one say ‘politicized’ – fields are not reproducible.

Tags: NatureReplication crisisThe Science

Donate

We depend on your donations to keep this site going. Please give what you can.

Donate Today

Comment on this Article

You’ll need to set up an account to comment if you don’t already have one. We ask for a minimum donation of £5 if you'd like to make a comment or post in our Forums.

Sign Up
Previous Post

News Round-Up

Next Post

Latest Twitter Files Reveal Company Suppressed Vaccine Sceptics, Even Eminent Doctors

Subscribe
Login
Notify of
Please log in to comment

Profanity and abuse will be removed and may lead to a permanent ban.

7 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments

NEWSLETTER

View today’s newsletter

To receive our latest news in the form of a daily email, enter your details here:

 

DONATE

PODCAST

Nick Dixon and Toby Young Talk About the Fall of Russell Brand, the BBC’s Trans Rights Activism and Graham Linehan Topping the Bestseller List

by Will Jones
19 September 2023
5

LISTED ARTICLES

  • Most Read
  • Most Commented
  • Editors Picks

News Round-Up

21 September 2023
by Richard Eldred

Generation Z Can’t Work Alongside People with Different Views and Don’t have the Skills to Debate, says Channel 4 Boss – as She Blames the Lockdowns

21 September 2023
by Will Jones

“You’d Have to Pay Me to Buy an Electric Car”

20 September 2023
by Will Jones

Rumble Rejects MPs’ “Dangerous” Demand to Cave into Russell Brand “Cancel Culture Mob”

21 September 2023
by Will Jones

The Terrible Truth is That Even Sunak’s Mild Net Zero Relaxation May Be Unlawful

21 September 2023
by Will Jones

News Round-Up

56

Rumble Rejects MPs’ “Dangerous” Demand to Cave into Russell Brand “Cancel Culture Mob”

34

The Terrible Truth is That Even Sunak’s Mild Net Zero Relaxation May Be Unlawful

31

Generation Z Can’t Work Alongside People with Different Views and Don’t have the Skills to Debate, says Channel 4 Boss – as She Blames the Lockdowns

27

“You’d Have to Pay Me to Buy an Electric Car”

29

Spikes in Heart Deaths Among Japan’s Working-Age Men Support the ‘Hot Lot Hypothesis’ – That Some Covid Vaccine Batches Are Much Worse Than Others

21 September 2023
by Guy Gin

There’s Only One Way to Halt the Spread of Pernicious Trans Guidance: the ‘Public Sector Equality Duty’ Must Go

21 September 2023
by Caroline ffiske

Why Are UN Human Rights Advocates Obsessed With Legalising the Sex Trade?

20 September 2023
by Dr David McGrogan

Nigeria is in No Fit State to Look After Precious Artefacts

20 September 2023
by Mike Wells

Education is Much More Expensive Than We Are Prepared to Admit

20 September 2023
by Mark Ellse

POSTS BY DATE

December 2022
M T W T F S S
 1234
567891011
12131415161718
19202122232425
262728293031  
« Nov   Jan »

SOCIAL LINKS

Free Speech Union
  • Home
  • About us
  • Donate
  • Privacy Policy

Facebook

Twitter

Instagram

RSS

Subscribe to our newsletter

© Skeptics Ltd.

No Result
View All Result
  • Articles
  • About
  • Archive
    • ARCHIVE
    • NEWS ROUND-UPS
  • Forum
  • Donate
  • Newsletter

© Skeptics Ltd.

Welcome Back!

Login to your account below

Forgotten Password?

Create New Account!

Please note: To be able to comment on our articles you'll need to be a registered donor

Already have an account?
Please click here to login Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In
wpDiscuz
You are going to send email to

Move Comment