138124
  • Log in
The Daily Sceptic
No Result
View All Result
  • Articles
  • About
  • Archive
    • ARCHIVE
    • NEWS ROUND-UPS
  • Forum
  • Donate
  • Newsletter
The Daily Sceptic
No Result
View All Result

Social Scientists Can’t Predict Better Than Simple Models, Study Finds

by Noah Carl
14 October 2022 9:00 AM

I previously covered a study which found social scientists can’t predict better than laymen. As you may recall, ‘experts’ and laymen were asked to predict the size and direction of social change in the U.S. between April and October of 2020. Overall, the two groups were equally inaccurate – there was no overall advantage for the ‘experts’.

A new study finds that social scientists can’t predict better than simple models either. (The study is a pre-print, so hasn’t yet been peer reviewed.)

Dillon Bowen collated data from several previous studies in which ‘experts’ had been asked to predict the impact of various interventions on people’s behaviour. His analysis covered five previous studies, but I’ll focus on the first three since the other two are rather complicated.

In the first study, 90 ‘experts’ were asked to predict how effective 53 different nudges would be at encouraging gym users to exercise more often. These nudges included things like administering a free audiobook and a bonus for returning after missed workouts.

In the second study, 24 ‘experts’ were asked to predict how effective 22 text-message interventions would be at encouraging Walmart customers to get a flu vaccine. These interventions included things like a simple reminder and a joke about the flu.

In the third study, 237 ‘experts’ were asked to predict how effective interventions carried out by two government nudge units would be at changing citizens’ behaviour. These interventions encompassed domains like healthcare, state benefits and community engagement.

For all three studies, Bowen compared the ‘expert’ predictions to a null model that said none of the interventions would work (i.e., none of them would change subjects’ behaviour by a statistically significant amount).

Remarkably, he found that in all three cases the null model performed better than the ‘experts’.

In other words, the ‘experts’ overestimated the interventions’ effects by such an extent that they would have been more accurate by simply guessing ‘no effect’ for every single one. Or put in other way, the effects of the interventions were generally closer to zero than they were to the ‘experts’ predictions.

Behavioural interventions are widely used by governments and other interventions to tweak people’s behaviour without coercing them. Yet practitioners consistently overestimate how well these interventions work. As it turns out, ‘they don’t work at all’ is a safer assumption than whatever the ‘experts’ are saying.

Tags: ExpertsSocial scienceThe Science

Donate

We depend on your donations to keep this site going. Please give what you can.

Donate Today

Comment on this Article

You’ll need to set up an account to comment if you don’t already have one. We ask for a minimum donation of £5 if you'd like to make a comment or post in our Forums.

Sign Up
Previous Post

A Look Back at the Demonisation of the Unvaccinated

Next Post

Study on All-Cause Deaths by Vaccination Status Makes Absurd Claim That a Fourth Dose Cuts Total Deaths by Two Thirds

Subscribe
Login
Notify of
Please log in to comment

Profanity and abuse will be removed and may lead to a permanent ban.

19 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments

NEWSLETTER

View today’s newsletter

To receive our latest news in the form of a daily email, enter your details here:

DONATE

PODCAST

Nick Dixon and Toby Young Talk About Toby’s Appearance on the 77th Brigade’s Watch List, the Scrubbing of the Internet After the Pfizer Sting and the Trans Insanity Unfolding in Scotland

by Will Jones
31 January 2023
0

LISTED ARTICLES

  • Most Read
  • Most Commented
  • Editors Picks

MIT Expert on Drug Safety Calls for Immediate Withdrawal of mRNA Vaccines: “Clearly the Most Failing Medical Product in History, Causing Unprecedented Harm”

30 January 2023
by Will Jones

News Round-Up

31 January 2023
by Will Jones

Scientists Struggle to Understand Why Antarctica Hasn’t Warmed for Over 70 Years Despite Rise in CO2

29 January 2023
by Chris Morrison

The Ministry of Truth

31 January 2023
by Dr Carl Heneghan and Dr Tom Jefferson

The JCVI is Right to Withdraw Boosters for Under-50s, But It’s Still Spinning the Stats

31 January 2023
by Amanuensis

News Round-Up

48

Elderly Vaccination Saved Lives in East Asia

39

The JCVI is Right to Withdraw Boosters for Under-50s, But It’s Still Spinning the Stats

34
Mandatory Credit: Photo by JUSTIN LANE/EPA-EFE/Shutterstock (10421665ds)
Sixteen-year-old climate activist Greta Thunberg addresses world leaders at the start of the 2019 Climate Action Summit which is being held in advance of the General Debate of the General Assembly of the United Nations at United Nations Headquarters in New York, New York, USA, 23 September 2019. World Leaders have been invited to speak at the event, which was organized by the United Nations Secretary-General Antonio Guterres, for the purpose of proposing plans for addressing global climate change. The General Debate of the 74th session of the UN General Assembly begins on 24 September.
United Nations 2019 Climate Action Summit, New York, USA - 23 Sep 2019

Elite Billionaire Foundations Fund Wave of Green Climate Propaganda Flooding into British Schools

18

The Ministry of Truth

14

Elderly Vaccination Saved Lives in East Asia

31 January 2023
by Noah Carl
Mandatory Credit: Photo by JUSTIN LANE/EPA-EFE/Shutterstock (10421665ds)
Sixteen-year-old climate activist Greta Thunberg addresses world leaders at the start of the 2019 Climate Action Summit which is being held in advance of the General Debate of the General Assembly of the United Nations at United Nations Headquarters in New York, New York, USA, 23 September 2019. World Leaders have been invited to speak at the event, which was organized by the United Nations Secretary-General Antonio Guterres, for the purpose of proposing plans for addressing global climate change. The General Debate of the 74th session of the UN General Assembly begins on 24 September.
United Nations 2019 Climate Action Summit, New York, USA - 23 Sep 2019

Elite Billionaire Foundations Fund Wave of Green Climate Propaganda Flooding into British Schools

31 January 2023
by Chris Morrison

The JCVI is Right to Withdraw Boosters for Under-50s, But It’s Still Spinning the Stats

31 January 2023
by Amanuensis

MIT Expert on Drug Safety Calls for Immediate Withdrawal of mRNA Vaccines: “Clearly the Most Failing Medical Product in History, Causing Unprecedented Harm”

30 January 2023
by Will Jones

In Praise of Boris Johnson’s Stance on Ukraine

28 January 2023
by Noah Carl

POSTS BY DATE

October 2022
M T W T F S S
 12
3456789
10111213141516
17181920212223
24252627282930
31  
« Sep   Nov »

SOCIAL LINKS

Free Speech Union
  • Home
  • About us
  • Donate
  • Privacy Policy

Facebook

Twitter

Instagram

RSS

Subscribe to our newsletter

© Skeptics Ltd.

No Result
View All Result
  • Articles
  • About
  • Archive
    • ARCHIVE
    • NEWS ROUND-UPS
  • Forum
  • Donate
  • Newsletter

© Skeptics Ltd.

Welcome Back!

Login to your account below

Forgotten Password?

Create New Account!

Please note: To be able to comment on our articles you'll need to be a registered donor

Already have an account?
Please click here to login Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In
wpDiscuz
You are going to send email to

Move Comment