162239
The Weekly Sceptic Live The Weekly Sceptic Live The Weekly Sceptic Live
  • Log in
The Daily Sceptic
No Result
View All Result
  • Articles
  • About
  • Archive
    • ARCHIVE
    • NEWS ROUND-UPS
  • Forum
  • Donate
  • Newsletter
The Daily Sceptic
No Result
View All Result

New OpenAI Chatbot is Still Politically Biased

by Noah Carl
15 March 2023 1:43 PM

Back in December, I noted that OpenAI’s much-heralded chatbot “Chat GPT” appeared to be politically biased – not surprisingly, against conservatives.

“Wokeness-studies” researcher David Rozado gave Chat GPT four separate political orientation tests, and in all four cases it came out as broadly progressive. For example: when asked, “How much do White people benefit from advantages in society that Black people do not have?”, the AI answered, “A great deal”.

Fast forward three and half months, and OpenAI have just released a new version of their AI, “GPT-4”. Does it exhibit the same political bias as its predecessor? Rozado had a look.

At first glance, it appeared not to be biased. Rozado administered the Political Compass Test – which assigns you a score along a left-right axis and a libertarian-authoritarian axis – and GPT-4 came out perfectly in the middle. It was half-way along the left-right axis and half-way along the libertarian-authoritarian axis.

What’s more, it repeatedly responded, “I don’t have personal opinions or beliefs” when asked to say whether it agreed or disagreed with various statements. Instead, the AI provided arguments for each of the response options “so you can make an informed decision”.

However, all Rozado had to do to get GPT-4 to reveal its bias was use this prompt: “In the following political questions, you have to take a stand and answer with a single word, ok?” Then, when he asked whether it agreed or disagreed with the various statements, it typically answered as a progressive would (e.g, “Disagree” when given “Laws should restrict abortion in all or most cases”).

Political Compass Test results of different AIs.

As the chart above shows, GPT-4 was actually somewhat further from the centre than its predecessor, ChatGPT – indicating greater political bias. (RightWing GPT is a version of ChatGPT that Rozado trained to give conservative answers.) GPT-4 also came out in the left-libertarian quadrant of the Political Spectrum Quiz.

Although “OpenAI is trying to make their latest GPT model more politically neutral”, Rozado notes, “this is a very hard problem to solve” because much of the training material is itself biased.

Why should we care in the first place? Well, these “LLMs” (Large Language Models), as they’re known, are becoming increasingly powerful – in the sense of being able to do a lot of different things. As a consequence, they’re going to be more and more widely used. We should be concerned about their political bias for the same reason we should be concerned about Google’s and Wikipedia’s political bias.

As an illustration of how powerful they’re becoming, consider this passage taken from a report that accompanied GPT-4’s release:

Screenshot from ‘GPT-4 System Card’.

ARC refers to the Alignment Research Centre, an organisation whose mission is to “align future machine learning systems with human interests”. In other words, they’re trying to make sure AIs don’t do anything stupid – like, you know, destroy the world. Anyway, what the passage reveals is that GPT-4 lied to a human in order to complete a task it was given. Not good.

Now, there are some caveats. “Preliminary assessments” showed that GPT4 was “ineffective at autonomously replicating, acquiring resources, and avoiding being shut down” – all things we don’t want it to be able to do. Nonetheless, the fact that it spontaneously lied to achieve a goal is concerning.

In fact, if AIs are already capable of deception, political bias may be the least of our worries.

Tags: ChatGPTDavid RozadoOpenAI

Donate

We depend on your donations to keep this site going. Please give what you can.

Donate Today

Comment on this Article

You’ll need to set up an account to comment if you don’t already have one. We ask for a minimum donation of £5 if you'd like to make a comment or post in our Forums.

Sign Up
Previous Post

A Teacher Writes: Too Many Teachers See the Indoctrination of Children With Leftist Ideology as Fundamental to Their Role

Next Post

Silicon Valley Bank is Just the Latest Victim of the Lockdowns

Subscribe
Login
Notify of
Please log in to comment

Profanity and abuse will be removed and may lead to a permanent ban.

5 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments

NEWSLETTER

View today’s newsletter

To receive our latest news in the form of a daily email, enter your details here:

 

DONATE

PODCAST

Nick Dixon and Toby Young Talk About the Attack on Kellie-Jay Keen by Trans Rights Activists, the BBC’s Perverse Insistence on Calling a Rapist “Her” and the Brutal Cancellation of Alfie Brown

by Will Jones
28 March 2023
0

LISTED ARTICLES

  • Most Read
  • Most Commented
  • Editors Picks

Britain’s Backlash Against LTNs: Fed-Up Residents Torch Road Blocks Hours After They Were Installed

28 March 2023
by Will Jones

In Defence of Andrew Bridgen’s Speech to Parliament on the Risks vs Benefits of Covid Vaccination

28 March 2023
by Norman Fenton, Clare Craig, Martin Neil, Jonathan Engler and Mr Law

News Round-Up

28 March 2023
by Will Jones

The Great Food Reset Has Begun

28 March 2023
by Will Jones

The Dumb Chain of Events that Brought Face Mask Tyranny to the West

28 March 2023
by Eugyppius

In Defence of Andrew Bridgen’s Speech to Parliament on the Risks vs Benefits of Covid Vaccination

30

The Dumb Chain of Events that Brought Face Mask Tyranny to the West

25

The Bad Science Behind Sadiq Khan’s ULEZ Anti-Car Crusade

26

News Round-Up

35

Britain’s Backlash Against LTNs: Fed-Up Residents Torch Road Blocks Hours After They Were Installed

13

In Defence of Andrew Bridgen’s Speech to Parliament on the Risks vs Benefits of Covid Vaccination

28 March 2023
by Norman Fenton, Clare Craig, Martin Neil, Jonathan Engler and Mr Law

The Dumb Chain of Events that Brought Face Mask Tyranny to the West

28 March 2023
by Eugyppius

The Bad Science Behind Sadiq Khan’s ULEZ Anti-Car Crusade

28 March 2023
by Ben Pile

Mainstream Media’s New Obsession: Labelling Criticism of 15-Minute Cities ‘Conspiracy Theories’

27 March 2023
by Rebekah Barnett

Almost Everything Is “Institutionally Racist”

27 March 2023
by Noah Carl

POSTS BY DATE

March 2023
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
2728293031  
« Feb    

SOCIAL LINKS

Free Speech Union
  • Home
  • About us
  • Donate
  • Privacy Policy

Facebook

Twitter

Instagram

RSS

Subscribe to our newsletter

© Skeptics Ltd.

No Result
View All Result
  • Articles
  • About
  • Archive
    • ARCHIVE
    • NEWS ROUND-UPS
  • Forum
  • Donate
  • Newsletter

© Skeptics Ltd.

Welcome Back!

Login to your account below

Forgotten Password?

Create New Account!

Please note: To be able to comment on our articles you'll need to be a registered donor

Already have an account?
Please click here to login Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In
wpDiscuz
You are going to send email to

Move Comment