Source: Tim LeckembyIn its latest postmortem, it said such behavior from its AI could pose a risk, especially concerning issues such as mental health.“People have started to use ChatGPT for deeply personal advice — something we didn’t see as much even a year ago,” OpenAI said.“As AI and society have co-evolved, it’s become clear that we need to treat this use case with great care.”Related: Crypto users cool with AI dabbling with their portfolios: Survey The company said it had discussed sycophancy risks “for a while,” but it hadn’t been explicitly flagged for internal testing, and it didn’t have specific ways to track sycophancy.
OpenAI is now checking for suck up answersAfter the updated AI model rolled out, ChatGPT users had complained online about its tendency to shower praise on any idea it was presented, no matter how bad, which led OpenAI to concede in an April 29 blog post that it “was overly flattering or agreeable.”For example, one user told ChatGPT it wanted to start a business selling ice over the internet, which involved selling plain old water for customers to refreeze.
During the latest model’s review process before it went public, OpenAI said that “some expert testers had indicated that the model’s behavior ‘felt’ slightly off” but decided to launch “due to the positive signals from the users who tried out the model.”“Unfortunately, this was the wrong call,” the company admitted.“The qualitative assessments were hinting at something important, and we should’ve paid closer attention.
or
Share This Story
Article Details
Author / Journalist: Cointelegraph by Jesse Coghlan
The story "OpenAI ignored experts when it released overly agreeable ChatGPT" has 580 words across 17 sentences, which will take approximately 3 - 5 minutes for the average person to read.
Which news outlet covered this story?
The story "OpenAI ignored experts when it released overly agreeable ChatGPT" was covered 15 hours ago by Coin Telegraph, a news publisher based in United States.
How trustworthy is 'Coin Telegraph' news outlet?
Coin Telegraph is a fully independent (privately-owned) news outlet established in 2013 that covers mostly crypto news.
The outlet is headquartered in United States and publishes an average of 23 news stories per day.
It's most recent story was published 7 hours ago.
What do people currently think of this news story?
The sentiment for this story is currently Neutral, indicating that people are not responding positively or negatively to this news.
How do I report this news for inaccuracy?
You can report an inaccurate news publication to us via our contact page. Please also include the news #ID number and the URL to this story.
