this post was submitted on 27 May 2024
1102 points (98.0% liked)

Technology

59414 readers
2842 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of  AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

you are viewing a single comment's thread
view the rest of the comments
[–] PumpkinEscobar@lemmy.world 52 points 5 months ago (1 children)

Rip up the Reddit contract and don’t use that data to train the model. It’s the definition of a garbage in garbage out problem.

[–] SeaJ@lemm.ee 9 points 5 months ago (2 children)

Jesus. I didn't even think of that. I could totally see that being a big part of why it is giving garbage answers.

[–] teejay@lemmy.world 25 points 5 months ago (1 children)

Just imagine the average reddit, twitter, facebook, and instagram content. Then realize that half of that content is dumber than that. That's half of what these AI models use to learn. The "smarter" half is probably filled with sarcasm, inside jokes, and other types of innuendo that the AI at this stage has no chance of understanding correctly.

[–] SeaJ@lemm.ee 16 points 5 months ago (1 children)

Reminds me of the time Microsoft unleashed their AI Twitter account and it turned into a Nazi after a couple hours. Whatever straight out of business school idiot who thought scraping the comments of the armpit of the internet was a good idea should be banned from any management position. At least it is a step up from scraping 4chan, I guess.

[–] Xatolos@reddthat.com 2 points 5 months ago

The Microsoft Tay one I can understand though. Before it was released, they had also had Microsoft Xiaoice which had been in use for 2 years prior without this issue. Yay was just the English version of that.

[–] FlyingSquid@lemmy.world 7 points 5 months ago

The glue on pizza one literally came from a Reddit post.