this post was submitted on 29 Apr 2024
195 points (94.9% liked)

Technology

59284 readers
4276 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] db0@lemmy.dbzer0.com 21 points 6 months ago (1 children)

It's not that their reasoning is a black box. It's that they do not have reasoning! They just guess what the next word in the sentence is likely to be.

[–] GiveMemes@jlai.lu 4 points 6 months ago (1 children)

I mean it's a bit more complicated than that, but at its core, yes, this is correct. Highly recommend this video.

https://www.youtube.com/watch?v=wjZofJX0v4M

[–] kureta@lemmy.ml 2 points 6 months ago

it's not even a little bit more complicated than that. They are literally trained to predict the next token given a series of previous tokens. The way that they do that is very complicated and the amount of data they are trained on is huge. That's why they have to give correct information sometimes to sound plausible. Providing accurate information is literally a side effect of the actual thing they are trained to do.