this post was submitted on 14 Jul 2024
486 points (96.6% liked)

Technology

59106 readers
3524 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

AI is overhyped and unreliable -Goldman Sachs

https://www.404media.co/goldman-sachs-ai-is-overhyped-wildly-expensive-and-unreliable/

"Despite its expensive price tag, the technology is nowhere near where it needs to be in order to be useful for even such basic tasks"

@technology@lemmy.world

you are viewing a single comment's thread
view the rest of the comments
[–] smiletolerantly@awful.systems 9 points 3 months ago

I was fully on board until, like, a year ago. But the more I used it, the more obviously it came undone.

I initially felt like it could really help with programming. And it looked like it, too - when you fed it toy problems where you don't really care about how the solution looks, as long as it's somewhat OK. But once you start giving it constraints that stem from a real project, it just stops being useful. It ignores constraints (use this library, do not make additional queries, ...), and when you point out its mistake and ask it to to better it goes "oh, sorry! Here, let me do the same thing again, with the same error!".

If you're working in a less common language, it even dreams up non-existing syntax.

Even the one thing it should be good at - plain old language - it sucks ass at. It's become so easy to spot LLM garbage, just due to its style.

Worse, asking it to proofread a text for spelling and grammar mistakes, but to explicitly do not change the wording or style, there's about a 50/50 chance it will either

  • change your wording or style, or
  • point out errors that are not even in the original text in the first place!

I could honestly go on and on, but what it boils down to is: it is able to string together words that make it sound like it knows what it is doing, but it is just that, a facade. And it looks like for more and more people, the spell is finally breaking.