AI

4151 readers

1 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

159

ChatGPT gets code questions wrong 52% of the time (www.theregister.com)

submitted 1 year ago by ylai@lemmy.ml to c/artificial_intel@lemmy.ml

10 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] lloram239@feddit.de 3 points 1 year ago

Any one of us who actually codes/scripts knows ChatGPT spits out hot garbage

Not my experience at all. What it spits out is almost always pretty damn close to the goal, for shell one liners it's easily a better programmer than myself. Sometimes it might invent API calls that don't exist, but so would any human that isn't allowed to look up the documentation or compile the code for testing. I don't think I have ever seen ChatGPT spit out anything remotely close to "hot garbage". The situations where it fails the worst are the situations where there isn't any good solution to begin with.

It will confidently spit out either completely wrong or made up code with commands that don’t even exist.

And it will often be able to correct them when you tell it what's wrong or when you provide it with compiler error messages.