AI

4151 readers

1 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

159

ChatGPT gets code questions wrong 52% of the time (www.theregister.com)

submitted 1 year ago by ylai@lemmy.ml to c/artificial_intel@lemmy.ml

10 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Kuvwert@lemm.ee 7 points 1 year ago (2 children)

52% In the first year is pretty cool, excited to see how it will evolve.

[–] SirGolan@lemmy.sdf.org 3 points 1 year ago

GPT4 with reflexion prompting gets 90% correct (for HumanEval coding benchmark). The paper this is based on is misleading at best.

[–] circuitfarmer@lemmy.sdf.org 2 points 1 year ago

Probably far enough that anyone with an actual interest will be out of a job.