134
Oops! We Automated Bullshit. | Department of Computer Science and Technology
(www.cst.cam.ac.uk)
this post was submitted on 19 Nov 2023
134 points (94.1% liked)
Technology
34830 readers
22 users here now
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It's interesting to me how many people I've argued with about LLMs. They vehemently insist that this is a world changing technology and the start of the singularity.
Meanwhile whenever I attempt to use one professionally it has to be babied and tightly scoped down or else it goes way off the rails.
And structurally LLMs seem like they'll always be vulnerable to that. They're only useful because they bullshit but that also makes them impossible to rely on for anything else.
They are useful when you need to generate quasi meaningful bullshit in large volumes easily.
LLMs are being used in medicine now, not to help with diagnosis or correlate seemingly unrelated health data, but to write responses to complaint letters or generate reflective portfolio entries for appraisal.
Don't get me wrong, outsourcing the bullshit and waffle in medicine is still a win, it frees up time and energy for the highly trained organic general intelligences to do what they do best. I just don't think it's the exact outcome the industry expected.
I think it's the outcome anyone really familiar with the tech expected, but that rarely translates to marketing departments and c-suite types.
I did an LLM project in school, and while that was a limited introduction, it was enough for me to doubt most of the claims coming from LLM orgs. An LLM is good at matching its corpus and that's about it. So it'll work well for things like summaries, routine text generation, and similar tasks (and it's surprisingly good at forming believable text), but it'll always disappoint with creative work.
I'm sure the tech can do quite a bit more than my class went through, but the limitations here are quite fundamental to the tech.
That's kinda the point of my above comment: they're useful for bullshit: that's why they'll never be trustworthy