this post was submitted on 11 Jun 2024
156 points (90.2% liked)

AI

4142 readers
1 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago
you are viewing a single comment's thread
view the rest of the comments
[–] snooggums@midwest.social -3 points 5 months ago* (last edited 5 months ago) (8 children)

They did not use a LLM.

In a recent experiment, they set out to determine how reliable LMMs are in medical diagnosis — asking both general and more specific diagnostic questions — as well as whether models were even being evaluated correctly for medical purposes.

Curating a new dataset and asking state-of-the-art models questions about X-rays, MRIs and CT scans of human abdomens, brain, spine and chests, they discovered “alarming” drops in performance.

[–] Thorry84@feddit.nl 18 points 5 months ago (3 children)

You've quoted them stating they used LLMs while claiming they did not use a LLM? What am I missing here?

[–] everett@lemmy.ml 6 points 5 months ago (2 children)

What am I missing here?

"L" "M" "M"

[–] spaduf 6 points 5 months ago (1 children)

Which in this context just means multimodal LLM, correct?

[–] blindsight@beehaw.org 6 points 5 months ago

Correct.

large language models (LLM) vs. large multi-modal models (LMM)

Regardless, they both use an LLM as the main driver. Multi modal just means that the LLM is interfaced with generative and/or predictive AIs for other types of content like images, sound, video, etc.

This is using a generalist tool for a specialized job. I'd expect the limit for LMMs is telling you if your picture is a heart or a kidney... Maybe. With low accuracy. Diagnosing? lol, hell no.

load more comments (4 replies)