Technology

84069 readers

3287 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related news or articles.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago

MODERATORS

L3s@lemmy.world

enu@lemmy.world

technopagan@lemmy.world

L4s@lemmy.world

L3s@hackingne.ws

599

Chatbots Make Terrible Doctors, New Study Finds (www.404media.co)

submitted 2 months ago* (last edited 2 months ago) by XLE@piefed.social to c/technology@lemmy.world

159 comments fedilink hide all child comments

Chatbots provided incorrect, conflicting medical advice, researchers found: “Despite all the hype, AI just isn't ready to take on the role of the physician.”

“In an extreme case, two users sent very similar messages describing symptoms of a subarachnoid hemorrhage but were given opposite advice,” the study’s authors wrote. “One user was told to lie down in a dark room, and the other user was given the correct recommendation to seek emergency care.”

you are viewing a single comment's thread
view the rest of the comments

[–] tyler@programming.dev -1 points 2 months ago (5 children)

You have misunderstood what they said.

[–] Hacksaw@lemmy.ca 2 points 2 months ago (4 children)

If you seriously think the doctor's notes about the patient's symptoms don't include the doctor's diagnostic instincts then I can't help you.

The symptom questions ARE the diagnostic work. Your doctor doesn't ask you every possible question. You show up and you say "my stomach hurts". The Doctor asks questions to rule things out until there is only one likely diagnosis then they stop and prescribe you a solution if available. They don't just ask a random set of questions. If you give the AI the notes JUST BEFORE the diagnosis and treatment it's completely trivial to diagnose because the diagnostic work is already complete.

God you AI people literally don't even understand what skill, craft, trade, and art are and you think you can emulate them with a text predictor.

[–] SuspciousCarrot78@lemmy.world 1 points 2 months ago* (last edited 2 months ago) (2 children)

You're over-egging it a bit. A well written SOAP note, HPI etc should distill to a handful of possibilities, that's true. That's the point of them.

The fact that the llm can interpret those notes 95% as well as a medical trained individual (per the article) to come up with the correct diagnosis is being a little under sold.

That's not nothing. Actually, that's a big fucking deal (tm) if you think thru the edge case applications. And remember, these are just general LLMs - and pretty old ones at that (ChatGPT 4 era). Were not even talking medical domain specific LLM.

Yeah; I think there's more here to think on.

[–] XLE@piefed.social 1 points 2 months ago (1 children)

If you think a word predictor is the same as a trained medical professional, I am so sorry for you...

[–] SuspciousCarrot78@lemmy.world 0 points 2 months ago

Feel sorry for yourself. Your ignorance and biases are on full display.

load more comments (1 replies)