Asklemmy

54471 readers

451 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
!lemmy411@lemmy.ca: a community for finding communities

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 7 years ago

MODERATORS

-19

What question can I ask ChatGPT, right now, that will reliably produce a factually incorrect, wrong, or false answer? (lemmy.world)

submitted 3 days ago* (last edited 3 days ago) by LoveRainbow@lemmy.world to c/asklemmy@lemmy.ml

80 comments fedilink hide all child comments

I believe ChatGPT generally gives accurate answers to most questions. Certainly: it produces answers that are more reliably true than a random average person. Obviously it cannot yet do advanced programming tasks: but generally it answers questions accurately.

Prove my position wrong.

What can I ask it that will produce factually incorrect answers?

As a side quest, a much easier one, what can I ask it that would cause it to produce extremely biased answers that fail to do justice to the truth of things?

you are viewing a single comment's thread
view the rest of the comments

[–] Tetsuo@jlai.lu 2 points 3 days ago (1 children)

I'm pretty sure LLM are deterministic in design.

The fact it doesn't give the same output for the same prompt is just a choice of the programmers to add randomness so it feels more natural.

But you can totally setup some LLMs to be perfectly deterministic.

[–] Aethr@lemmy.world 1 points 3 days ago (1 children)

Got any sources to back up that claim?

[–] Tetsuo@jlai.lu 2 points 2 days ago

A good start is this :

https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/

While it's hard to get perfect determinism you can still get very close. But really I think it's accurate to say that LLM are random because they are configured to be.