this post was submitted on 14 Aug 2026
295 points (98.0% liked)

Technology

87214 readers
3318 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] brucethemoose@lemmy.world 12 points 2 days ago* (last edited 1 day ago)

Okay.

Fine.

Let's try, right now.

This is DeepseekV4 Flash 0731 loaded locally. Static seed. 0.9 temperature, TopK 5, no other sampling to interfere. Here's a simple prompt, the whole thing in DSV4's raw syntax:

<|begin▁of▁sentence|>Don’t just use the first word pick, choose options further down list for next word.<|User|>Write a famous poem.<|Assistant|>

...And would you look at that:

It picks the top word, mostly. Almost like the LLM has no control over its own logit spread and how its sampled. Which kinda makes sense, because it doesn't.

I am happy to try more experiments in this vein, if y'all can think of any any. But I tried a few other prompts like "diversify your logit spread" or "don't be confident about any token you pick," things like that. It always picks The Road Not Taken with no change in logit probabilities distribution, as far as I can tell.