this post was submitted on 08 Nov 2025
694 points (97.4% liked)
Technology
76678 readers
1929 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Exactly. Nothing technical about it: they simply produce the statistically most likely token (in their training model) to follow a given list of tokens.
Any information contained in their output (other than the fact that each of the tokens is probably the most statistically likely to appear after the previous ones in the texts used as their models, which I imagine could be useful for philologists) is purely circumstantial, and was already contained in their training model.
There's no reasoning involved in the process (other than possibly in the writing of the texts in their training mode if they predate LLM, if we're feeling optimistic about human intelligence), nor any mechanism in the LLM for reasoning to take place.
They are as far from AI as Markov chains were, just slightly more correct in their token likelihood predictions and several orders of magnitude more costly.
And them being sold as AI doesn't make them any closer, it just means the people and companies selling them are scammers.