this post was submitted on 08 Jan 2026
601 points (99.7% liked)
Technology
78511 readers
3110 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Serious question here. LLMs trained their data off SO. Developers now ask LLMs for solutions instead of SO. New technology comes out that LLMs don’t have indexed. Where will LLMs get their data to train on for new technologies? You can’t exactly feed it a manual and expect it to extrapolate or understand (for that matter “what manual).
I am worried, because there are increasing cases where open source docs are going offline because they can't take the bandwidth costs of the big LLM bots recrawling hundreds of times per day. Wikipedia is also getting hammered. There is so much waste and diminishing returns
Yes, that is the major problem with LLMs in general. There is no solution aside from "train on another different source (like Reddit)", but then we rinse & repeat.
There is a solution: RLVR
I guess, though I'm pretty ignorant as to how RLVR would fix the issue that arises from new coding languages or even new major versions. I'm not sure how LLMs would ever get to a correct answer if they don't have good reference material to start from or reference.
The assumption seems to be that an LLM can't figure out a manual or source code. If it can't, then you have to pay people. But that's not a universally valid assumption.
You can do that to a degree (RLVR). They are also paying human experts. But that's the situation now. Who knows how it will be in a couple more years. Maybe training AIs will be like writing a library, framework, ...
From the questions people ask and from online accounts.