this post was submitted on 19 Oct 2026
516 points (98.3% liked)
Technology
88987 readers
2879 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You can host a small LLM model with a phone, or a whisper or a TTS, maybe some light diffusion.
You cannot do tool use, reasonable coding, get non-hallucination answers on even moderate questions. That stuff starts to get viable around 24G and really needs closer to 200G to be able to do most of that they're doing.
the reason they bought up all the ram is to keep someone from buying 200G of vram and diying cards putting them out of business.
I read this as about general social media, not LLMs.
LLMs, I agree the at-home hardware is pricey and not super competitive right now. Plenty of frontier models that are kept from the public, with VC-discounted rates because the IPO hasn't dropped yet. (If you're expecting a market crash, this is going to get much better fairly soon. In the mean-time, subscriptions are probably more cost effective than just buying the hardware at old prices would have been.)