this post was submitted on 20 Jan 2026
683 points (99.1% liked)

Technology

78923 readers
3329 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Big tech boss tells delegates at Davos that broader global use is essential if technology is to deliver lasting growth

you are viewing a single comment's thread
view the rest of the comments
[–] wonderingwanderer@sopuli.xyz 1 points 11 hours ago* (last edited 11 hours ago)

See, you have more experience in the matter than I do, hence the caveat that I'm not an expert. Thanks for sharing your experience.

Then again, I'd consider 128GB of memory to be fairly serious hardware, but if that's common among hobbyists then I stand corrected. I was operating on the assumption that 64GB of RAM is already a lot

All in all, 106 billion parameters on 128GB of memory with quantization doesn't surprise me all that much. But again, I'm just going off of the vague notions I've gathered from reading about it.

The focus of my original comment was more on the fact that self-hosting is an option, I wasn't trying to be too precise with the specs. My bad if it came off that way