this post was submitted on 08 Jan 2026
428 points (99.3% liked)
Technology
78543 readers
3156 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
These AI PCs/Notebooks aren't even able to run the really big models. For those you'd need a 5000$ card. And for the smaller models a good graphics card is often enough.
For a real AI PC we would need new technology or graphics cards with more ram (the last one would suprise me with current ram prices)
I'm still sanguine that 1.58 BITNET models take off. Those could plausibly run at good clip on existing CPUs, no GPU needed.
Super basic medium article for those not in know
https://medium.com/@kondwani0099/reimagining-ai-efficiency-a-practical-guide-to-using-bitnets-1-bit-llm-on-cpus-without-ef804d3fb875
~~Necessity~~ spite is usually a good driver...though given BITNET is Microsoft IP....ehh...I won't hold my breath for too long. Still waiting for their 70B model to drop... maybe this year....