this post was submitted on 18 Aug 2026
104 points (97.3% liked)

technology

24445 readers
284 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 6 years ago
MODERATORS
 

No datacenter needed now, just run it on your computer. Anything with 12gb+ of vram can run it comfortably at low quants. If they can come out with a good MOE model it will crush the competition. At this current rate of progress, China will out-compete foreign AI development within a year or two.

you are viewing a single comment's thread
view the rest of the comments
[–] ZWQbpkzl@hexbear.net 25 points 3 days ago (3 children)

Obviously if you can run frontier quality models on consumer hardware then the quality of models you can run in a data center will let you hit AGI. Unless there's any sort of diminishing returns in quality when increasing model size.

But in seriousness Qwen3.8 was trained in a data center. It takes way more VRAM and compute to train a model than to run one.

[–] marxisthayaca@hexbear.net 26 points 3 days ago (2 children)

Unless there's any sort of diminishing returns in quality when increasing model size.

There is actually.

[–] Acute_Engles@hexbear.net 19 points 3 days ago* (last edited 3 days ago) (1 children)

ZWQbpkzl is being sarcastic, the line after says "but in seriousness"

(edit pronouns sorry)

[–] ZWQbpkzl@hexbear.net 7 points 3 days ago

Thank you for your service. freedom-and-democracy

[–] Owl@hexbear.net 9 points 3 days ago

Nah, they redefined getting 20% better results for 10x the cost as "not diminishing returns actually" years ago.

Obviously if you can run frontier quality models on consumer hardware then the quality of models you can run in a data center will let you hit AGI

sentient-ai

[–] soybeanis@hexbear.net 9 points 3 days ago (1 children)

Obviously

why is this obvious?

[–] Acute_Engles@hexbear.net 12 points 3 days ago* (last edited 3 days ago) (1 children)

ZWQbpkzl is being sarcastic, the line after says "but in seriousness"

(edit pronouns sorry)