this post was submitted on 18 Aug 2026
104 points (97.3% liked)

technology

24445 readers
284 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 6 years ago
MODERATORS
 

No datacenter needed now, just run it on your computer. Anything with 12gb+ of vram can run it comfortably at low quants. If they can come out with a good MOE model it will crush the competition. At this current rate of progress, China will out-compete foreign AI development within a year or two.

you are viewing a single comment's thread
view the rest of the comments
[–] lurkerlady@hexbear.net 5 points 3 days ago* (last edited 3 days ago)

You might like Proton Mail's Lumo project, I find it useful for quicker searches without needing an account, they use open-weights models only. Unsloth with EXA or setting up searxng-mcp is your other best bet, Unsloth has a desktop app now.