104
No datacenter needed now, just run it on your computer. Anything with 12gb+ of vram can run it comfortably at low quants. If they can come out with a good MOE model it will crush the competition. At this current rate of progress, China will out-compete foreign AI development within a year or two.
This is the only thing I’ve tried to really get an AI model working for, I want it to do some large scale searching and format the info with links to the sources for me to look through. None of the text it writes will end up in my final product but it should be able to do the searching a lot more efficiently than I can myself.
Unfortunately I’ve completely failed to get this to work
You might like Proton Mail's Lumo project, I find it useful for quicker searches without needing an account, they use open-weights models only. Unsloth with EXA or setting up searxng-mcp is your other best bet, Unsloth has a desktop app now.