104
No datacenter needed now, just run it on your computer. Anything with 12gb+ of vram can run it comfortably at low quants. If they can come out with a good MOE model it will crush the competition. At this current rate of progress, China will out-compete foreign AI development within a year or two.
Training a frontier model is like Karsus' casting a 12th level spell. it takes a massive amount of everything to get it to go. Even the enigma machine was huge before it could be one shot by claude. So if it's going to become something that can use your phone's worth of compute then it's gotta get big and dense and then you take the 10% of it that works and do it over again. But in the mean time they'll keep pushing the frontier, it'll get distilled and open sourced, and that will be whittled down. Like a giant, electric-steel, writhing eldritch monster
One of the nice things about Deepseek being open-source is that it significantly mitigates the training costs involved as well as use costs (since it's so efficient). If you only one need to train one model that the whole world can then use, that's a lot better environmentally than multiple companies all making their own proprietary models.