104
No datacenter needed now, just run it on your computer. Anything with 12gb+ of vram can run it comfortably at low quants. If they can come out with a good MOE model it will crush the competition. At this current rate of progress, China will out-compete foreign AI development within a year or two.
They're not really -for- anyone, and they may or may not even get built. It's a front for the circular financing that's propping up the bubble. NVidia invests $3bn in OpenAI, who goes and buys $3bn worth of future datacenter capacity from a cloud provider, who pre-purchase $3bn of GPUs from NVidia.
Everybody just made $3bn and the line keeps going up.