405
Accenture Just Capped Employees’ Claude Spending at $29 a Month. Some Were Spending $1,000
(finance.yahoo.com)
This is a most excellent place for technology news and articles.
Definitely. We do this at my job. But a server big enough to provide a comparable service would cost at least $30k. And you likely need more than one. And you still need someone to maintain it.
I've heard that GPU's for this work are exceedingly hard to get ahold of as well. Glm 5, which i think is near frontier model capabilities, takes around 1.5 Tb of vram un-quantized.
Not hard. Just really fucking expensive and might have a long lead time.
So hard, then.