I like local LLMs as much as the next person but the issue is that doesn't scale the way companies need it to.
As a personal assistant? Sure, I agree. They're useful at times. But as soon as you need multiple to run simultaneously you're gonna hit resource issues.
What Oracle and others were banking on is that you have engineers and others running a lot of agents in parallel composing different things together. Or having one input that multiple serverside agents take and execute numerous tasks on. That's something you can't run on an individual machine right now. And with the way they currently work I don't envision they will anytime soon.
I like local LLMs as much as the next person but the issue is that doesn't scale the way companies need it to.
As a personal assistant? Sure, I agree. They're useful at times. But as soon as you need multiple to run simultaneously you're gonna hit resource issues.
What Oracle and others were banking on is that you have engineers and others running a lot of agents in parallel composing different things together. Or having one input that multiple serverside agents take and execute numerous tasks on. That's something you can't run on an individual machine right now. And with the way they currently work I don't envision they will anytime soon.