this post was submitted on 21 Sep 2026
625 points (98.4% liked)
Technology
88183 readers
3628 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I would wager that the AI said inconvenient things, and then got lobotomized to have MAGA brain.
My personal local AI is able to infer consequences, and it is only a 180b parameters on three consumer GPUs. The DOW undoubtedly can use the most powerful hardware and have perfectly configured settings to do a much better job.
They simply don't want to.
How do you get the model split over 3 GPUs? I thought the entire model had to be loaded into memory on a card?
It depends on what backend you are using. UnSloth Desktop and KoboldCPP allow you to use multiple GPUs, alongside leveraging your RAM.
Unfortunately, Hermes Agent doesn't allow you to control and leverage your GPUs as of yet.
If you are using ComfyUI, there is an extension called Distribution, if you are getting into picture generation. You can order up batches of pictures, and each card tackles a different one.
In the case you want to hook up your backend to another program for agentic purposes, I recommend UnSloth Desktop. I have been using it with Lingua Gacha to translate a RPGMaker game. KoboldCPP isn't able to handle this kind of work yet, unfortunately.