this post was submitted on 31 Oct 2026
1519 points (99.7% liked)
memes
23217 readers
3067 users here now
Community rules
1. Be civil
No trolling, bigotry or other insulting / annoying behaviour
2. No politics
This is non-politics community. For political memes please go to !politicalmemes@lemmy.world
3. No recent reposts
Check for reposts when posting a meme, you can only repost after 1 month
4. No bots
No bots without the express approval of the mods or the admins
5. No Spam/Ads/AI Slop
No advertisements or spam. This is an instance rule and the only way to live. We also consider AI slop to be spam in this community and is subject to removal.
A collection of some classic Lemmy memes for your enjoyment
Sister communities
- !tenforward@lemmy.world : Star Trek memes, chat and shitposts
- !lemmyshitpost@lemmy.world : Lemmy Shitposts, anything and everything goes.
- !linuxmemes@lemmy.world : Linux themed memes
- !comicstrips@lemmy.world : for those who love comic stories.
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Because typically the resources for a particular AI job need to be centralized in order to obtain usable speeds. Even a machine with a decent 16GB GPU is going to lose speed swapping in and out of system RAM - though it does allow for larger models - so machines in a LAN can't currently split the workloads without significant efficiency losses. It's also why AI boards are typically using soldered LPDDR rather than swappable DIMM's (can't get an AI CPU with a non-soldered board).
Peers over the Internet would be abysmally slow or untenable for many workloads, at least with the way a lot of stuff is built currently.
HOWEVER, that's assuming monolithic non-specialized/optimized models. In the future as we see models built and trained for more specific jobs, it should be possible to have individual students run more as specialists and swap data. There are models that are specialized currently but not really an ecosystem for them:
If we think of something like creating an MMO (and assuming we didn't include the moral issues of AI generation), then a pipeline could have different assets building a soundtrack, 3d models, scenes/animation per a script, character voicing, various dialog, 3d world space mechanics, etc all running from different clustered machines