this post was submitted on 16 Sep 2026
155 points (80.9% liked)

Technology

88183 readers
3365 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] solrize@lemmy.ml 18 points 5 days ago* (last edited 5 days ago) (1 children)

It doesn't say anything about how this works. "No data retention" suggests that data is going to a server that's processing it but then not retaining it. That's bad, this type of feature should run entirely on the client.

Also, there's a proprietary AI model doing the work, even if inference is in the client. It says "open weight" but that's like letting people download a program as a compiled binary, the exact opposite of what FOSS is supposed to mean. It's an open/free model only if the training data and algorithms are also public, not just the trained weights.

[–] CommanderCloon@lemmy.ml 1 points 3 days ago (1 children)

Issue is that local AI hog vram, are slow and small models. Or if you don't have a compatible GPU, it uses the CPU which is even slower.

If AI is the future, I really hope it's local, but with the equipment people have at home, local AIs are a non-starter.

IMO it's enough to justify not shipping those AI features at all but I guess that's where FF execs disagree.

[–] solrize@lemmy.ml 1 points 3 days ago

AI inference is doable on home equipment. AI training is less feasible, but nobody builds their whole Debian distro from source either. It's enough that the source is available and you can rebuild any component if you want ot do so.