Asklemmy

55603 readers

763 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
!lemmy411@lemmy.ca: a community for finding communities

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 7 years ago

MODERATORS

How all do you use AI/ML in life? Especially offline uses (lemmy.ml)

submitted 2 weeks ago* (last edited 1 week ago) by 1Malayali@lemmy.ml to c/asklemmy@lemmy.ml

32 comments fedilink hide all child comments

Speech to text, Voice typing is cool.
F-droid lists opensource apps that support Whisper and Vosk models.
Futo voice is not opensource, but is source available.
It's good for English. For my mother tongue, Malayalam, the support seems to be underdeveloped currently.
Handy seems to be good for Windows, but have not used it much.

Then for Translations: https://f-droid.org/packages/dev.davidv.translator/
Using Mozilla's translation Models. A good enough offline and Open source alternative to GTranslate.

Are there other cool uses of offline ML/AI that you know?

you are viewing a single comment's thread
view the rest of the comments

[–] monovergent@lemmy.ml 5 points 1 week ago

I use it to generate little bash and python scripts for mundane tasks, random ideas I don't have a good starting point for, or boilerplate code I don't have the energy to write manually. Or also to decipher cryptic error messages and logs. Nothing that I publish though, just all testing and personal scripts.

I do this with models running locally on my gpu. 14B parameters is surprisingly decent and fast enough for a 16 GB slot-powered workstation model.

For fun, since the model is local, I also toss in some excerpts of my writing, see what it can glean from my style and vocabulary, something I'd never do with an LLM hosted by someone else for obvious reasons.