Now I have a leftover Windows micro-PC running a local LLM model, so I can be less dependent on GPT, as long as time isn't a factor...
Might as well go all in. LM Studio, Stability Matrix, Comfy UI, Ollama - everything's native on Linux.
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
Now I have a leftover Windows micro-PC running a local LLM model, so I can be less dependent on GPT, as long as time isn't a factor...
Might as well go all in. LM Studio, Stability Matrix, Comfy UI, Ollama - everything's native on Linux.
I was never really against AI, and used the free things for most of the time. I moved to paying for AI once I started homelabbing, I have saved so much money with being able to move my things to my LAN. If I could afford a computer with a strong enough GPU it would be great.
I was able to setup a firewall running OpenWRT that I had tried searching the internet for help but it was always way over my head.
Yeah. I'm not pro-AI by any stretch but internet searching powered by AI has made it MUCH easier to tinker and troubleshoot. The Linux community can be pretty awful when you're new to Linux and trying to make things run.
Just RTFM!!!!
*reads the manual and there’s nothing about this*
…ok. Now what?
I suspect that LLMs do pretty well with troubleshooting Linux thanks to those manuals and old forum posts. After using them to troubleshoot Linux based devices, I tried the same thing on Windows and it struggled to figure out what commands to run.
Windows is a mess to configure and troubleshoot, even with the help of LLMs. Microsoft could have spent their investment trying to fix that, but I don't think they have.
"Copilot can troubleshoot your computer" could have been a selling point, but they'd have to admit that windows 11 is a buggy mess
Sorry, that guide was written for systems running systemd and the install manual you followed was a from an opinionated Arch user for SysVinit.
Oh, this guide is 11 years old written by someone who hated Wayland, so no, modern KDE won’t work with it.
Just use Arch Wiki, it’s the best for beginners, but also don’t install Arch unless you know what you’re doing already because it’s the worst for beginners.
Yeah, any time someone tells me to just read the arch wiki for something unrelated to arch I automatically know they will never provide anything valuable to humanity
Archwiki is pretty good, it has a lot of breadth, but it’s not a manual and it’s not easy.
Yeah that's the proper way to do it.
There's a guy at work constantly asking AI everything on his second screen. He came to me after failing to figure out an issue using it. I said "oh yeah let's look at the documentation, I bet there's an example for this exact scenario" and sure enough there was. Made the change, tested and working.
On the other hand, any time I want to do something with Ansible, I start off reading the docs, can't find what I need, scour a bunch of search results, and when that fails somehow AI can produce a working example of what I need in a few tries.
Agreed. The only advice people gave me with issues on Windows as "just use Linux!" OK, I switched...here's my hundreds of issues, suddenly no help from them. ChatGPT made it possible for me to build a server and switch to Fedora. Not how I wanted to switch, but it worked
Man, this makes me very proud of myself. I switched to Linux 10 years ago when it was really rough to maintain. Oooofff the sleepless nights I’d spent hunting for fixes that AI now can fix in mere seconds. I use ChatGPT a ton now to fix issues and my distro has been solid ever since.
Welcome to the other side. I highly recommend checking man pages when looking up commands to start getting a feel for how to use them, also I recommend getting tealdeer (TLDR, get it?) It's a TLDR of man pages that shows you how a package is usually used. I've often found that it bridges a syntax gap that is often missed in man pages.
Learning how to navigate and use man pages saved my ass when I was screwing around with my network.
Great call out on the irony. So true. Welcome to the future.
Pretty much the same experience here. During my first week of full-time Linux I managed to break KDE Plasma with a widget IIRC and AI was able to tell me which file in .config I needed to delete to restore to default.
Good for you. The only two times I decided to glance at the AI overview of a search cause I wasn't finding anything, it wasn't useful at all. So yeah, I'm gonna save the planet a little more.
Was about to say now you should look into self-hosting AI, but you're already on it. 😄