Selfhosted

Interesting question. If you are asking for an LLM (that is self-hosted and can do that?), you're going to need to provide some significant tooling, like rag / documentation, troubleshooting, sort out concurrency, front end etc. Honestly...it just easier to point them at a YouTube (network chuck has good stuff).

It absolutely can be done and it absolutely can be valuable - for you personally. But if they're having trouble doing basic things like installing jelly fin, they have zero chance of doing something like that themselves.

Honestly, I think your easiest option for your non-technical friends is just to point them at one of the cloud providers, like chatGPT or Claude.

OTOH, how much work are you willing to put into this and what's your GPU / LLM set up like?

Your basic foot in door starting point is going to be installing and provisioning OpenWebui, getting a good local model up and running (Qwen3.6-35B or Qwen3.6-27B) and creating a "Knowledge Base" in OWUI with requisite documentation.

If you're serious about this, write back and I'll thumbnail sketch it out for you. It's a good project and I've done similar.

I'll give a non-answer; if they dont spend the time setting it up themselves to understand it, they are kinda screwed.

There are TONS of videos out there, step-by-step guides, that should be enough honestly. I understand the appeal of LLM though to talk through stuff, but honestly, just give them a good guide. They can ask Googles AI if they need terms explained etc.

Just a different perspective.

why would anybody think that setting up a local "LLM that can guide a user on how to manually set up a home server that runs Jellyfin" would be easier than setting up jellyfin itself?

🤔

just follow the instructions on https://jellyfin.org/docs/general/installation/linux/#debuntu-debian-ubuntu-and-derivatives-using-apt

GPT4All can accommodate a plethora of models all the way until you run out of VRAM. LOL Maybe play around with some of them. Right now I'm experimenting with DeepSeek R1 Distill Qwen 14 B, and Qwen 2.5 Coder -32B Instruct GGUF. Pretty neat stuff.

Please update your title with [AIT] as noted in the sidebar.

Easy setup would be to use koboldcpp + SillyTavern + Gemma 4 26B A4B GGUF of the largest quant your graphics card can fit together with your context.
Remember to setup SillyTavern to allow network connections and create a user and password, default installation is localhost only.
Set the temperature to 0.3 if using IQ3_M, higher quants allow higher temperature, and make sure all the formatting templates inside Advanced Formatting are set to Gemma 4.

Then use either Gemma 4 itself or the free google.com AI to create some "W++ Denze with Horizontal Lines summaries for Gemma 4" of the relevant documentation of the latest version of the home server apps your friends are gonna install.
You should ensure the resulting lorebook entries are no more than 1k tokens each to leave some context for your friends chats, add it to a character card in SillyTavern and set some keywords to allow them to load dynamically and not stay in context memory all the time.

Regarding the character card you can ask Gemma 4 to write that for you too, I find "Write a character card in W++ Denze with Horizontal Lines style for Gemma 4 with this name, personality, attitude and skillset" works well for that.
Then ask it to write a "First message prompt that starts with X, continues with Y and ends with Z for that character card" and you get a first draft to rewrite and paste into the "First Message" of the character card. The first message works as a template that Gemma 4 will imitate when you chat with it. Then simply try the chatbot out before letting others use it.

I find my own Gemma 4 26B A4B IQ3_M works well for practicing hiragana and katakana, discussing programming or troubleshoot existing code or writing a small function but it can't be expected to write a correct DatabaseService.cs from scratch and stuff like that.

Oh and forget about finding good cards and lorebooks for SillyTavern use online, most users use it for NSFW Roleplaying chats. It is a very easy UI to use to create harnesses for your local LLM though.

Someone started a stack named admirarr but it miss the configuration of many parts. If you find something keep us updated.

Probably setup ollama with qwen and aider first. Then give it the docs for the things you want to set up.