this post was submitted on 30 Mar 2025
175 points (100.0% liked)
Selfhosted
60281 readers
544 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil.
-
No spam.
-
Posts are to be related to self-hosting.
-
Don't duplicate the full text of your blog or readme if you're providing a link.
-
Submission headline should match the article title.
-
No trolling.
-
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Are there any AI apps that will index markdown documents with a vector DB, then allow you to run natural language queries using some kind of RAG approach with a local LLM?
Closest I've found is LlamaIndex, but this is still more of a 'foundation' than a turn-key solution and right now I'm too time-poor to do the assembly required...
I realise I'm describing close-to-frontier tech, but is there anything more turn-key (Dockerised) out there yet?
My use-case is pretty 'vanilla' in this space: Having a knowledge base and wanting quick answers to questions like "How should screen X behave if I am not a registered user?".
Thanks for any suggestions!
I think I found my jam! AnythingLLM self-hostable
Ollama + OpenWebUI also can do this.