this post was submitted on 20 Jul 2026
52 points (98.1% liked)

Selfhosted

60810 readers
513 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

What's your ebook download automation pipeline? And what do you use for library management — calibre, calibre-web, something else?

top 29 comments
sorted by: hot top controversial new old
[–] d00ery@lemmy.world 2 points 5 hours ago* (last edited 5 hours ago)

Download books from libgen, Anna's archive, torrents. Move (sftp) to a watched folder on my pi4 that's running calibre and then download from server using moon reader.

[–] ikidd@lemmy.dbzer0.com 1 points 4 hours ago

Openbooks IRC download to calibre guacamole instance to fbreader opds connection. Once I pick a book it's automated to the point that I find it on my reader index page.

[–] irmadlad@lemmy.world 4 points 8 hours ago

I use Calibre but I don't have any automated, download, pipeline. I just upload the books as I buy them. I guess I'm boring and vanilla like that. LOL

[–] TheFerventLion@sh.itjust.works 1 points 6 hours ago

It's not fully automated, but I use Shelfmark -> Grimmory for my ebooks. Works quite nicely with the ingestion/metadata lookup in Grimmory.

[–] non_burglar@lemmy.world 1 points 8 hours ago

Calibre Web Automated. I have Kobo integration enabled, so when I add an ebook to the "sync" folder, it appears on my Kobo. pretty nice system.

[–] fonix232@fedia.io 6 points 13 hours ago (1 children)

I'm actually working on an all in one solution that sort of fills the roles of Readarr AND Calibre - without all the baggage of the latter.

Oh, and of course a KOReader library plugin that foregoes OPDS and works like the Kindle interface ("available books" synced from this backend, one tap downloads them, plus potentially adding series handling too in the future).

But right now it's mostly manual downloads + CWA ingest + OPDS via KOReader.

[–] happeningtofry99158@lemmy.world 0 points 8 hours ago (1 children)
[–] fonix232@fedia.io 2 points 8 hours ago (1 children)

why would I try a book REQUESTING system when I'm working on my own AIO solution?

[–] Jolteon@lemmy.zip 1 points 6 hours ago* (last edited 6 hours ago) (1 children)

One of the benefits of Free Software is that you can copy and improve the good parts of other Free software into your own, reducing the required effort.

[–] fonix232@fedia.io 1 points 44 minutes ago

Uhm, no.

Only if the licence allows. I personally go for A/GPLv3 wherever I can because I don't want corporations to just take and not contribute back. But that means I can't just copy MIT/Apache software, need to do my own implementation from scratch. Which I prefer anyway.

[–] ExcessShiv@lemmy.dbzer0.com 14 points 16 hours ago (1 children)

I just manually transfer books to my reader when I get them. I have them organized by genre on my reader (done manually). This is not an area where I see automation providing any significant benefit to bother setting up and maintaining an automated pipeline.

[–] ampersandrew@lemmy.world 5 points 7 hours ago (1 children)

I don't think I can read books fast enough to make automation attractive either, haha. I break DRM on Calibre with two plugins, books purchased from Kobo, and then organize on Komga after manually dragging the files.

[–] ExcessShiv@lemmy.dbzer0.com 2 points 6 hours ago

Yeah i read Like 8-12 books per year, at best, it doesn't make sense to automate any aspect of that.

[–] maikuuuuuu@lemmy.zip 11 points 17 hours ago (1 children)

Audiobookshelf, shelfmark, and prowlarr work well for me

[–] happeningtofry99158@lemmy.world 2 points 8 hours ago

thanks a lot for recommending shelfmark.

Do you use calibre to manage metadata?

[–] dragonlover@lemmy.zip 4 points 15 hours ago (1 children)

For books: mam (manually now that readarr died) -> calibre -> Kavita

If it's a manga or comic, bypass calibre, straight to Kavita + komf for metadata / covers.

[–] happeningtofry99158@lemmy.world 1 points 8 hours ago (1 children)

Would you say Kavita is better than calibre web? I'm having trouble adjusting to folder structures of Kavita

[–] dragonlover@lemmy.zip 1 points 7 hours ago

I vastly prefer it to calibre web personally, but it's all up to personal preference. Kavita has a pretty extensive user guide too

I use calibre to label books by series. I don't think I did anything crazy with the folder structure outside of putting comics, manga, and books in separate directories.

I have one media directory with books / manga / comics in separate subdirectories. I process metadata with calibre or other tools as needed, and point Kavita at my books directory and tell it to scan. Kavita should automatically group books of the same series together provided the series name is exact. (eg: "The adventures of Bob" vs "adventures of Bob, The" would be seen as different series. Kavita should also group the libraries together by directory, so I have 3 libraries, books, manga, and comics.

You do need to make sure books are all in the correct formats. I batch convert everything to epub and limit Kavita to only show epubs to avoid duplicates.

The upside to all this is that Kavita comes with a cleaner interface imho, opds is easier to set up, and I've had less issues with it. Also users can set their own reading lists and collections if you are setting this up for other users.

[–] solrize@lemmy.ml 5 points 18 hours ago (1 children)

Mostly pandoc (for epub to text) and a few stupid python scripts. I'm a luddite and prefer reading text files. I don't use any particular collection management beyond filenames and grep.

[–] everett@lemmy.ml 5 points 17 hours ago (1 children)

To something like Markdown, or do you just throw away formatting?

[–] solrize@lemmy.ml 2 points 17 hours ago

Epub is html with some crap wrapping it. Converting it to text follows the html formatting, like using the lynx browser.

[–] GottaHaveFaith@fedia.io 2 points 14 hours ago

electronic library -> calibre web -> ebook reader via opds

[–] adeoxymus@lemmy.world 3 points 17 hours ago (1 children)

I have kavita and audiobookshelf running as containers on my NAS. I don’t have a good automation for getting books there since I usually need to remove DRM, which is a bit manual with calibre. Kavita is then coupled to my ereader (tolino) running koreader.

[–] happeningtofry99158@lemmy.world 0 points 8 hours ago

Try shelfmark

[–] MIXEDUNIVERS@discuss.tchncs.de 3 points 18 hours ago (2 children)

I'm also looking to get startet and to integrad it in my media arr server

[–] whysofurious@lemmy.dbzer0.com 2 points 16 hours ago (1 children)

Not really automation, but I will copy-paste a comment I made in an older thread, maybe it can still be useful :)

  • I download books through Z-Library, I tried in the past lazylibrarian and readarr/bookshelf for automation, but I always ended up spending a lot of time on refining the search for non-english books or specific editions, which was just way easier in Z-Library.
  • I tag/update metadata of books using Calibre of my laptop. I prefer to manually do that because while it took a few days to do it for my whole library, I don't really add books in such a high number that I can justify automating it or having a Calibre container on my homeserver. (I know Calibre Web Automated will do this, but see below). I use Hardcover to track my readings, so Calibre with the hardcover plugin makes it easy to find ids or HC editions for integrations with other apps I use.
  • After moving between Kavita, CWA and Booklore, I set up on Komga for library management. I found Komga's koreader sync way more stable and mature than the other options. I am a bit annoyed by the fact that (as in Kavita) each book/series folder is a series, but at the end of the day the pros outweighs the cons for me. I can manage custom reading lists or series, so it's not really an issue personally.
[–] happeningtofry99158@lemmy.world 1 points 8 hours ago

Try shelfmark, to me it is much better than lazylibrarian and readarr/bookshelf

I am a bit annoyed by the fact that (as in Kavita) each book/series folder is a series, but at the end of the day the pros outweighs the cons for me.

Yeah me too. I will try komga. thanks a lot