A9nWGzYt

joined 1 month ago
 

I have noticed that my home server is strangely using lots of swap (~5 GB), despite having only a few lightweight processes running and loads of RAM installed (32 GB).

Upon configuring Grafana + Prometheus, I noticed a trend where cache + buffer will progressively increase until swap starts to be used. My system and services combined will use ~8 GB RAM. Upon rebooting, the cache + buffer will start anywhere from 3--10 GB, progressively ramp up to ~25 GB in 1--2h, where swap will start to be needed (~3 GB). See the image attached for reference.

My swap filesystem is on an expensive (to me) SSD, and I would like to reduce its wear by as much as possible. I understand that swap can introduce only minimal wear on SSDs depending on its nature and that it can be harmless, but I am still not sure what is causing this behavior (and why) and whether I should worry about it or not. So I figured I should investigate what is happening here.

My main question is, how can I figure out what is causing this behavior? Is it expected? I am looking for guidance from others who are more experienced than me in the topic.

A little bit about my system:

I am running Debian 12 on an NVMe SSD containing the root partition (btrfs) and docker services. I also have two HDDs, one with persistent data (ext4), and the other with backups (ext4). This is majoritarily a single-user machine. I tried using the following kernel parameters, but it hasn't helped:

vm.swappiness=10
vm.vfs_cache_pressure=200

My docker services are:

  • *arr stack
  • jellyfin
  • nextcloud
  • immich
  • open-webui + ollama
  • pi-hole
  • invidious
  • romm
  • nginx proxy manager
  • grafana + prometheus
  • other minor services that I don't think are doing much (uptime-kuma, stirlingpdf, vaultwarden, etc)
[–] A9nWGzYt@lemmy.dbzer0.com 3 points 6 days ago (1 children)

I would like to keep it to torrents, since it doesn't hurt to improve my setup's resilience (after all, why not, right?). But at the same time I suspect that usenet might improve my experience, according to what I have been reading online when trying to debug this problem I'm facing.

You are right about the crack in my investigation. It seems like I have to dig deeper, and this is another indicator that maybe the usenet solution would be my best bet here, since I have already added plenty of indexers. You raise a good point about the filters configured in the *arr stack perhaps being "too aggressive" and sleeping on what would be a "good match". I will look into that.

I do have a specific example of content my setup isn't finding. I will give it a look later to find a specific season/episode that matches the criteria and report back. I appreciate your willingness to help!

[–] A9nWGzYt@lemmy.dbzer0.com 2 points 6 days ago

I will keep this in mind, since I strongly suspect that usenet would seriously improve my experience, and comments here seem to corroborate that idea. I appreciate the tip!

[–] A9nWGzYt@lemmy.dbzer0.com 3 points 6 days ago (1 children)

If I do a manual search on public indexers (1337x, TBP, etc), I do not find the results I'm looking for. That means I would be out of luck following the standard process.

I am not using the same indexers on prowlarr and stremio. I actually do not use stremio, and from what I found online, they use addons and plugins like torrentio are responsible for doing the heavy lifting. My suspicion is that they rely on private indexers that I'm yet not aware of. By comparing magnet links from my friend's stremio setup, many of these results actually seem to be available at private indexers.

 

I have setup a full *arr stack on my home server about one year ago. I am having some trouble finding some specific content that is not listed by popular public indexers (mostly TV shows with lots of episodes). However, my friends can find the same content in stremio, so I know there are torrents of the content out there. I have asked them to share some magnet links to specific media the *arr stack has failed to source, and I have tried to trace back their origins.

What happens next is, I register to the newly found private indexers when I can, and request everything again through prowlarr. Still, there is specific episodes where are not found, and I have to get back to step 1 and do everything again. That makes me realize that my setup is not as robust as I would like.

I wonder what you would recommend me do. Right now, I can think of two solutions. I can try to register on more private trackers that are invite only by asking around (I appreciate any invitation links), or I can try the whole usenet workflow. Of course, using stremio is a possibility, but I would like to improve my own setup if I can.

What is my best bet here? There are only a few shows where I'm struggling with. For most of the content I request, my setup works smoothly.