this post was submitted on 17 Oct 2026
50 points (98.1% liked)

Selfhosted

63148 readers
893 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
 

Right now I'm creating a nightly restic snapshot of my server on borgbase and on some spare drives, and keeping the snapshots forever. There's a ton of daily churn in my data though, between databases and logs and other files that don't constitute 'real data' but might be needed to restore the app.

top 50 comments
sorted by: hot top controversial new old
[–] Greenbeard@lemmy.zip 8 points 5 days ago
[–] Sibbo@sopuli.xyz 17 points 6 days ago

I have daily backups, weekly, monthly and yearly. All but yearly is deleted after a certain time, but yearly I keep forever.

[–] bertlewirth@lemy.lol 3 points 4 days ago

where we're going, we don't need backups!

[–] MonkderVierte@lemmy.zip 2 points 4 days ago

Always last daily, weekly, monthly. The others are pointers (hardlinks). How many years, i'm not there yet.

[–] hendrik@palaver.p3x.de 10 points 6 days ago* (last edited 6 days ago)

I learned I pretty much never need old data for my hobby selfhosting stuff. So I do 4 weeks. I'll notice if something breaks within 4 weeks and fix it. I occasionally do manual backups, for example when migrating stuff and keep them for longer. And I got some old stuff like in xkcd 1360.

I suppose I could do more, but I also want the privacy policy of my online services to say: x weeks and all the logs and unnecessary data is gone.

[–] Guiorgy@lemmy.ml 3 points 5 days ago

For frequently changing data hourly up to 24, daily up to 7, weekly upto 4, monthly up to 12.

For daily changing data daily up to 7 and etc. as above.

For seldom changing data a backup every 3 days with rotation based on a storage quota, and retention of manually held samples.

[–] NotEasyBeingGreen@slrpnk.net 5 points 5 days ago

I use nightly backups. I keep them 2 weeks.

After that I keep a weekly backup for 2 months.

After that I keep a monthly backup for 2 years.

I keep my yearly backups forever.

[–] DieserTypMatthias@lemmy.ml 1 points 4 days ago

For configs I use Home Manager on a public Git repo. And for everything else I use Pika Backup.

[–] Reannlegge@lemmy.ca 7 points 6 days ago (1 children)

I was backing up multiple places on my LAN but than half of my place flooded, so lamenat and carpet was ripped up, one of my pi 5’s was misplaced with a NVMe drive and another was lost. Than just down the street 3 house went up in flames had the wind been blowing just a little south my condo complex would have been burnt to the ground. After the fire fighters were telling us to get back further and further I had my main pi 5 that had all the backups of everything important on another NVMe drive and a few other things ready to go if the firefighters started banging on my door telling me it was time to leave. I wish I could honestly say that was the day I decided to get a VPS and start my back up, but I was still hoping my father would let me set up a pi with a drive big enough to do back ups at his place. It sounds like he will but he is concerned about security risks about my VPN, funny thing is my back up pi would be the most secure thing hooked up to his modem/router and I wouldn’t want his stuff touching my stuff and with how my LAN and VPN are set up they would have a hard time doing it. Anywho I have a domain hosted by EasyDNS, and just went and looked at their VPS options and got some year long plan and set up cron jobs to take the stuff I want to backup and use age to encrypt it and than it is sent to my VPS each age container is than deleted after there is something of the same name but 3 days iterations older and deletes it.

[–] Dave@lemmy.nz 4 points 6 days ago (1 children)

Is using a VPS cost effective compared to uploading to object storage?

I use rclone to sync backups to Backblaze object storage. I find it hard to believe a VPS would be cheaper, considering the disk space on those can be very expensive compared to object storage.

[–] Reannlegge@lemmy.ca 3 points 6 days ago* (last edited 6 days ago) (1 children)

If it was just for backup backblaze is probably less expensive but my LAN consists mostly of pi’s and hand me down computers. I am slowly moving things around on my LAN so to each their own I guess. I like the idea of having more control over my stuff so having a whole Debian system on the other end feels right for me.

*edit: It also gives me peace of mind knowing that I can encrypt my stuff to my liking. Silly me I forgot to actually look at the encryption tool I used, I just did a search and found age was highly suggested. It is coded in Go, sure it is open source and all that I am just not a fan of the language.

[–] Dave@lemmy.nz 2 points 6 days ago

Ah yeah makes sense if it's not just for storing an offsite copy of backups like mine is.

[–] krypto@lemmy.ml 1 points 4 days ago (1 children)

I know I’ll get shot for this, but I stopped backing up a long time ago.

I was doing it at home because I do it at work and it’s the done thing. But when I stopped to think about it, I realised I don’t have anything at home that actually matters. If I lose my Plex library it’s ok.

[–] HerbGrower@slrpnk.net 1 points 4 days ago

Other than my password manager database, the rest of my backups are not overly valuable. I don't really need my 2016 factorio saves, but I have them. Adding more things to backup is minimal effort so I do, but if the space taken up becomes a concern there is plenty I could trim from it.

[–] Hupf@feddit.org 5 points 6 days ago (2 children)
[–] chewypoops@lemmy.world 3 points 6 days ago (1 children)

Unironically how I use LTO-6 tapes.

2.5TB of storage for ~$5/tape on ebay.

Never delete anything. If the authorities ever come after me, discovery is going to be hilarious.

[–] AHemlocksLie@lemmy.zip 2 points 6 days ago (1 children)

What's the catch, why don't we use those? I/O speed? Limited read/write cycles? I imagine it sucks if you need files on opposite ends of the tape.

[–] Hupf@feddit.org 6 points 6 days ago

The drives are crazy expensive if you want to use a somewhat recent generation.

load more comments (1 replies)
[–] lka1988@lemmy.dbzer0.com 1 points 4 days ago* (last edited 4 days ago) (1 children)

I just rsync a full backup of my NAS's entire RAID array every week to a separate machine. I have Proxmox set up with an NFS mount to the NAS where it stores all of the /[userdata] volumes that my VMs and LXCs use; Proxmox itself is hosted on 3x office PCs, each with i7-7700/500GB SSD/32GB RAM, and set up for replication in case one goes down. On occasion I'll actually document which services I'm using, so I don't really bother backing those up since the volume(s) holding the userdata itself is backed up and can be easily remapped to a new instance of whatever service needs it.

[–] HerbGrower@slrpnk.net 2 points 4 days ago (1 children)

Most of what I would use proxmox for doesn't even require backing up. A copy of each VM when it is setup and possibly update that every few years would be plenty.

I think you can export the whole VM? Using virtualbox currently which has import/export appliance. Doing that on an infrequent basis is pretty much what I would need.

[–] m4ylame0wecm@lemmy.zip 2 points 4 days ago

Proxmox has backup stuff for VMs and containers which uses whatever storage youbadd (local, NFS,), and has retention settings. iirc those will always be full backups. for incremental and more, proxmox backup server (PBS VM using backupNAS as destination for me)

[–] Zwuzelmaus@feddit.org 4 points 6 days ago

How long do you keep your backups?

Yes, I have that exernal HDD lying around somewhere near the PC, and it was at least 4 or 5 times that I backed up a lot of files on it.

I think I keep it for more than 10 years now.

[–] non_burglar@lemmy.world 3 points 6 days ago (1 children)

Daily for 10 days, 4 weekly, 4 monthly.

That covers me from broken updates, generally.

[–] HubertManne@piefed.social 1 points 6 days ago (1 children)

came to say something like this but not sure why you would do daily for 10 days. Your doing weeklys so why not 7. I would rather increase the monthly to 7 or do 6 bi monthly and keep a yearly.

[–] non_burglar@lemmy.world 1 points 5 days ago (1 children)

Your doing weeklys so why not 7

They are all daily backups, those schedules I pointed out are for pruning. And I don't understand the question... How would keeping 7 instead of 10 dailies help me?

[–] HubertManne@piefed.social 1 points 5 days ago (5 children)

because your last weekly would be a max of 7 days out

load more comments (5 replies)
[–] PetteriPano@lemmy.world 3 points 6 days ago

My VPS gets a weekly rsync to my home server. I keep ten deduplicated copies for weeks gone by. The current week also gets synced off-site with encryption.

[–] NoLemurs@lemmy.world 3 points 6 days ago
[forget]
keep-daily = 10
keep-weekly = 4

Daily backups are cheap because of de-duplication. I keep a few weekly backups in case it takes me a bit to notice something went wrong. I don't usually back up logs.

I could probably drop the weekly backups without much risk, but I've got the space.

[–] fuckwit_mcbumcrumble@lemmy.dbzer0.com 3 points 6 days ago (1 children)

As long as I have space. My backups are on dedicated drives, and as they run out of space the old ones are deleted.

[–] Dave@lemmy.nz 4 points 6 days ago (1 children)

I guess OPs question is more about what makes you comfortable.

Is your drive only big enough for 2 backups or is it big enough for hundreds? If it was half that size would you still be happy with the number of backups? A quarter of the size?

[–] fuckwit_mcbumcrumble@lemmy.dbzer0.com 2 points 4 days ago* (last edited 4 days ago) (1 children)

Kinda depends on what it's for. My server? IDK, 2 days. Maybe have a dedicated weekly/monthly backup left behind. PC? Honestly just the latest is fine.

But it's a 10tb drive, so I've got months of backups even if they're running continuously. It's less a how comfortable I am and more a how much can I afford. (a lot more before the shortage)

I also explicitly purge stuff that's constantly changing like logs. I don't care for logs in my backups. Only on the live machine.

[–] Dave@lemmy.nz 1 points 4 days ago (1 children)

I have about 750GB of irreplaceable files on my server so I want a really solid history. A couple of days backup is no where near enough to give me peace of mind 😅

[–] fuckwit_mcbumcrumble@lemmy.dbzer0.com 2 points 4 days ago (1 children)

3 2 1 offsite backups typically happen a lot less often than local copies or local backups.

I also don't really consider any machines data to be irreplaceable. If I lose my phone I want the latest backup. But taxes or photos I care for? Those are an entirely different backup, and those aren't incremental. They're just what they are.

[–] Dave@lemmy.nz 1 points 4 days ago

I have Nextcloud on my server which stores all those documents and photos etc. I have nightly offsite backup as well as backing up to a local borg repo on a separate drive.

But as it's that important to me, I also do a once-yearly backup of non-encrypted files to M-Disc, with two copies, one stored at my mother's house. This way if my house burns down and I'm inside it, my family can still get (most of) the precious memories without needing to know how to access a borg repo and without having to know how to download from Backblaze object storage.

I'm just a little bit paranoid about losing things after that one time I dragged from a USB stick to my computer and when it was done moving the files they were all corrupt, and didn't exist on the USB stick anymore either. Thanks Windows, a whole holiday of photos gone.

[–] JustARaccoon@lemmy.world 2 points 6 days ago (1 children)

7 backups, though the frequency they're taken (daily Vs weekly Vs monthly) depends on the service.

Why don't you exclude logs from your backups? databases sure yes that's where the real info is (not sure why you don't consider it real data) but logs are useless outside of the current running instance.

[–] gwheel@lemmy.zip 2 points 6 days ago (2 children)

I didn't really want to poke through each containers files to figure out where it stores logs, plus it adds risk that I'm not backing up something I should.

When I say databases aren't real data, I'm more talking about them changing every day despite nothing happening. Even if I haven't taken any photos or opened the app, today's db dump of immich is not the same as yesterday's db dump so restic stores it as a new unique file.

load more comments (2 replies)
[–] Treczoks@lemmy.world 2 points 6 days ago

Let me put it this way: I have a removable harddisk with my files from the universities' VAX 11/780 in storage. Long enough?

[–] ISOmorph@feddit.org 2 points 6 days ago* (last edited 6 days ago) (2 children)

I backup once a week. I have 3 backups (in 2 locations). Everytime a new one is created, the oldest is deleted. I figured if I need to roll back something, 3 weeks is more than enough to notice.

[–] Dave@lemmy.nz 5 points 6 days ago (1 children)

Back when I used OneDrive, it deleted an important but seldom used folder. It just wasn't there anymore. No one noticed for 6 months, but luckily I had kept a backup each month so could restore it easily.

3 weeks is definitely not long enough for me to notice something missing, if it's just a random chunk of my 700GB of important stuff. E.g. if a folder of my kids photos from 5 years ago suddenly disappeared, I probably wouldn't notice it for months but would be devistated to find it missing when I eventually went looking for it.

[–] ISOmorph@feddit.org 2 points 6 days ago

I don't host massive amounts of data. Just my contacts, calendars, grocery lists, rss feeds, that kind of stuff. All my pictures and movies are on my PC and backed up separately.

[–] passenger@sopuli.xyz 2 points 6 days ago

With borg or another deduplicating solution you could (probably) fit a year of daily in less space that the source takes. Of course depends how much the data changes over time. Highly recommend pika backup as borg desktop client. You can also easily do "smart" retention where only last week is daily, then weekly, monthly, yearly.

[–] ShortN0te@lemmy.ml 1 points 5 days ago (1 children)

As of now, i keep them basically for ever, but granularity gets less over time. (restic forget)

Before you go nuts about files you want to exculde the "churn" as you said it, go ahead and actually check how much space this actually takes up. Text and especially logs are highly compressible and will most likely end up taking up almost no space.

Be sure you backup everything you actually need, rather backup a file more then a file too less.

[–] gwheel@lemmy.zip 1 points 5 days ago

Comparing daily snapshots I see 100mb+ daily churn (I assume restic diff is pre compression), the borgbase repository space usage chart shows it increasing about 50mb daily.

[–] Decronym@lemmy.decronym.xyz 1 points 6 days ago* (last edited 17 hours ago)

Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:

Fewer Letters More Letters
Git Popular version control system, primarily for code
LXC Linux Containers
NAS Network-Attached Storage
NFS Network File System, a Unix-based file-sharing protocol known for performance and efficiency
NVMe Non-Volatile Memory Express interface for mass storage
Plex Brand of media server package
RAID Redundant Array of Independent Disks for mass storage
SSD Solid State Drive mass storage
VPN Virtual Private Network
VPS Virtual Private Server (opposed to shared hosting)

10 acronyms in this thread; the most compressed thread commented on today has 7 acronyms.

[Thread #137 for this comm, first seen 17th Oct 2026, 15:00] [FAQ] [Full list] [Contact] [Source code]

load more comments
view more: next ›