Selfhosted

60093 readers

830 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam.
Posts here are to be centered around self-hosting. Please ensure it is clear in your post how it relates to self-hosting.
Don't duplicate the full text of your blog or git here. Just post the link for folks to click.
Submission headline should match the article title.
No trolling.
Promotion posts require your active participation in selfhosting or related communities, or the post will be removed. No more than 10% of your posts or comments may be self-promotional, or your post will be removed. F/LOSS Exception: If your post is about a project that is completely open source & can be self-hosted in full without payment, and your account is at least 30 days old, your post is exempt from this rule as long as you continue to engage in comments.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

160

How do you effectively backup your high capacity (20+ TB) local NAS? (lemmy.world)

submitted 4 months ago* (last edited 4 months ago) by NekoKoneko@lemmy.world to c/selfhosted@lemmy.world

120 comments fedilink hide all child comments

I have a 56 TB local Unraid NAS that is parity protected against single drive failure, and while I think a single drive failing and being parity recovered covers data loss 95% of the time, I'm always concerned about two drives failing or a site-/system-wide disaster that takes out the whole NAS.

For other larger local hosters who are smarter and more prepared, what do you do? Do you sync it off site? How do you deal with cost and bandwidth needs if so? What other backup strategies do you use?

(Sorry if this standard scenario has been discussed - searching didn't turn up anything.)

you are viewing a single comment's thread
view the rest of the comments

[–] danielquinn@lemmy.ca 5 points 3 months ago (1 children)

Honestly, I'd buy 6 external 20tb drives and make 2 copies of your data on it (3 drives each) and then leave them somewhere-safe-but-not-at-home. If you have friends or family able to store them, that'd do, but also a safety deposit box is good.

If you want to make frequent updates to your backups, you could patch them into a Raspberry Pi and put it on Tailscale, then just rsync changes every regularly. Of course means that wherever youre storing the backup needs room for such a setup.

I often wonder why there isn't a sort of collective backup sharing thing going on amongst self hosters. A sort of "I'll host your backups if you host mine" sort of thing. Better than paying a cloud provider at any rate.

[–] Joelk111@lemmy.world 4 points 3 months ago* (last edited 3 months ago) (1 children)

That NAS software company Linus (of Linus Tech Tips) funded has a feature for this planned I think.

An open-source standalone implementation would be dope as hell. Sure, it'd mean you'd need to double your NAS capacity (as you'd have to provide enough storage as you use), but that's way easier than building a second NAS and storing/maintaining it somewhere else or constantly paying for and managing a cloud backup.

[–] WhyJiffie@sh.itjust.works 1 points 3 months ago (1 children)

such a system would need a strict time limit for restoration after the catastrophe. Otherwise leeching would be too easy.

[–] Joelk111@lemmy.world 1 points 3 months ago* (last edited 3 months ago) (1 children)

That's an incredibly good point. Bad actors are the worst. Some ideas:

Maybe you'd need to contribute your storage capacity +10% (or more), to account for your and other's downtime during disasters.
A time limit after disasters would be necessary. It's difficult to think of a proper time limit though, as even a month might not be enough time if your entire house burns down.
Maybe a payment system could be set up to where, if your server doesn't ping for a week, your credit card is automatically charged (after pinging you with many emails). Sure, that'd suck, but it'd be better than loosing your data, and cheaper overall than paying for cloud backups. I'm not sure where that money would go. Maybe distributed to those who didn't experience a disaster, or maybe to the software project, though that would mean people are profiting from a disaster. Maybe it could go to a charity of your choice or something.

Definitely a difficult problem to solve. I'm sure people smarter than me have ideas beyond mine.

[–] WhyJiffie@sh.itjust.works 1 points 3 months ago

A time limit after disasters would be necessary. It's difficult to think of a proper time limit though, as even a month might not be enough time if your entire house burns down.

and also accounting for low bandwidth connections.. whats more, some shitty providers even have monthly data caps

Maybe a payment system could be set up to where, if your server doesn't ping for a week, your credit card is automatically charged (after pinging you with many emails).

yeah, that would be almost a necessary feature. being able to hold on to the backup when you really can't restore.