this post was submitted on 03 Oct 2025
550 points (97.3% liked)

Selfhosted

52084 readers
682 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

You might not even like rsync. Yeah it's old. Yeah it's slow. But if you're working with Linux you're going to need to know it.

In this video I walk through my favorite everyday flags for rsync.

Support the channel:
https://patreon.com/VeronicaExplains
https://ko-fi.com/VeronicaExplains
https://thestopbits.bandcamp.com/

Here's a companion blog post, where I cover a bit more detail: https://vkc.sh/everyday-rsync

Also, @BreadOnPenguins made an awesome rsync video and you should check it out: https://www.youtube.com/watch?v=eifQI5uD6VQ

Lastly, I left out all of the ssh setup stuff because I made a video about that and the blog post goes into a smidge more detail. If you want to see a video covering the basics of using SSH, I made one a few years ago and it's still pretty good: https://www.youtube.com/watch?v=3FKsdbjzBcc

Chapters:
1:18 Invoking rsync
4:05 The --delete flag for rsync
5:30 Compression flag: -z
6:02 Using tmux and rsync together
6:30 but Veronica... why not use (insert shiny object here)

(page 2) 50 comments
sorted by: hot top controversial new old
[–] ryper@lemmy.ca 9 points 5 days ago* (last edited 5 days ago) (3 children)

I was planning to use rsync to ship several TB of stuff from my old NAS to my new one soon. Since we're already talking about rsync, I guess I may as well ask if this is right way to go?

[–] Suburbanl3g3nd@lemmings.world 7 points 5 days ago* (last edited 5 days ago)

I couldn't tell you if it's the right way but I used it on my Rpi4 to sync 4tb of stuff from my Plex drive to a backup and set a script up to have it check/mirror daily. Took a day and a half to copy and now it syncs in minutes tops when there's new data

[–] Cyber@feddit.uk 4 points 4 days ago (2 children)

It depends

rsync is fine, but to clarify a little further...

If you think you'll stop the transfer and want it to resume (and some data might have changed), then yep, rsync is best.

But, if you're just doing a 1-off bulk transfer in a single run, then you could use other tools like xcopy / scp or - if you've mounted the remote NAS at a local mount point - just plain old cp

The reason for that is that rsync has to work out what's at the other end for each file, so it's doing some back & forwards communications each time which as someone else pointed out can load the CPU and reduce throughput.

(From memory, I think Raspberry Pi don't handle large transfers over scp well... I seem to recall a buffer gets saturated and the throughput drops off after a minute or so)

Also, on a local network, there's probably no point in using encryption or compression options - esp. for photos / videos / music... you're just loading the CPU again to work out that it can't compress any further.

load more comments (2 replies)
[–] GreenKnight23@lemmy.world 5 points 5 days ago (1 children)

yes, it's the right way to go.

rsync over ssh is the best, and works as long as rsync is installed on both systems.

[–] qjkxbmwvz@startrek.website 3 points 5 days ago

On low end CPUs you can max out the CPU before maxing out network---if you want to get fancy, you can use rsync over an unencrypted remote shell like rsh, but I would only do this if the computers were directly connected to each other by one Ethernet cable.

[–] surph_ninja@lemmy.world 8 points 5 days ago

Use borg/borgmatic for your backups. Use rsync to send your differentials to your secondary & offsite backup storage.

[–] i_stole_ur_taco@lemmy.ca 9 points 5 days ago (8 children)

The thing I hate most about rsync is that I always fumble to get the right syntax and flags.

This is a problem because once it’s working I never have to touch it ever again because it just works and keeping working. There’s not enough time to memorize the usage.

[–] mesamunefire@piefed.social 5 points 5 days ago

I feel this too. I have a couple of "spells" that work wonders in a literal small notebook with other one liners over the years. Its my spell book lol.

load more comments (7 replies)
[–] solrize@lemmy.ml 9 points 5 days ago* (last edited 5 days ago) (1 children)

I've been using borg because of the backend encryption and because the deduplication and snapshot features are really nice. It could be interesting to have cross-archive deduplication but maybe I can get something like that by reorganizing my backups. I do use rsync for mirroring and organizing downloads, but not really for backups. It's a synchronization program as the name implies, not really intended for backups.

load more comments (1 replies)
[–] calliope@retrolemmy.com 8 points 5 days ago (10 children)

Tangentially, I don’t see people talk about rclone a lot, which is like rsync for cloud storage.

It’s awesome for moving things from one provider to another, for example.

[–] davidvasandani@social.coop 3 points 5 days ago (1 children)

@calliope It’s also great for local or remote backups over ssh, smb, etc.

load more comments (1 replies)
load more comments (9 replies)
[–] Wispy2891@lemmy.world 1 points 3 days ago (2 children)

I tried to use it via tailscale but it disconnects very easily - is to be expected?

load more comments (2 replies)
[–] vext01@lemmy.sdf.org 4 points 4 days ago

I used to use rsnapshot, which is a thin wrapper around rsync to make it incremental, but moved to restic and never looked back. Much easier and encrypted by default.

[–] Mio@feddit.nu 4 points 4 days ago* (last edited 4 days ago) (2 children)

I think the there are better alternatives for backup like kopia and restic. Even seafile. Want protection against ransomware, storage compression, encryption, versioning, sync upon write and block deduplication.

[–] lazynooblet@lazysoci.al 4 points 4 days ago

comparing seafile to rsync reminds me the old "Space Pen" folk tale.

load more comments (1 replies)
[–] Landless2029@lemmy.world 6 points 5 days ago

I need a breakdown like this for Rclone. I've got 1TB of OneDrive free and nothing to do with it.

I'd love to setup a home server and backup some stuff to it.

[–] tal@olio.cafe 5 points 5 days ago* (last edited 5 days ago) (2 children)

slow

rsync is pretty fast, frankly. Once it's run once, if you have -a or -t passed, it'll synchronize mtimes. If the modification time and filesize matches, by default, rsync won't look at a file further, so subsequent runs will be pretty fast. You can't really beat that for speed unless you have some sort of monitoring system in place (like, filesystem-level support for identifying modifications).

[–] eager_eagle@lemmy.world 3 points 5 days ago

yeah, more often than not I notice the bottleneck being the storage drive itself, not rsync.

load more comments (1 replies)
[–] Xylight@lemdro.id 3 points 4 days ago

rsync for backups? I guess it depends on what kind of backup

for redundant backups of my data and configs that I still have a live copy of, I use restic, it compresses extremely well

I have used rsync to permanently move something to another drive though

[–] portnull@lemmy.dbzer0.com 3 points 5 days ago* (last edited 5 days ago) (3 children)

Maybe I am missing something but how does it handle snapshots?

I use rsync all the time but only for moving data around effectively. But not for backups as it doesn't (AFAIK) hanld snapshots

load more comments (3 replies)
load more comments
view more: ‹ prev next ›