#rsyncd — Public Fediverse posts

mein #offsite_backup nähert sich der Fertigstellung.

Ein alter D2701 Atom in einem thecus NAS wird zu meinem Bruder an einen Glasfaseranschluss verfrachtet.

4 enterprise 1TB HDDs mit ZFS raidz2 + 1 coldspare.

#ProxmoxBackupServer und bissel #docker mit #restic_rest_server und #scrutiny.

Nun ist die Kiste nicht mehr die schnellste und mit #netbird ist bereits alles verschlüsselt, also können wir darin plaintext machen.

good old #rsyncd rockt auf der alten Gurke noch 450Mbit Durchsatz 😎

So here's a #brainfart / #rant regarding #USB3 and #RaspberryPi 4.

I have my Photos in a #Synology ​:synology:​ with 4GB in a RAID 1. I thought I achieved something with this redundancy until somebody said "Yeah, but if the host fails you're still fucked" ... and it's true.

So I repurposed a #RPi4 ​:rpi:​ into a #OpenMediaVault ​:omv:​ so that I could achieve an extra backup of my photos ​:dance_cool_doge:​

⏩ FastForward to this week, I have my DS 720+ with SATA3 (6Gb/s) via LAN 1Gb/s backing up into the RPi4 using a USB3 (4.8Gb/s) through rsync. But I achieve only consistent 30MB/s, far from the numbers suggested by the protocols ​:excuseme:​

- I checked the LAN with iperf and I get ~850Mb/s, that should be around 100MB/s.
- The WD Red HDD appears to be at least 180MB/s here

And then I run into this article regarding the USB3 support of the #RaspberryPi4 ... Makes total sense, but it's a bit disappointing 🙄

I was actually pointing the finger to the #rsync, using or not compression, and I saw no significant difference between doing the rsync through SSH or via #rsyncd

I have to change the approach, I can't maintain a daily incremental backup with such a speed, the process takes hours!

And now looking again to rsync, maybe I should dig deeper through multithreading, I saw solutions that take a process per folder tree and queues. Let's see

Sorry for the divagation 😇