home.social

#mergerfs — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #mergerfs, aggregated by home.social.

fetched live
  1. mal wieder ein use case par excellence für unter linux:

    unter wurden keine ordner angezeigt trotz gesetzter acls

    LÖSUNG

    FUSE default_permissions bricht POSIX ACLs — und niemand merkt's

    Setup: Ubuntu Fileserver, Samba/Winbind in AD-Domäne, Storage-Pool via mergerfs (FUSE). POSIX ACLs korrekt gesetzt — group:bs_alle:r-x auf /srv/storage/Mitarbeiter. User ist in bs_alle. Ext4 direkt: Zugriff klappt. Über mergerfs: Permission denied.

    Symptom: test -r sagt OK, ls sagt denied. Windows-ACLs korrekt, Samba-ACLs korrekt, ext4-ACLs korrekt. Nichts zu finden.

    Root cause: FUSE default_permissions wird vom Kernel-Modul geprüft — und der kennt nur owner/group/other, keine named POSIX ACLs. group:bs_alle:r-x wird ignoriert. group::--- (base group) greift → DENY. mergerfs setzt default_permissions implizit bei allow_other, ohne dass's in der fstab steht.

    Fix: mergerfs ≥ 2.41.0 hat default_permissions=false als Option (PR #1448). Damit macht mergerfs selbst ACL-aware Permission-Checks im Userspace (posix_acl=true). mergerfs 2.42.0 installiert, fstab angepasst, remount — 15 Sekunden Downtime. ACLs greifen, Security intakt.

    Lektion: FUSE default_permissions und POSIX ACLs sind inkompatibel. Wenn ihr FUSE-Mounts mit ACL-basierten Permissions habt — checkt das.

  2. 🎧 Your ears called. BitFlip picked up.

    📻 Ep. 8 — Just Install it on the Host

    We dig into the NVIDIA RTX Spark and what it means for local AI, revisit the Proxmox-vs-Unraid debate through Alex's Perfect Media Server Part 3, and do a deep dive on Jellyfin's strengths, rough edges, and the upcoming version 12.

    #bitflipshow #Nvidia #LocalAi #Llm #Proxmox #Arm #Unraid #Mergerfs #Snapraid #Ansible #Jellyfin

    🔗 bitflip.show/8

  3. 🎧 Your ears called. BitFlip picked up.

    📻 Ep. 8 — Just Install it on the Host

    We dig into the NVIDIA RTX Spark and what it means for local AI, revisit the Proxmox-vs-Unraid debate through Alex's Perfect Media Server Part 3, and do a deep dive on Jellyfin's strengths, rough edges, and the upcoming version 12.

    🔗 bitflip.show/8

  4. Perfect Media Server Part 3 is out!!!

    This feature length epic details everything you need to know to build a media server from the ground up using nothing be free and open-source software.

    #selfhosted #jellyfinjune #proxmox #mergerfs #snapraid #docker (repost due to techhub.social downtime)

    youtu.be/5xLopzndVfU

  5. Perfect Media Server Part 3 is out!!!

    This feature length epic details everything you need to know to build a media server from the ground up using nothing be free and open-source software.

    (repost due to techhub.social downtime)

    youtu.be/5xLopzndVfU

  6. Perfect Media Server Part 3 is out!!!

    This feature length epic details everything you need to know to build a media server from the ground up using nothing but free and open-source software.

    #selfhosted #jellyfinjune #proxmox #mergerfs #snapraid #docker

    youtu.be/5xLopzndVfU

  7. Perfect Media Server Part 3 is out!!!

    This feature length epic details everything you need to know to build a media server from the ground up using nothing but free and open-source software.

    youtu.be/5xLopzndVfU

  8. 🐧 Hardware-Monitoring für einen Ubuntu-Fileserver — in einer Session gebaut! 🚀

    ~50 Interaktionen, ca. 30 Minuten. Ergebnis:

    ▫️ sensors.sh — CPU (Package + 6 Cores), NVMe, ACPI Temps
    ▫️ disks.sh — SMART für HDD (20TB Exos) + NVMe SSD
    ▫️ system.sh — CPU, RAM (DDR5-Slots!), GPU, BIOS, Mainboard via dmidecode
    ▫️ mergerfs.sh — Pool-Übersicht: Belegung, Inodes, Berechtigungen
    ▫️ updates.sh — apt update/upgrade + Neustart-Check
    ▫️ check-all.sh — Master-Script, läuft alles durch
    ▫️ mail.sh — Mail-Versand via SMTP
    ▫️ Custom opencode Skill „log-summary" — liest Log, fasst zusammen, sendet per Mail
    ▫️ Cron-Job: täglich 01:00 → Check → Zusammenfassung → Mail 📧

    Jeden Morgen eine kompakte Übersicht im Postfach — alle Temperaturen einzeln, SMART-Status, Storage, Updates. Nur Alarme wenn was nicht stimmt.

    Tech-Stack: Ubuntu 26.04, smartmontools, lm-sensors, dmidecode, mergerfs, opencode AI, Python smtplib, cron

    thanks to:

  9. 🐧 Ubuntu Fileserver in eine Windows-Domäne integriert — und es war satisfying! 🚀

    Was wir gebaut haben:
    ▫️ Domänenbeitritt via realmd/SSSD zu Active Directory
    ▫️ mergerfs-Pool: 374 GB NVMe + 18 TB HDD = ~18,5 TB vereinter Storage
    ▫️ Samba als Domain Member mit winbind ID-Mapping
    ▫️ ACL-Support für Windows-kompatible Berechtigungen
    ▫️ AD-Gruppen steuern den Zugriff auf Freigaben

    Das Besondere: mergerfs lässt jede Platte einzeln ansprechbar. Bei Plattenausfall sind nur die Daten darauf weg — kein RAID-Overhead, dafür TSM-Backup pro Platte. Perfekt für Cold Data.

    Samba läuft mit acl_xattr, NTFS-ACLs werden als xattr auf ext4 gespeichert. Windows-Clients verbinden sich nahtlos mit Domänen-Credentials.

    Der i5-12400 langweilt sich dabei mit 90% Idle. 📉

    Tech-Stack: Ubuntu 26.04, realmd, SSSD, Samba, winbind, mergerfs, ext4

    thanks n credits to:

    =)

  10. My experience with #OMV #NAS with #RaspberryPi, and using #SnapRAID + #MergerFS, is that while SnapRAID's really cool, it def could not beat real #RAID. My understanding is RAID works on a low/block level so it can achieve redundancy 'in real time' no matter what files you have, but since SnapRAID is in software, it's not only more involved but it also simply could not achieve full redundancy as you will def need to exclude a lot of files (which could render ur redundancy useless, depending on ur use case) and it's also more involved where you might need to e.g. stop a bunch of #Docker containers prior to it doing its thing.

    I'm just not sure how to achieve 'real' RAID on an RPi 4 (of varying memory capacities). One benefit of SnapRAID (and MergerFS) is that you could easily implement it with USB-attached disks, which is the 'friendliest' choice for SBCs like the Pi which has no SATA connectivity built-in.

  11. My experience with #OMV #NAS with #RaspberryPi, and using #SnapRAID + #MergerFS, is that while SnapRAID's really cool, it def could not beat real #RAID. My understanding is RAID works on a low/block level so it can achieve redundancy 'in real time' no matter what files you have, but since SnapRAID is in software, it's not only more involved but it also simply could not achieve full redundancy as you will def need to exclude a lot of files (which could render ur redundancy useless, depending on ur use case) and it's also more involved where you might need to e.g. stop a bunch of #Docker containers prior to it doing its thing.

    I'm just not sure how to achieve 'real' RAID on an RPi 4 (of varying memory capacities). One benefit of SnapRAID (and MergerFS) is that you could easily implement it with USB-attached disks, which is the 'friendliest' choice for SBCs like the Pi which has no SATA connectivity built-in.

  12. I'm setting up my fileserver again. Before I used MergerFS and 4x4tb NAS drivers, to aggregate the files on all the drives as one mountpoint. The nice thing about mergerfs is that the disks are completely separate (files are written whole to each disk - nice !). The data is not important at all to me and backed up so I don't need RAID etc. Any suggestions of an alternative approach? I hear ZFS pools are interesting, but never used zfs.

  13. I'm setting up my fileserver again. Before I used MergerFS and 4x4tb NAS drivers, to aggregate the files on all the drives as one mountpoint. The nice thing about mergerfs is that the disks are completely separate (files are written whole to each disk - nice !). The data is not important at all to me and backed up so I don't need RAID etc. Any suggestions of an alternative approach? I hear ZFS pools are interesting, but never used zfs. #linux #mergerfs #zfs #datahoarding

  14. Because I had a conveersation about #backup yesterday at the pool.

    trapexit, author of mergerfs, has a collection of IMHO , good and new user friendly howtos over here.

    github.com/trapexit/backup-and

    #linix #btrfs #zfs #snapraid #mergerfs #backup #rsync

  15. @diegolakatos this was great. I went with Open Media Vault (OMV). The installer for that was a little painful because it didn't support manual partitioning. But it loaded on to a TerraMaster F4-424 without any issues.

    I added the OMV extras repository. Installed mergerfs and SnapRAID.
    Configured through the UI.

    It works! Simple and effective. I checked my files by mounting independently and they all look good. Then tested a recovery by formatting a drive and using SnapRAID and it worked beautifully.

    Extremely happy! Thank you.

    #selfhosting #selfhosted #openmediavault #mergerfs #snapraid #terramaster

  16. I think I might RMA that one SATA SSD - that SSD is currently setup as 1 of 2 #SnapRAID data drives (there's another identical parity drive), that is then part of a #MergerFS pool.

    There are a ton of video guides on how to replace a disk part of a
    #RAID array for failure/upgrade reasons on #TrueNAS, but not found one for this SnapRAID-MergerFS setup on #OpenMediaVault.

    From what I can tell, there doesn't seem to be a graphical option on
    #OMV to do this easily/intuitively. Might need to look up some written guides/docs to do this safely, so I can send the SSD back, and recover my data on the replacement drive once it arrived.

    ---

    Hopefully, this written guide should suffice:

    🔗 https://wiki.omv-extras.org/doku.php?id=omv7:omv7_plugins:snapraid#recovery_operations

    RE: https://sakurajima.social/notes/a8mrrt78bi

  17. I think I might RMA that one SATA SSD - that SSD is currently setup as 1 of 2 #SnapRAID data drives (there's another identical parity drive), that is then part of a #MergerFS pool.

    There are a ton of video guides on how to replace a disk part of a
    #RAID array for failure/upgrade reasons on #TrueNAS, but not found one for this SnapRAID-MergerFS setup on #OpenMediaVault.

    From what I can tell, there doesn't seem to be a graphical option on
    #OMV to do this easily/intuitively. Might need to look up some written guides/docs to do this safely, so I can send the SSD back, and recover my data on the replacement drive once it arrived.

    ---

    Hopefully, this written guide should suffice:

    🔗 https://wiki.omv-extras.org/doku.php?id=omv7:omv7_plugins:snapraid#recovery_operations

    RE: https://sakurajima.social/notes/a8mrrt78bi

  18. I've managed to get #OpenMediaVault working on my #RaspberryPi (running #Raspbian Lite) and the performance seems pretty impressive! Despite relying on USB storage for the SSDs.

    This is my first time running a
    #NAS on the Pi, on #OMV, not using #ZFS or #RAID but rather an #Unraid like solution, 'cept, #FOSS called #SnapRAID in combination with #mergerfs (the drives themselves are simply #EXT4).

    So far, honestly, so good. I got 2x 1TB SSDs for data, and another 1TB SSD for parity. Don't have a backup for the data themselves atm, but I do have a scheduled backup solution (
    #RaspiBackup) setup for the OS itself (SD card). It's also got #Timeshift for creating daily snapshots.

    I'm not
    out of the woods yet though, cos after this comes the (somewhat) scary part - deploying #Immich on the Pi lol (using OMV's #Docker compose interface perhaps). I really could just deploy it in my #Proxmox #homelab, and I wouldn't have to worry about system resources or hardware transcoding, etc. but I really wanna experiment this 'everything hosted/contained in 1 Pi' concept.

  19. I've managed to get #OpenMediaVault working on my #RaspberryPi (running #Raspbian Lite) and the performance seems pretty impressive! Despite relying on USB storage for the SSDs.

    This is my first time running a
    #NAS on the Pi, on #OMV, not using #ZFS or #RAID but rather an #Unraid like solution, 'cept, #FOSS called #SnapRAID in combination with #mergerfs (the drives themselves are simply #EXT4).

    So far, honestly, so good. I got 2x 1TB SSDs for data, and another 1TB SSD for parity. Don't have a backup for the data themselves atm, but I do have a scheduled backup solution (
    #RaspiBackup) setup for the OS itself (SD card). It's also got #Timeshift for creating daily snapshots.

    I'm not
    out of the woods yet though, cos after this comes the (somewhat) scary part - deploying #Immich on the Pi lol (using OMV's #Docker compose interface perhaps). I really could just deploy it in my #Proxmox #homelab, and I wouldn't have to worry about system resources or hardware transcoding, etc. but I really wanna experiment this 'everything hosted/contained in 1 Pi' concept.

  20. Installing #OpenMediaVault on the #RaspberryPi so far... has been kind of a headache, despite how it always seemed 'simple' on other people's videos... Kinda wondering if I'm better off, just, setting up #SnapRAID, #mergerfs, and #Samba/#CIFS manually.

    I don't think I need
    #OMV specifically, using the Pi as a simple #SMB share that I also happen to run some #Docker services on, I just thought it'd be neat to finally try out OMV, after having only used and been familiar with #TrueNAS all this while.

    --

    Well, while it was busy installing (which I initiated remotely, through SSH), for some fuckin' reason I got disconnected to it and I couldn't reconnect to it through SSH again. Why does this only happen when I'm a million miles away (exaggerating) and have no physical access to it but when I'm literally in the same building, doing the same type of thing thousands of times, everything just.. goes swell to the point that it deluded me into thinking
    #KVM 's a waste of money :')

  21. Installing #OpenMediaVault on the #RaspberryPi so far... has been kind of a headache, despite how it always seemed 'simple' on other people's videos... Kinda wondering if I'm better off, just, setting up #SnapRAID, #mergerfs, and #Samba/#CIFS manually.

    I don't think I need
    #OMV specifically, using the Pi as a simple #SMB share that I also happen to run some #Docker services on, I just thought it'd be neat to finally try out OMV, after having only used and been familiar with #TrueNAS all this while.

    --

    Well, while it was busy installing (which I initiated remotely, through SSH), for some fuckin' reason I got disconnected to it and I couldn't reconnect to it through SSH again. Why does this only happen when I'm a million miles away (exaggerating) and have no physical access to it but when I'm literally in the same building, doing the same type of thing thousands of times, everything just.. goes swell to the point that it deluded me into thinking
    #KVM 's a waste of money :')

  22. Part 1 of a massive new video series I've been working really hard on behind the scenes for the last few weeks.

    100% open source. 100% free.

    Join me on the journey to build the Perfect Media Server.

    youtu.be/Yt67zz9p0FU

    #selfhosting #mediaserver #homeinfra #mergerfs #snapraid #docker

  23. Part 1 of a massive new video series I've been working really hard on behind the scenes for the last few weeks.

    100% open source. 100% free.

    Join me on the journey to build the Perfect Media Server.

    youtu.be/Yt67zz9p0FU

  24. Switched my big 16 TB harddrive which served as a backup with the "smaller" 8 TB one which turned into the backup hdd.

    Planning to just get another 8 TB one and using #mergerFS to expand the backup storage.

    Anyone with a few experiences regarding that setup?

    #selfhosting #linux #backup

  25. True true! Perfect for the „poor man's Datacentre“ ;) I built a storage pool of my existing USB-Drives with various content, combined with some internal Drives, just by adding one or two Drives for RAID-Parity and writing a few lines of config and merged the content via #MergerFS (github.com/trapexit/mergerfs) to one big Storage. Boom, Cloud :awesome: :hacker:
    @chpietsch

  26. True true! Perfect for the „poor man's Datacentre“ ;) I built a storage pool of my existing USB-Drives with various content, combined with some internal Drives, just by adding one or two Drives for RAID-Parity and writing a few lines of config and merged the content via #MergerFS (github.com/trapexit/mergerfs) to one big Storage. Boom, Cloud :awesome: :hacker:
    @chpietsch

  27. Well, added a storage tier this evening.

    A couple 4 Tb drives which I had laying about, as #JBOD (#MergerFS), for those media files which are "replaceable" and don't really need to be on #ZFS mirrors (~70 & ~16 Tb).

    I now feed into #Plex from the different tiers using #OverlayFS.

    Pretty neat. I can move things around without Plex noticing, select the tier in #Sonarr / #Radarr, and if one of those 4 Tb drives goes down, NBD and I can see what is missing.

    More iops don't hurt either.

  28. Ich hab in meinem Desktop ja neben der SSD eine HDD für große Daten (Fotos, Videoschnitt) oder "das Datenarchiv" mit alten, selten genutzten Dingen. Bislang war es immer etwas fummelig zu verwalten, was wo abgelegt ist.
    mergerfs github.com/trapexit/mergerfs sieht nach einem vielversprechenden Ansatz aus, eine gemeinsame Sicht in einem Verzeichnisbaum zu bekommen!
    #linux #mergerfs

  29. @kirsten @wuffel RPi4 mit 4GB. Daran habe ich nen Fantec 4-bay Gehäuse mit den Platten. ~30TB Gesamt. Das ganze per USB3 angeschlossen. Leistung ist halt bei ca. 30MB/s im Netzwerk. Da ist die Miese Verbindung von USB und Raspi Schuld. AlsoOS nutze ich OMV. Die Platten sind gepoolt mit #mergerfs. Funktioniert absolut brauchbar. Mache meine ganzen Backups drüber. Und als Schmankerl läuft auch Docker mit paar Containern drauf. Hauptsächlich #selfhost Zeug.

  30. @kirsten @wuffel RPi4 mit 4GB. Daran habe ich nen Fantec 4-bay Gehäuse mit den Platten. ~30TB Gesamt. Das ganze per USB3 angeschlossen. Leistung ist halt bei ca. 30MB/s im Netzwerk. Da ist die Miese Verbindung von USB und Raspi Schuld. AlsoOS nutze ich OMV. Die Platten sind gepoolt mit #mergerfs. Funktioniert absolut brauchbar. Mache meine ganzen Backups drüber. Und als Schmankerl läuft auch Docker mit paar Containern drauf. Hauptsächlich #selfhost Zeug.

  31. After looking more into #TrueNAS Scale, I decided to just stick with #Snapraid + #MergerFS for my Plex Media. I like having the ability to mix and match drives and easily expand my storage.

    I have never understood why RAID is so much more popular than SnapRaid.

  32. After looking more into #TrueNAS Scale, I decided to just stick with #Snapraid + #MergerFS for my Plex Media. I like having the ability to mix and match drives and easily expand my storage.

    I have never understood why RAID is so much more popular than SnapRaid.

  33. Has anyone around the #Fediverse used a NAS with #MergerFS and #SnapRAID, rather than conventional RAID setups? I want to hear about its stability and usability in a real-world scenario.

    The plan here is a file storage server with up to 14 disks of 16TB each. Other great ideas for this setup are welcome too, I have about 1 week left to orient on how I will configure it.

  34. So I bought #Unraid and only then realized the booting-from-a-USB-stick thing isn't just for ease-of-use and optional, but actually an anti-piracy scheme.

    I'm just not going to let my homemade NAS system be dependent on a flimsy USB stick. Guess I'll have to give #mergerfs + #snapraid another go, with #openMediaVault this time.

    #linux #homeServer #nas #omv

  35. So I bought #Unraid and only then realized the booting-from-a-USB-stick thing isn't just for ease-of-use and optional, but actually an anti-piracy scheme.

    I'm just not going to let my homemade NAS system be dependent on a flimsy USB stick. Guess I'll have to give #mergerfs + #snapraid another go, with #openMediaVault this time.

    #linux #homeServer #nas #omv

  36. ndr.de/kultur/film/Animationsf

    Done. Now its time to send this #zfs mount to darkstar02.

    Using #linux as desktop-workstation for #animation and #film has gotten harder the last years. All the awesome tools like #mergerfs , nfscached, zfs and kickstart are outweighed by gnomes lack of documentation, sneaking abandon of old linux/unix virtues like one tool for one job (systemd, NetworkManager), multi user. But still #linux makes things just possible.

  37. Do you know that MergerFS is integrated in CasaOS since version 0.3.8?

    blog.casaos.io/blog/13.html

  38. Ah, I was wondering why #MergerFS seemed like a permission nightmare for me, from digging I realized only mmap was failing, and it turns out enabling direct_io or cache.files=off causes mmap to fail on MergerFS. TIL!

    reddit.com/r/jellyfin/comments

  39. CW: Wining about software

    So, it seems that #mergerfs has been ignoring the 4 smallest drives in my system. The 3 big drives are now full... WHY!?

    Oh well, thank goodness for mergerfs.balance which should fix everything.

  40. CasaOS has just released its v0.3.7, which includes a lot of fixes in storage management and beta support of MergerFS (feature toggled)

    github.com/IceWhaleTech/CasaOS

  41. @tobomir I run two nearly similar systems just because I got them for free apart from the HDDs. They are Fujitsu Esprimo P5731 & P5730 PCs. I run an additional old self-built PC with an EE AMD Athlon. None of the systems runs close to 24/7. All run #OpenMediaVault & use #mergerfs to pool the drives.