#raid5 — Public Fediverse posts

One of my first encounters with the Beautiful BSD Operating Systems was on a machine that Loves Pepper.

It was configured to do one task and do that one task well. The machine was a file server configured to serve diverse clients with speed agility and redundancy. The machine which loved to be called ChiliBox had space for just a couple of hard drives HDDs. That meant that if you want it true redundancy, you had to connect external hard drives
Those enclosures could also be provided by the hardware vendor

The ChiliBox was a fun toy to play with

It served my clients well for a number of years where all that was needed was to swap out hard drives which were worn without losing any data the only patience the client needed to have, is to make the resilvering of the new HDD complete itself.

#BSD #freeBSD #UNIX #ChiliBox #Server #filesystem #Raid #Raid5 #technology #OpenSource

One of my first encounters with the Beautiful BSD Operating Systems was on a machine that Loves Pepper.

It was configured to do one task and do that one task well. The machine was a file server configured to serve diverse clients with speed agility and redundancy. The machine which loved to be called ChiliBox had space for just a couple of hard drives HDDs. That meant that if you want it true redundancy, you had to connect external hard drives
Those enclosures could also be provided by the hardware vendor

The ChiliBox was a fun toy to play with

It served my clients well for a number of years where all that was needed was to swap out hard drives which were worn without losing any data the only patience the client needed to have, is to make the resilvering of the new HDD complete itself.

#BSD #freeBSD #UNIX #ChiliBox #Server #filesystem #Raid #Raid5 #technology #OpenSource

I had to decide -- more burn-in to check for early errors or just build the array and let it detect them? So I fired up mdadm to create my #RAID5 array and that took literally all day. Oh and today too. But its done now and I downloaded 15 GiB from one and 17 GiB from the other event off my main camera.
I can finally fire up #darktable and start culling and processing pictures.
Dear fellow photo #geeks, its not just you. It happens to all of us.
Also please be patient, I'll post #photos soon!

I had to decide -- more burn-in to check for early errors or just build the array and let it detect them? So I fired up mdadm to create my #RAID5 array and that took literally all day. Oh and today too. But its done now and I downloaded 15 GiB from one and 17 GiB from the other event off my main camera.
I can finally fire up #darktable and start culling and processing pictures.
Dear fellow photo #geeks, its not just you. It happens to all of us.
Also please be patient, I'll post #photos soon!

Random update that hits both my #photog and #sysadmin roles; I ran out of disk space for my raw #photography recently. I have a home-made #NAS box with a pair of disks in #RAID1 running Rocky Linux and I needed to get more space. I spent an evening shopping around for the best value I could get in local disks and that required driving to three Canada Computers locations to pick up one drive at each so I could build a #RAID5 array and not deal with this again in the near future. [ continues ]

Random update that hits both my #photog and #sysadmin roles; I ran out of disk space for my raw #photography recently. I have a home-made #NAS box with a pair of disks in #RAID1 running Rocky Linux and I needed to get more space. I spent an evening shopping around for the best value I could get in local disks and that required driving to three Canada Computers locations to pick up one drive at each so I could build a #RAID5 array and not deal with this again in the near future. [ continues ]

Всё про age в Linux

Привет, Хабр! Сегодня мы рассмотрим age — современный инструмент файлового шифрования, который за последние пару лет стал твёрдым фаворитом всех, кому надо быстро и надёжно прятать данные.

https://habr.com/ru/companies/otus/articles/933028/

#linux #age #шифрование_данных #MySQL #резервное_копирование #RAID5 #секретные_ключи #X25519

1/2
@_RyekDarkener_ If you want to push #LLM to their limits, here is a prompt about my #BTRFS #RAID5 file server.
All the description is true. I did not expect any useful answer from any LLM. This was inspired by a crazy page that I saw on Reddit
https://www.reddit.com/r/btrfs/comments/1irpwpj/speeding_up_btrfs_metadata_storage_with_an_ssd/
https://usercomp.com/news/1380103/btrfs-metadata-acceleration-with-ssd

1/2
@_RyekDarkener_ If you want to push #LLM to their limits, here is a prompt about my #BTRFS #RAID5 file server.
All the description is true. I did not expect any useful answer from any LLM. This was inspired by a crazy page that I saw on Reddit
https://www.reddit.com/r/btrfs/comments/1irpwpj/speeding_up_btrfs_metadata_storage_with_an_ssd/
https://usercomp.com/news/1380103/btrfs-metadata-acceleration-with-ssd

Woooo hooo I am at 78.5% done with the 36 Tb (48Tb total) #raid5 array! That’s like gonna take “415.4” minutes to finish 😅

Oh boy, setting up this #RAID array is gonna be an overnight ordeal 🤪

Last time I manually set up raid (specifically #raid1) was with two 4 Tb drives. Which I do not recall taking too long; maybe an hour or two. Now I am doing four 12 Tb in #raid5. Good thing I am on summer break 😅

Due to some driver issues that I just don’t want to deal with, I have switched from the well loved #Debian to the more (corporate) supported #Ubuntu for the #DIY media server.

All the needed drivers we easily installed on Ubuntu. Currently I am in the process of setting up #raid5. Once that is done then I will install #Jellyfin

Je suis parti pour ajouter un #NAS #DIY à ma petite infra perso pour accueillir ces backups.

Ce sera sur une base de debian avec un SSD système auquel j'aimerai bien ajouter un #RAID5 pour les données.

Je veux un système simple à mettre ne place et robuste.

De ce que j'ai vu #openmediavault sait très bien faire ça en quelques clics. Donc il me tente pas mal.

Ensuite, je me dis que pour avoir des perfs convenables, les backups pourraient se faire comme ça:

2/X

Установка RAID5 и NFS для Ubuntu Server

В зависимости от инфраструктуры выберите способ подключения диска в систему. Я работаю на VMware Workstation. Создаем три диска по 1ГБ. Из моего опыта лучше создавать их как:

https://habr.com/ru/articles/895256/

#raid5 #nfs #ubuntu #ubuntu_server

What a beautiful sight! :BlobCatChefsKiss:

The drives came in and I am in the process of setting up #raid5

#NAS

The failing drive has been swapped and the NAS is now rebuilding the volume. Asustor firmware seems pretty solid, it would seem. It booted right up and automatically began rebuilding without any interaction from me.

#CosplayAsSysadmin
#RAID5

Also, glad I checked, the Asusor NAS I own does NOT support hot-swapping the drives per this article. That's fine, I don't mind powering it off later to swap the drive.

https://www.asustor.com/en/knowledge/detail/?id=6&group_id=681

#CosplayAsSysadmin
#RAID5

One of the drives in my Asustor 4-bay NAS is reporting S.M.A.R.T. errors. The drives are now two years old.

Seagate Ironwolf has a 3 year warranty so I am having a replacement overnighted for $15 which includes the return packaging and label for the failing drive.

I am very impressed with the Seagate RMA process.

When I was setting up my NAS I intentionally bought a spare drive that I can swap immediately. I will do that tonight and let the volume rebuild overnight.

#CosplayAsSysadmin
#RAID5

One of the drives in my Asustor 4-bay NAS is reporting S.M.A.R.T. errors. The drives are now two years old.

Seagate Ironwolf has a 3 year warranty so I am having a replacement overnighted for $15 which includes the return packaging and label for the failing drive.

I am very impressed with the Seagate RMA process.

When I was setting up my NAS I intentionally bought a spare drive that I can swap immediately. I will do that tonight and let the volume rebuild overnight.

#CosplayAsSysadmin
#RAID5

He wrote a similar article in 2010 about how #RAID 6 would be dead by 2019.

https://www.zdnet.com/article/why-raid-6-stops-working-in-2019/

#storage #raid5 #raid6

He wrote a similar article in 2010 about how #RAID 6 would be dead by 2019.

https://www.zdnet.com/article/why-raid-6-stops-working-in-2019/

#storage #raid5 #raid6

Come configurare in modo efficace i sistemi RAID nei NAS: I sistemi RAID (Redundant Array of Independent Disks) sono una tecnologia consolidata per l’archiviazione dati: come diverse configurazioni di RAID possono pero’...
#sistemiRAID #toshiba #unitàarchiviazione #RAID10 #RAID5 http://dlvr.it/TGLDBY

Файловая система без фокусов: как hard links и XOR сэкономят ваши гигабайты

Для начала нужно понять главное - файлов не существует. А потом на примере простых манипуляций разобрать что такое hard links, чем может быть полезен непонятный XOR и как это всё уживается в системах копирования и снимков

https://habr.com/ru/articles/855480/

#xor #raid #hard_links #windows #python #backup #raid5 #file_system

@dagaz Yo, ich nutze auch #zfs unter #Debian aber auch ein #xfs im #raid5 war mit #mdadm ziemlich leicht zu handeln...

#raid5

speedtest ... has its limits 🙂

i think this is due to the used storage medium

Enclosed is also a picture of my server farm in my large data centre 😉

#raid5
#samba

I decided to switch to SAMBA, as I also have some Windows PCs in the Network.

Server :
sudo apt update
sudo apt install samba
sudo mkdir /mnt/raid5/users/marco
sudo chown marco:marco /mnt/raid5/users/marco
sudo nano /etc/samba/smb.conf
sudo service smbd restart

Client :
sudo apt update
sudo apt install samba
sudo mkdir /mnt/marco/backup
sudo nano /etc/fstab

#raid5
#nfs

I will use NFS instead of SAMBA.

https://www.digitalocean.com/community/tutorials/how-to-set-up-an-nfs-server-using-block-storage

NFS Server:
sudo apt install nfs-kernel-server
nano /etc/exports
sudo systemctl restart nfs-kernel-server
chown nobody:nogroup /mnt/raid5/nfs -R
chmod 007 /mnt/raid5/nfs/Nextcloud/ -R

NFS Client :
sudo apt install nfs-common
sudo mount riscv:/mnt/raid5/nfs/Nextcloud /home/marco/Nextcloud
nano /etc/fstab :
riscv:/mnt/raid5/nfs/Nextcloud /home/marco/Nextcloud nfs auto,nofail,noatime,nolock,intr,tcp,actimeo=1800 0 0

#raid5
#luks

How do I auto-mount a LUKS disk at login WITHOUT unmounting it at logout?

https://askubuntu.com/questions/1407417/how-do-i-auto-mount-a-luks-disk-at-login-without-unmounting-it-at-logout

After creating and mounting the encrypted raid5 partition it is time to auto mount it at boot up.

mkdir /etc/luks-keys
openssl genrsa -out /etc/luks-keys/raid5 2048
chmod 400 /etc/luks-keys -R
cryptsetup luksAddKey /dev/md0 /etc/luks-keys/raid5

Last but not least, update /etc/crypttab and /etc/fstab properly

#raid5
#luks

Setting up raid drive as an encrypted volume is also quite easy.

The following links are in german:

https://wiki.ubuntuusers.de/LUKS/
https://wiki.ubuntuusers.de/LUKS/Partitionen_verschl%C3%BCsseln/

sudo apt-get install cryptsetup
sudo cryptsetup luksFormat -c aes-xts-plain64 -s 512 -h sha512 -y /dev/md0
sudo cryptsetup luksOpen /dev/md0 raid5
sudo mkfs.ext4 /dev/mapper/raid5
mkdir /mnt/raid5
sudo mount /dev/mapper/raid5 /mnt/raid5

todo : mount luks drive @ boot

#raid5

I have found the solution to my raid device renaming issue.

mdadm detects the array as a "foreign" array, rather than a "local" one. Foreign arrays will be assigned device nodes starting from md127 (and working down). Local arrays are assigned device nodes starting from md0 (and working up).

The solution on how to fix it is mentioned in the linke below.

https://unix.stackexchange.com/questions/544841/my-raid-1-always-renames-itself-to-dev-md127-after-rebooting-debian-10

#raid5 is up and running. Somehow ubuntu recognizes the RAID drive as /dev/md127 after reboot. I will have to find a way to bind it to /dev/md0.

The total capacity is as expected 1.5TB.

Next steps :
- bind to /dev/md0
- LUKS/ext4 encryption

#raid5

Setting up RAID5 is straight forward.

https://www.tecmint.com/create-raid-5-in-linux/

I can imagine that RAID10 is more difficult due to the nested RAID levels.

Now it's time to wait ... btw ... remind me to setup NTP.

#raid5
#raid10

I am setting up a SAMBA NAS with RAID ... using USB Flash drives. "Why? WTF?" you might ask ... because I can ;-)

A so-called crazy idea that wants to be realized.

So I bought the cheapest USB flash drives I could get from an electronics retailer nearby. Around 45€ per stick and this 4 times.

I have Raspberry Pi 4 and VisonFive2 to choose from.

As RPI4 has 2xUSB 2.0 and 2xUSB 3.0 I will go for VF2 4xUSB3.0.

@cslinuxboy My #MediaServer Files are on #XFS #Raid5. Fast and stable!

Catastrophic Raid5 loss at home. I had an array of 10 drives, 9 data + 1 parity lose 2 drives. It's a Synology SS1019+ with an external enclosure.

About 90TB in total, 90% full. Synology refuses to mount it. Drive errors galore in dmesg. I'm at a loss of what to do next.

I have a spare drive (all 12TB) just as a FYI, and am considering moving them all to a case I have with enough bays and to linux them into submission and try to recover something. But my MDADM foo is weak and the best I have is google right now.

I expect I'll spend most of today trying to recover a little before admitting defeat, RMA drives, and starting clean.

I'll admit I made many mistakes to get here. Only one drive parity, dumb. Not backing up when it told me, dumb. Not making sure everything I care about was in at least 2 places, dumb. And I had the gall to call myself "data paranoid"

#linux #raid5 #synology #datarecovery

Anyone have experience deploying #btrfs in #raid5 / #raid6 configurations? I'm aware of the mdadm raid5/6+lv+btrfs approach Synology uses, and I've got a UPS and read-heavy workload so I don't really care about the native raid5/6 write hole but from everything I'm reading the "off the shelf" industry solution appears to be #zfs in raidz/raid2z

#homelab

Ce qui se passe quand on rajoute un 4e disque à un filesystem #BTRFS en #RAID5.
Avant/après (noir=libre, blanc=utilisé, bleu=métadonnées).
Là il est encore en cours de “balance”, reste 16% à faire...

Rebuild läuft. 🔄 #qnap #QNAP_NAS #raid5 #backupTaken #backup