#ahalodeck — Public Fediverse posts on home.social

A 50 minute show-and-tell, about #AHAlodeck, and how #xattrs on #ZFS can be used as #DataCentric catalog/environment.

Enjoy!

Perfect for #longterm preservation #dltp - and any other digital data collections.

#ahalodeck #xattrs #zfs #datacentric #longterm #dltp

- Testdataset: 386.5 GB
- 120.000 filesystem objects (files and folders)
- 7616839 key/value informations gathered/extracted as #xattrs.

Result: A 55 MB .tar.bz2 #holotar.

Fully search-and-filter-able by any of the 7 Mio xattrs.

Extraction step required only once (6h)
Afterwards:
Indexing done in 60 SECONDS! 🤩 🥇

#ahalodeck #xattrs #holotar

Download #wikidata dump for testing #ahalodeck and #xattrs on #zfs long-term storage... 😎

Found this while doing so:

It's a statistical breakdown of the #English #language. #Interesting.

#wikidata #ahalodeck #xattrs #zfs #english #language

#AHAlodeck: My best friend wrote a mini-basic fulltext indexer for #xattrs in the shell.

Took ~1.5 seconds (!) to index ~14.000 files with "de-embedded" music tags.

🥳 🎉
I love xattrs.
Imagine doing this with embedded metadata tags? 😉

#ahalodeck #xattrs

Very helpful insights on "how much actual bytes" can be stored in #xattrs on `btrfs`:

Current limit = about the nodesize (it was formatted with).

nodesize - sizeof(struct btrfs_header) - sizeof(struct btrfs_item) - sizeof(btrfs_dir_item)

Current default = 16K - 101 - 25 - 30 , which is 16228 bytes

Maximum (for now) is ~64kB, if formatted like this:

`$ mkfs.btrfs -n 64K /dev/sdX`

#xattrs #ahalodeck #metadata #digipres

Oh, I'm loving this!

> "The Data-Centric revolution puts data at the center of the enterprise. Applications are optional visitors to the data."

#ahalodeck #rdf #graphql #xattrs

Me engaging on #Smbd ("Samba") mailing lists about support for "larger" (eg 64kB) key/value attributes on filesystem level (#xattrs):

Good news! 🥳

> "in 2021 we added smbd max xattr size with a default of 64KB."

#smbd #xattrs #ahalodeck #dltp