home.social

#ahalodeck — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #ahalodeck, aggregated by home.social.

  1. cloud.arkthis.com/index.php/s/

    A 50 minute show-and-tell, about #AHAlodeck, and how #xattrs on #ZFS can be used as #DataCentric catalog/environment.

    Enjoy!

    Perfect for #longterm preservation #dltp - and any other digital data collections.

  2. #AHAlodeck R&D news:

    - Testdataset: 386.5 GB
    - 120.000 filesystem objects (files and folders)
    - 7616839 key/value informations gathered/extracted as #xattrs.

    Result: A 55 MB .tar.bz2 #holotar.

    Fully search-and-filter-able by any of the 7 Mio xattrs.

    Extraction step required only once (6h)
    Afterwards:
    Indexing done in 60 SECONDS! 🤩 🥇

  3. Download #wikidata dump for testing #ahalodeck and #xattrs on #zfs long-term storage... 😎

    Found this while doing so:

    wikidata.org/wiki/Wikidata:Lis

    It's a statistical breakdown of the #English #language. #Interesting.

  4. #AHAlodeck: My best friend wrote a mini-basic fulltext indexer for #xattrs in the shell.

    Took ~1.5 seconds (!) to index ~14.000 files with "de-embedded" music tags.

    🥳 🎉
    I love xattrs.
    Imagine doing this with embedded metadata tags? 😉

  5. Very helpful insights on "how much actual bytes" can be stored in #xattrs on `btrfs`:

    github.com/kdave/btrfs-progs/i

    Current limit = about the nodesize (it was formatted with).

    nodesize - sizeof(struct btrfs_header) - sizeof(struct btrfs_item) - sizeof(btrfs_dir_item)

    Current default = 16K - 101 - 25 - 30 , which is 16228 bytes

    Maximum (for now) is ~64kB, if formatted like this:

    `$ mkfs.btrfs -n 64K /dev/sdX`

    #ahalodeck #metadata #digipres

  6. Oh, I'm loving this!

    > "The Data-Centric revolution puts data at the center of the enterprise. Applications are optional visitors to the data."

    datacentricmanifesto.org/

    #AHAlodeck #RDF #GraphQL #xattrs

  7. Me engaging on #Smbd ("Samba") mailing lists about support for "larger" (eg 64kB) key/value attributes on filesystem level (#xattrs):

    lists.samba.org/archive/samba-

    Good news! 🥳

    > "in 2021 we added smbd max xattr size with a default of 64KB."

    #AHAlodeck #DLTP