#zarr — Public Fediverse posts

Do you work with Zarr data? The `pizzarr` package has just been published on CRAN! This is an R implementation for creating, reading, and writing chunked Zarr arrays, developed by David Blodgett and Mark Keller. It supports both Zarr V2 & V3 and efficient slicing of large N-dimensional arrays, making it perfect for handling massive datasets.

GitHub repository: https://github.com/zarr-developers/pizzarr

#rstats #rspatial #gischat #zarr

📢Blosc2 3.10.2 Released! 📢

Building on the functions introduced in version 3.9, we have extended lazy evaluation to general expressions with ALL blosc2 functions in version 3.10.

Blosc2's compute engine ingests many array formats, as well as blosc2 arrays, with impressive results - see the graphic below!
Details on the comparisons in our blog: https://www.blosc.org/posts/tensordot-pure-persistent/

Blosc2's compute engine also powers Cat2Cloud (visit the demo site here https://cat2.cloud/demo/)!

#Zarr
#HDF5
#Python

A summary of the second and third days of the #BugsDoneQuick marathon I did last month (:

https://bojidar-bg.dev/blog/2025-08-26-bugs-done-part-2/

The trouble with sitting on a draft instead of finishing it up early is that it ends up with 3.1K words instead of 2.5K. Oh well.. at least, I hope I got a few interesting details around #Zarr for whoever ends up reading it (:

#100DaysToOffload

If Tuesday feels a bit dark, come join me on my coding stream in ~25 minutes! I have a lightbox, and I'm not afraid to use it! 😂🛋️

Today, I'll be breaking the mold of contributing only to #opensource applications for #BugsDoneQuick—by contributing to an open-source library! 😁 In particular, I'm going to be checking out the #Zarr (@zarr) ecosystem! 😊

Recording: https://watch.bojidar-bg.dev/w/mzskYURdt5EiavS9L8c1D3

https://bojidar-bg.dev/bdq/

#livestreaming #python

From Josh Moore, German Bioimaging research software engineer and OME and Zarr developer and maintainer:

🚀 We’re hiring again! Join German BioImaging as a Software Developer!

💻 Build scalable #bioimaging solutions

🌍 Collaborate globally

🎯 Contribute to open science through #OME #Zarr

📣 Tell your #NGFF friends.

Remote, full-time. Apply by 30 June 2025. All submissions via:
https://gerbi-gmb.de/machform/view.php?id=86038

🚀 We’re hiring again! Join @GerBI as a Software Developer!

💻 Build scalable #bioimaging solutions

🌍 Collaborate globally

🎯 Contribute to open science through #OME #Zarr

📣 Tell your #NGFF friends.

Remote, full-time. Apply by 30 June 2025: All submissions via http://bit.ly/gerbi-jobs-202505

#getfedihired

https://gerbi-gmb.de/resources/career/

𝗖𝗙 𝗠𝗲𝘁𝗮𝗱𝗮𝘁𝗮 𝗖𝗼𝗻𝘃𝗲𝗻𝘁𝗶𝗼𝗻𝘀 support #OpenScience by automating processes via metadata in #NetCDF and #Zarr files. They establish a unified language for the #weather, #climate, #ocean, and #EO community. https://buff.ly/rGPuoku
#remotesensing #EarthObs

Anyone here using #nasa #nasapower data from #aws open data registry?

We were getting data from the following URL https://power-analysis-ready-datastore.s3.amazonaws.com/power_901_daily_radiation_lst.zarr

This datastore used to be updated frequently. However, since 2024-12-31 it does not contain new data. The #zarr file appears to be stuck on 2024-12-31. Has this datastore been abandoned?

Hi Zarrites! 👋🏻

We have our bi-weekly community meeting today @ 11:00 PT. 🗓️

Today, Joe Hamman will open the community meeting by talking about how they're using #Zarr at EarthmoverHQ to make cool stuff! 🎙️

Zoom: https://zoom.us/j/300670033?pwd=OFhjV0FHQmhHK2FYbGFRVnBPMVNJdz09

More info: https://zarr.dev/community-calls/

OK here we go! "Using Zarr and FLAC for storing large audio data files in cloud-optimised format" -- my Friday blog with example code, finding the FLAC compressor very handy: http://mcld.co.uk/blog/2024/using-zarr-for-storing-large-audio-data-files-in-cloud-optimised-format.html #Zarr #FLAC #audio #data @zarr

Here's a very cool thing for audio data in #Zarr: someone has implemented the FLAC codec! https://github.com/AllenNeuralDynamics/flac-numcodecs (I haven't tested it) #flac #codec #audio

The #Zarr data format doesn't have a #Wikipedia page! Until now: https://en.wikipedia.org/wiki/Zarr_(data_format) Could you help expand it? What should be said about it? #datascience

I think about "big cloud data" in bioacoustics: very large audio data, or very large deep embeddings -- which (for audio) are essentially a kind of vector time-series. Inspired by the similar issues raised in @jack_kelly recent blog, and this interesting comparison https://waterdata.usgs.gov/blog/cloud_data/ I'm wondering if #Zarr or #Parquet could be good for our audio/time-series... #audio #deeplearning #dataengineering

Cloud native data and dynamic tiling with @zarr at #RSEcon24 in Newcastle #zarr

If, like me, you are confused about all the terminology around geospatial cloud computing and how it all fits together, I recommend this video. Great explanation! #STAC, #COG, #Zarr, #Dask, #AWS, #EarthEngine
https://www.youtube.com/watch?v=YPno-89l54Q

Want to learn the fundamentals of Zarr and OME-Zarr NGFF? Take these new interactive tutorials, operating on whole-brain lightsheet volumes from the Allen Insitute for Neural Dynamics

https://github.com/InsightSoftwareConsortium/GetYourBrainTogether/blob/main/HCK02_2023_Allen_Institute_Hybrid/Tutorials/WorkingWithOMEZarrNGFF/README.md

#zarr #ngff @dyfbrian
@zarr_dev
@openmicroscopy

Honored to be 1 of 40 recipients of a 2-yr #cziscience #EOSS5 grant to continue work on #OMENGFF 🎉

#OME #Zarr @GerBI and #NFDI4BIOIMAGE are dedicated to the development of scalable data repositories for #bioimaging

https://chanzuckerberg.com/eoss/proposals/ngff-democratize-access-to-next-generation-bioimaging-data/