#zarr — Public Fediverse posts

An introduction to Zarr, the data format that simplifies working with large matrices in the cloud, explained through NASA's ocean temperature record since 2002 #zarr

https://open.fused.io/mjyttte444gnh4sye2bzjgd5f4?step=0

Performance engineering for geospatial data. Zarrista brings 1.9–2.7× faster Zarr reads to Python via a Rust backend, being integrated directly into Zarr-Python so existing code gets faster automatically. Sweet win for anyone wrangling big raster datasets.

#geospatial #Zarr #Python
https://developmentseed.org/zarrista/latest/blog/2026/08/13/zarrista-faster-zarr-for-python/

Today’s release of #OMIO (v0.2.6) is again a small update, but it brings memory-efficient OME-TIFF writing for Zarr-backed workflows. When imwrite receives a disk-cached #Zarr array, OMIO now streams it plane by plane instead of materializing the full store in RAM.

🌍 https://omio.readthedocs.io/en/latest/changelog.html#omio-v0-2-6

#BioimageAnalysis #Neuroscience #Python

Today's release of #OMIO (v0.2.5) is just a small update, but brings a useful option: configurable disk-cache locations for imread(). Ideal when large #microscopy files live e.g. on a server, while you want OMIO's disk-backed #Zarr cache stored locally for smoother and faster processing and reuse ✌️

🌍 https://omio.readthedocs.io/en/latest/changelog.html#omio-v0-2-5

#BioimageAnalysis #Neuroscience #Python

I just pushed #OMIO to version v0.2.2. You can now reuse existing disk-backed #Zarr caches instead of rebuilding them every time an image is opened. OMIO stores cache metadata directly in the Zarr store and validates compatibility automatically before reuse ✌️

🌍 https://omio.readthedocs.io/en/latest/usage_large_files.html#reuse-an-existing-on-disk-omio-cache
👨‍💻 https://github.com/FabrizioMusacchio/omio

#Microscopy #BioimageAnalysis #Python #OpenScience

For large microscopy datasets (e.g. >1 GB): #OMIO can materialize images directly as disk-backed #Zarr stores. This allows #MemoryMapped, slice-wise access w/o loading the entire dataset into RAM. And: It fully integrates with #Napari workflows ✌️

🧵4/8

Do you work with Zarr data? The `pizzarr` package has just been published on CRAN! This is an R implementation for creating, reading, and writing chunked Zarr arrays, developed by David Blodgett and Mark Keller. It supports both Zarr V2 & V3 and efficient slicing of large N-dimensional arrays, making it perfect for handling massive datasets.

GitHub repository: https://github.com/zarr-developers/pizzarr

#rstats #rspatial #gischat #zarr

📢Blosc2 3.10.2 Released! 📢

Building on the functions introduced in version 3.9, we have extended lazy evaluation to general expressions with ALL blosc2 functions in version 3.10.

Blosc2's compute engine ingests many array formats, as well as blosc2 arrays, with impressive results - see the graphic below!
Details on the comparisons in our blog: https://www.blosc.org/posts/tensordot-pure-persistent/

Blosc2's compute engine also powers Cat2Cloud (visit the demo site here https://cat2.cloud/demo/)!

#Zarr
#HDF5
#Python

A summary of the second and third days of the #BugsDoneQuick marathon I did last month (:

https://bojidar-bg.dev/blog/2025-08-26-bugs-done-part-2/

The trouble with sitting on a draft instead of finishing it up early is that it ends up with 3.1K words instead of 2.5K. Oh well.. at least, I hope I got a few interesting details around #Zarr for whoever ends up reading it (:

#100DaysToOffload

If Tuesday feels a bit dark, come join me on my coding stream in ~25 minutes! I have a lightbox, and I'm not afraid to use it! 😂🛋️

Today, I'll be breaking the mold of contributing only to #opensource applications for #BugsDoneQuick—by contributing to an open-source library! 😁 In particular, I'm going to be checking out the #Zarr (@zarr) ecosystem! 😊

Recording: https://watch.bojidar-bg.dev/w/mzskYURdt5EiavS9L8c1D3

https://bojidar-bg.dev/bdq/

#livestreaming #python

From Josh Moore, German Bioimaging research software engineer and OME and Zarr developer and maintainer:

🚀 We’re hiring again! Join German BioImaging as a Software Developer!

💻 Build scalable #bioimaging solutions

🌍 Collaborate globally

🎯 Contribute to open science through #OME #Zarr

📣 Tell your #NGFF friends.

Remote, full-time. Apply by 30 June 2025. All submissions via:
https://gerbi-gmb.de/machform/view.php?id=86038

🚀 We’re hiring again! Join @GerBI as a Software Developer!

💻 Build scalable #bioimaging solutions

🌍 Collaborate globally

🎯 Contribute to open science through #OME #Zarr

📣 Tell your #NGFF friends.

Remote, full-time. Apply by 30 June 2025: All submissions via http://bit.ly/gerbi-jobs-202505

#getfedihired

https://gerbi-gmb.de/resources/career/

𝗖𝗙 𝗠𝗲𝘁𝗮𝗱𝗮𝘁𝗮 𝗖𝗼𝗻𝘃𝗲𝗻𝘁𝗶𝗼𝗻𝘀 support #OpenScience by automating processes via metadata in #NetCDF and #Zarr files. They establish a unified language for the #weather, #climate, #ocean, and #EO community. https://buff.ly/rGPuoku
#remotesensing #EarthObs

Anyone here using #nasa #nasapower data from #aws open data registry?

We were getting data from the following URL https://power-analysis-ready-datastore.s3.amazonaws.com/power_901_daily_radiation_lst.zarr

This datastore used to be updated frequently. However, since 2024-12-31 it does not contain new data. The #zarr file appears to be stuck on 2024-12-31. Has this datastore been abandoned?

Hi Zarrites! 👋🏻

We have our bi-weekly community meeting today @ 11:00 PT. 🗓️

Today, Joe Hamman will open the community meeting by talking about how they're using #Zarr at EarthmoverHQ to make cool stuff! 🎙️

Zoom: https://zoom.us/j/300670033?pwd=OFhjV0FHQmhHK2FYbGFRVnBPMVNJdz09

More info: https://zarr.dev/community-calls/