#caterva2 — Public Fediverse posts

🚀 Our #PyDataGlobal 2025 tutorial recording on modern #Blosc2 & #Caterva2 features is out!
We show how compression is more than just a space saver, boosting performance for large in-memory & out-of-memory arrays via auto-chunking & parallelism.

We also cover: 🌐 Serving Blosc2/#HDF5 data online with Caterva2 ☁️ Computing directly in the cloud (no downloads needed!)

Watch here: 👉 https://www.youtube.com/watch?v=tUvSI3EpTBQ&list=PLGVZCDnMOq0qmerwB1eITnr5AfYRGm0DF&index=80

#Python #DataScience #BigData #HPC #DataHandling

🚀 Excited to share more about Caterva2, your ultimate gateway to Blosc2/HDF5 repositories! 🚀

Caterva2 is designed to redefine how you interact with large datasets.

Want to see it in action? 🤔 We've just released a new introductory video showcasing Caterva2's main functionalities! 🎬

👉 https://ironarray.io/caterva2

#Caterva2 #Blosc2 #HDF5 #BigData #DataManagement #FreeSoftware #Python #DataScience #Tech

There's also lossy compression using #JPEG2000, alreadz used in medical applications with compression factors ~ 10×

#Caterva2 offers a web interface and REST API to access remote data.

Big news! #Caterva2 enters advanced beta stage 🎉 🎉

Caterva2 is a FOSS distributed system written in Python meant for sharing Blosc2 datasets (either native or converted on-the-fly from HDF5) among different hosts.

It follows the pub-sub paradigm, so it can publish data once and allow multiple subscribers to access it, saving time and resources. It comes with a Python API and a Web interface for easy browsing.

Learn more in https://ironarray.io/caterva2

Make Compression Better 😀
#blosc2 #ironarray