#pyarrow — Public Fediverse posts

Munquet 0.2.1 just landed on Flathub 🚀

Fixed a small race condition when canceling a conversion — turns out the process could finish right before you clicked “Yes” 😅

Two lines later… all good.

https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

#Flatpak #GTK4 #OpenSource #Parquet #DataScience #Linux #Python #PyArrow

Munquet 0.2.1 just landed on Flathub 🚀

Fixed a small race condition when canceling a conversion — turns out the process could finish right before you clicked “Yes” 😅

Two lines later… all good.

https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

#Flatpak #GTK4 #OpenSource #Parquet #DataScience #Linux #Python #PyArrow

Munquet 0.2.1 just landed on Flathub 🚀

Fixed a small race condition when canceling a conversion — turns out the process could finish right before you clicked “Yes” 😅

Two lines later… all good.

https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

#Flatpak #GTK4 #OpenSource #Parquet #DataScience #Linux #Python #PyArrow

Munquet 0.2.1 just landed on Flathub 🚀

Fixed a small race condition when canceling a conversion — turns out the process could finish right before you clicked “Yes” 😅

Two lines later… all good.

https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

#Flatpak #GTK4 #OpenSource #Parquet #DataScience #Linux #Python #PyArrow

Munquet is now officially on Flathub 🎉

A native Linux app to convert datasets into Apache Parquet using PyArrow backend. Perfect for data science workflows, analytics, and anyone needing fast local conversions.

Get it here: https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

@gnome @xfce @kde @GTK @linux @flathub

#apache #pyarrow #datascience #parquet #csv #OpenSource #Python #GNOME #GTK4 #Adwaita

Munquet is now officially on Flathub 🎉

A native Linux app to convert datasets into Apache Parquet using PyArrow backend. Perfect for data science workflows, analytics, and anyone needing fast local conversions.

Get it here: https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

@gnome @xfce @kde @GTK @linux @flathub

#apache #pyarrow #datascience #parquet #csv #OpenSource #Python #GNOME #GTK4 #Adwaita

Munquet is now officially on Flathub 🎉

A native Linux app to convert datasets into Apache Parquet using PyArrow backend. Perfect for data science workflows, analytics, and anyone needing fast local conversions.

Get it here: https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

@gnome @xfce @kde @GTK @linux @flathub

#apache #pyarrow #datascience #parquet #csv #OpenSource #Python #GNOME #GTK4 #Adwaita

Munquet is now officially on Flathub 🎉

A native Linux app to convert datasets into Apache Parquet using PyArrow backend. Perfect for data science workflows, analytics, and anyone needing fast local conversions.

Get it here: https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

@gnome @xfce @kde @GTK @linux @flathub

#apache #pyarrow #datascience #parquet #csv #OpenSource #Python #GNOME #GTK4 #Adwaita

🚀 Munquet — Convert, merge, rename & validate tabular data into Parquet, fully offline & batch-ready.

GitLab: https://gitlab.com/zulfian1732/munquet

Featured in: @severo 's Awesome Parquet: https://github.com/severo/awesome-parquet 🙏

#Parquet #OpenSource #Python #GNOME #GTK4 #Adwaita #PyArrow

🚀 Sneak peek Munquet!
Convert, merge, rename, and validate tabular data safely into Parquet. Works offline, with batch processing and progress feedback.

GitLab repo:

https://gitlab.com/zulfian1732/munquet

Flathub release coming soon!

#Python #GTK4 #GNOME #PyArrow #Parquet #DataScience #Libadwaita

Released scrapy-contrib-bigexporter 1.0.0 (https://codeberg.org/ZuInnoTe/scrapy-contrib-bigexporters) - additional export formats for the webscraping framework Scrapy.

Migrated parquet export from fastparquet to pyarrow as fastparquet is deprecated (https://docs.dask.org/en/stable/changelog.html#fastparquet-engine-deprecated)

Migrated orc export from pyorc to pyarrow to reduce the number of dependencies

#scrapy #crawling #python #parquet #orc #pyarrow #webcrawling #scraping

Easily obtain OSM and OMF data: #Python and CLI tools #QuackOSM and #OvertureMaestro offer easier access to data from #OpenStreetMap (#OSM) and the Overture Maps Foundation (#OMF) through #PyArrow, #GeoParquet, or #DuckDB. These tools can simplify large-scale geospatial data...
https://spatialists.ch/posts/2025/05/23-easily-obtain-osm-and-omf-data/ #GIS #GISchat #geospatial #SwissGIS

Easily obtain OSM and OMF data: #Python and CLI tools #QuackOSM and #OvertureMaestro offer easier access to data from #OpenStreetMap (#OSM) and the Overture Maps Foundation (#OMF) through #PyArrow, #GeoParquet, or #DuckDB. These tools can simplify large-scale geospatial data...
https://spatialists.ch/posts/2025/05-23-easily-obtain-osm-and-omf-data/ #GIS #GISchat #geospatial #SwissGIS

If the purpose of a library is to "process and transport large data sets" but the code base contains an error message like "array cannot contain more than 2147483646 bytes" then there must be a big misunderstanding somewhere. #pyarrow

#TalkPythonToMe 503: The #PyArrow Revolution

Episode webpage: https://talkpython.fm/episodes/show/503/the-pyarrow-revolution

Media file: https://talkpython.fm/episodes/download/503/the-pyarrow-revolution.mp3

#PyConUS #Python #pandas #FLOSS

Ironia losu: kiedy właśnie dodałeś blokera na #PyArrow w ebuildzie #Gentoo dla #pandas, bo powoduje, że #CPython się wykrzacza, a potem czytasz, że zależność od PyArrow będzie obowiązkowa w przyszłości. Wzdych.

https://github.com/pandas-dev/pandas/issues/54466

Irony: when you've just added a blocker on #PyArrow in the #Gentoo ebuild for #pandas because it causes #CPython to crash, and then read that pandas are planning on making PyArrow obligatory. Sigh.

https://github.com/pandas-dev/pandas/issues/54466

Good news - Python's CSV reader supports unicode characters like 🤘 as CSV field delimiters.

Bad news is that #PyArrow doesn't support it yet :(

Make PyArrow great again!

#Python #developer #unicode #CSV #bigdata

Hey #dataNerds 🤓, good news:

#DuckDB v0.6.0 brings reading #CSV data on par with #PyArrow & #Polars and loads 1.66 GB of #ChicagoCrimes data in 1.9s with 12 cores/24 threads when experimental parallel CSV reader & unordered insertion are enabled.

🧐 https://github.com/RandomFractals/chicago-crimes#with-duckdb

#dataTools 🔬 ...

Hey #dataNerds 🤓, good news:

#DuckDB v0.6.0 brings reading #CSV data on par with #PyArrow & #Polars and loads 1.66 GB of #ChicagoCrimes data in 1.9s with 12 cores/24 threads when experimental parallel CSV reader & unordered insertion are enabled.

🧐 https://github.com/RandomFractals/chicago-crimes#with-duckdb

#dataTools 🔬 ...