Parquet files hide their row group structure. This 288-line script reads it, flags tiny groups killing query speed, and recompresses. Intermediate.
https://www.valtersit.com/python/parquet-file-inspector-and-optimizer/
#python #data #pyarrow
#pyarrow — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #pyarrow, aggregated by home.social.