#parquet — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #parquet, aggregated by home.social.
-
FERC to start distributing their largest dataset in the least convenient possible format. The EQR is already ~100GB in uncompressed CSVs. In XBRL that would be maybe a TB? With the XML of each filing having to be parsed individually are we going to have to spin up a whole cluster just to get it converted to Parquet in less than a day?
https://www.jdsupra.com/legalnews/ferc-proposes-overhauling-electronic-4199806/