#parquet — Public Fediverse posts

Data Catalog 第2回：Object Storage上のOracle Databaseマニュアルと文書インベントリParquetをカタログ化してみてみた
https://qiita.com/shirok/items/bb431a6bd37fb1ef0cd6?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #oracle #AI #Parquet #datacatalog #Lakehouse

Data CatalogでObject Storage内のCSVとParquetを自動カタログ化してみてみた
https://qiita.com/shirok/items/d23855d5634f528f796c?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #ObjectStorage #oraclecloud #metadata #Parquet #DataCatalog

I've made a new release for the PHP DuckDB PDO driver:

- Update to DuckDB 1.5.5
- Support for PHP 8.6
- Support for TrueAsync and Quack protocol
- More examples in the readme:
- ascii chart rendering with SQL
- LLM integration
- fetch public data
- direct data copy from MySQL/MariaDB

Binary releases are available on GitHub and can be installed or updated with PIE:

pie install thomas-0816/pdo-duckdb-php

https://github.com/thomas-0816/pdo-duckdb-php

#php #duckdb #pdo #analytics #bigdata #parquet

Spent the past couple of nights working up a #Golang utility to read the central XML file (exports.xml) from an #AppleHealth export and convert the <Record/> elements to #Parquet.

Finally got that working tonight and was able to load the Parquet file into #DuckDB to begin doing some querying.

Spent the past couple of nights working up a #Golang utility to read the central XML file (exports.xml) from an #AppleHealth export and convert the <Record/> elements to #Parquet.

Finally got that working tonight and was able to load the Parquet file into #DuckDB to begin doing some querying.

Paging Through a Parquet File in DuckDB: File_row_number or Offset?

https://rusty.today/blog/paging-parquet-duckdb-file-row-number-vs-offset/

Comments: https://news.ycombinator.com/item?id=49111006

#HackerNews #DuckDB #Parquet #Paging #FileRowNumber #Offset #DataProcessing

Paging Through a Parquet File in DuckDB: File_row_number or Offset?

https://rusty.today/blog/paging-parquet-duckdb-file-row-number-vs-offset/

Comments: https://news.ycombinator.com/item?id=49111006

#HackerNews #DuckDB #Parquet #Paging #FileRowNumber #Offset #DataProcessing

The "Awesome Parquet" list keeps growing.

https://github.com/severo/awesome-parquet

The newest projects:

1. GeoParquet Viewer 🗺️: A table and map viewer for GeoParquet files in the browser, by @mmohr.

https://geoparquet.info/

2. Hardwood ☕: A minimal dependency Java implementation of Apache Parquet, by @gunnarmorling.

https://hardwood.dev/

3. LakeQL 🚣: Pure JavaScript duck-compatible SQL query engine for Parquet and Iceberg data in object storage.

https://github.com/earonesty/lakeql

🧵

#Parquet

The "Awesome Parquet" list keeps growing.

https://github.com/severo/awesome-parquet

The newest projects:

1. GeoParquet Viewer 🗺️: A table and map viewer for GeoParquet files in the browser, by @mmohr.

https://geoparquet.info/

2. Hardwood ☕: A minimal dependency Java implementation of Apache Parquet, by @gunnarmorling.

https://hardwood.dev/

3. LakeQL 🚣: Pure JavaScript duck-compatible SQL query engine for Parquet and Iceberg data in object storage.

https://github.com/earonesty/lakeql

🧵

#Parquet

Do you use Adminer? It's the best PHP database management, since PHPMyAdmin has enshittified.

But there has not been DuckDB / Parquet support, so here you go:
https://ambience.sk/adminer-support-for-duckdb-and-parquet-database-files/

Both work in read-only mode and require external dependencies, but they work with Adminer!

#adminer #php #db #database #duckdb #parquet #management #dbm

Do you use Adminer? It's the best PHP database management, since PHPMyAdmin has enshittified.

But there has not been DuckDB / Parquet support, so here you go:
https://ambience.sk/adminer-support-for-duckdb-and-parquet-database-files/

Both work in read-only mode and require external dependencies, but they work with Adminer!

#adminer #php #db #database #duckdb #parquet #management #dbm

#til about #GeoParquet files naming:

It is RECOMMENDED to use .parquet as the file extension for a GeoParquet file. This provides the best interoperability with existing Parquet tools. The file extension .geoparquet SHOULD NOT be used

#parquet #gis #geo #gischat

https://geoparquet.org/releases/v1.1.0/

#til about #GeoParquet files naming:

It is RECOMMENDED to use .parquet as the file extension for a GeoParquet file. This provides the best interoperability with existing Parquet tools. The file extension .geoparquet SHOULD NOT be used

#parquet #gis #geo #gischat

https://geoparquet.org/releases/v1.1.0/

Jérôme #Barella mis en examen pour le #viol et le #meurtre de #Lyhanna, annonce le #parquet d' #Agen

https://www.franceinfo.fr/faits-divers/disparition-de-lyhanna-dans-le-gers/affaire-lyhanna-jerome-barella-entendu-par-le-juge-d-instruction-en-vue-de-sa-mise-en-examen-pour-le-viol-et-le-meurtre-de-la-fillette_8107760.html#xtor=CS2-765-[autres]-

Jérôme #Barella mis en examen pour le #viol et le #meurtre de #Lyhanna, annonce le #parquet d' #Agen

https://www.franceinfo.fr/faits-divers/disparition-de-lyhanna-dans-le-gers/affaire-lyhanna-jerome-barella-entendu-par-le-juge-d-instruction-en-vue-de-sa-mise-en-examen-pour-le-viol-et-le-meurtre-de-la-fillette_8107760.html#xtor=CS2-765-[autres]-

S3上の大量ログを Oracle Autonomous AI Lakehouseで分析する：外部表、Parquet、SQL、Vector Search、RAGの使い分け
https://qiita.com/shirok/items/2eafd347f90e80c46005?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items

#qiita #AWS #S3 #oracle #AI #Parquet

Postgres data stored in Parquet on S3: LTAP architecture explained

https://www.databricks.com/blog/lakebase-ltap-rethinking-database-storage

#HackerNews #Postgres #Parquet #S3 #LTAP #architecture #dataengineering

Postgres data stored in Parquet on S3: LTAP architecture explained

https://www.databricks.com/blog/lakebase-ltap-rethinking-database-storage

#HackerNews #Postgres #Parquet #S3 #LTAP #architecture #dataengineering

#LabPlot (upcoming release) just got even more powerful.

The latest merge request introduces native support for importing data from the following file formats:

👉 #Apache #Parquet
👉 #Apache #ORC
👉 #Arrow #IPC (#Feather)

—three of the most efficient and widely used columnar storage formats in data science.

#DataScience #OpenSource #FOSS #FLOSS #KDE #DataViz #BigData #Data #DataAnalysis #Python #R #OpenData #HackerNews #TechNews #OpenData #Science #Research #Analytics #Tech #IT

#LabPlot (upcoming release) just got even more powerful.

The latest merge request introduces native support for importing data from the following file formats:

👉 #Apache #Parquet
👉 #Apache #ORC
👉 #Arrow #IPC (#Feather)

—three of the most efficient and widely used columnar storage formats in data science.

#DataScience #OpenSource #FOSS #FLOSS #KDE #DataViz #BigData #Data #DataAnalysis #Python #R #OpenData #HackerNews #TechNews #OpenData #Science #Research #Analytics #Tech #IT

Parquet file format. Talk by Boudewijn Braams on Spark+AI Summit Europe 2019

#parquet #dataprocessing

https://youtu.be/1j8SdS7s_NY?si=rfH4cNH1pL415ltR

BFM: Dominique de #Villepin visé par une enquête du #parquet #financier concernant des #statuettes #reçues en #cadeau lorsqu'il était au #Quai d' #Orsay

Le #mec, il reçoit un cadeau de 125000€ en nature et il ne se dit pas qu'il va y avoir un #problème #éthique et #moral, voire #juridique...

https://www.bfmtv.com/police-justice/dominique-de-villepin-vise-par-une-enquete-du-parquet-financier-concernant-des-statuettes-recues-en-cadeau-lorsqu-il-etait-au-quai-d-orsay_AD-202605200554.html

BFM: Dominique de #Villepin visé par une enquête du #parquet #financier concernant des #statuettes #reçues en #cadeau lorsqu'il était au #Quai d' #Orsay

Le #mec, il reçoit un cadeau de 125000€ en nature et il ne se dit pas qu'il va y avoir un #problème #éthique et #moral, voire #juridique...

https://www.bfmtv.com/police-justice/dominique-de-villepin-vise-par-une-enquete-du-parquet-financier-concernant-des-statuettes-recues-en-cadeau-lorsqu-il-etait-au-quai-d-orsay_AD-202605200554.html

When does #Iceberg beat #Parquet+projection on #AWSGlue, and when doesn't ?

An end-to-end #ETL PoC on #AWS to find out: producer, #Kinesis, two #Firehose paths, two #Glue jobs, #Athena.

🔮 Spoiler: how the data is read is the key to the choice.

In the article: every choice with its why, plus a few gems from some Glue experience 😄

https://alessandra.bilardi.net/diary/articles/2026-05/when-does-iceberg-beat-parquet-projection-on-aws-glue-and-when-doesn-t.en

#DiaryOfALazyDeveloper

When does #Iceberg beat #Parquet+projection on #AWSGlue, and when doesn't ?

An end-to-end #ETL PoC on #AWS to find out: producer, #Kinesis, two #Firehose paths, two #Glue jobs, #Athena.

🔮 Spoiler: how the data is read is the key to the choice.

In the article: every choice with its why, plus a few gems from some Glue experience 😄

https://alessandra.bilardi.net/diary/articles/2026-05/when-does-iceberg-beat-parquet-projection-on-aws-glue-and-when-doesn-t.en

#DiaryOfALazyDeveloper

Гайд: Как работать с форматом PARQUET

В прошлом году мы начали публиковать данные в каталоге «Если быть точным» в формате Parquet . Его придумали инженеры Twitter и Cloudera в 2013 году, и сегодня он стал стандартом хранения аналитических данных — его используют Google, Amazon, Netflix и большинство современных data-платформ. В этом гайде мы расскажем, как эффективно работать с данными в формате Parquet с помощью Python.

https://habr.com/ru/articles/1013604/

#parquet #python #анализ_данных

🐒 Ah, yes, the holy grail of nerd bragging rights: a 47M+ item #archive of Hacker News, now in the culinary delight format of #Parquet for all your "data chef" needs. 🍽️ Updated every 5 minutes, because clearly, what's more riveting than a play-by-play of techie's daily musings? Oh wait, I forgot—🥱 anything else.
https://huggingface.co/datasets/open-index/hacker-news #HackerNews #DataChef #TechieBraggingRights #DailyUpdates #HackerNews #ngated

🐒 Ah, yes, the holy grail of nerd bragging rights: a 47M+ item #archive of Hacker News, now in the culinary delight format of #Parquet for all your "data chef" needs. 🍽️ Updated every 5 minutes, because clearly, what's more riveting than a play-by-play of techie's daily musings? Oh wait, I forgot—🥱 anything else.
https://huggingface.co/datasets/open-index/hacker-news #HackerNews #DataChef #TechieBraggingRights #DailyUpdates #HackerNews #ngated

Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

https://huggingface.co/datasets/open-index/hacker-news

#HackerNews #HackerNews #Archive #Parquet #Data #47MItems #UpdatedEvery5m

Hacker News archive (47M+ items, 11.6GB) as Parquet, updated every 5m

https://huggingface.co/datasets/open-index/hacker-news

#HackerNews #HackerNews #Archive #Parquet #Data #47MItems #UpdatedEvery5m

Ho provato a riversare un dump #Wikidata in #Parquet e ad interrogarlo con #DuckDB: ci mette meno di un'ora ad estrapolare tutte le 19.939.182 entità che rappresentano persone, incluse le sottoclassi di wdt:Q5.
Decisamente meglio del mio deserializzatore implementato in Go, che per fare la stessa cosa ci mette quasi 8 ore.

Ho provato a riversare un dump #Wikidata in #Parquet e ad interrogarlo con #DuckDB: ci mette meno di un'ora ad estrapolare tutte le 19.939.182 entità che rappresentano persone, incluse le sottoclassi di wdt:Q5.
Decisamente meglio del mio deserializzatore implementato in Go, che per fare la stessa cosa ci mette quasi 8 ore.

Munquet 0.2.1 just landed on Flathub 🚀

Fixed a small race condition when canceling a conversion — turns out the process could finish right before you clicked “Yes” 😅

Two lines later… all good.

https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

#Flatpak #GTK4 #OpenSource #Parquet #DataScience #Linux #Python #PyArrow

Munquet 0.2.1 just landed on Flathub 🚀

Fixed a small race condition when canceling a conversion — turns out the process could finish right before you clicked “Yes” 😅

Two lines later… all good.

https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

#Flatpak #GTK4 #OpenSource #Parquet #DataScience #Linux #Python #PyArrow

Munquet 0.2.0 is now available on Flathub 🎉

✨ Display real host paths via XDG Portal
🛠 Introduced a .Devel Flatpak manifest for development builds

Continuing to improve the Linux desktop data workflow 🚀

https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet

#Flathub #Flatpak #XDGPortal #GTK4 #OpenSource #Parquet #Python #DataScience