home.social

#parquet — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #parquet, aggregated by home.social.

  1. When does #Iceberg beat #Parquet+projection on #AWSGlue, and when doesn't ?

    An end-to-end #ETL PoC on #AWS to find out: producer, #Kinesis, two #Firehose paths, two #Glue jobs, #Athena.

    🔮 Spoiler: how the data is read is the key to the choice.

    In the article: every choice with its why, plus a few gems from some Glue experience 😄

    alessandra.bilardi.net/diary/a

    #DiaryOfALazyDeveloper

  2. Ah, nothing screams "cutting-edge innovation" like using #Parquet and #Polars for text embeddings. 🤣 Because, clearly, what the AI world needed was some spreadsheet nostalgia. And don't forget, everyone desperately needed to know how to embed 32,254 Magic the Gathering cards. 🧙‍♂️💾 Truly groundbreaking stuff!
    minimaxir.com/2025/02/embeddin #cuttingedgeinnovation #textembeddings #MagicTheGathering #AIhumor #HackerNews #ngated