#parquet — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #parquet, aggregated by home.social.
-
Paging Through a Parquet File in DuckDB: File_row_number or Offset?
https://rusty.today/blog/paging-parquet-duckdb-file-row-number-vs-offset/
Comments: https://news.ycombinator.com/item?id=49111006
#HackerNews #DuckDB #Parquet #Paging #FileRowNumber #Offset #DataProcessing
-
Parquet file format. Talk by Boudewijn Braams on Spark+AI Summit Europe 2019
-
When does #Iceberg beat #Parquet+projection on #AWSGlue, and when doesn't ?
An end-to-end #ETL PoC on #AWS to find out: producer, #Kinesis, two #Firehose paths, two #Glue jobs, #Athena.
🔮 Spoiler: how the data is read is the key to the choice.
In the article: every choice with its why, plus a few gems from some Glue experience 😄
-
Ah, nothing screams "cutting-edge innovation" like using #Parquet and #Polars for text embeddings. 🤣 Because, clearly, what the AI world needed was some spreadsheet nostalgia. And don't forget, everyone desperately needed to know how to embed 32,254 Magic the Gathering cards. 🧙♂️💾 Truly groundbreaking stuff!
https://minimaxir.com/2025/02/embeddings-parquet/ #cuttingedgeinnovation #textembeddings #MagicTheGathering #AIhumor #HackerNews #ngated -
The Best Way to Use Text Embeddings Portably Is with Parquet and Polars — https://minimaxir.com/2025/02/embeddings-parquet/
#HackerNews #TextEmbeddings #Parquet #Polars #DataScience #MachineLearning -
The Best Way to Use Text Embeddings Portably Is with Parquet and Polars — https://minimaxir.com/2025/02/embeddings-parquet/
#HackerNews #TextEmbeddings #Parquet #Polars #DataScience #MachineLearning -
The Best Way to Use Text Embeddings Portably Is with Parquet and Polars — https://minimaxir.com/2025/02/embeddings-parquet/
#HackerNews #TextEmbeddings #Parquet #Polars #DataScience #MachineLearning -
The Best Way to Use Text Embeddings Portably Is with Parquet and Polars — https://minimaxir.com/2025/02/embeddings-parquet/
#HackerNews #TextEmbeddings #Parquet #Polars #DataScience #MachineLearning -
The Best Way to Use Text Embeddings Portably Is with Parquet and Polars — https://minimaxir.com/2025/02/embeddings-parquet/
#HackerNews #TextEmbeddings #Parquet #Polars #DataScience #MachineLearning