#apachehadoop — Public Fediverse posts

https://www.europesays.com/ie/389135/ QCon London 2026: Behind Booking.com’s AI Evolution: The Unpolished Story #A/BTesting #AI #ApacheHadoop #Architecture&Design #ArtificialIntelligence #BookingEvolutionAiManuel #Development #Éire #IE #Ireland #Java #MachineLearning #ML&DataEngineering #Python #QConLondon2026 #Scala #Technology

Apache Hadoop: Flaw in HDFS-Native-Client allows malicious code to pass

The Apache Hadoop framework is vulnerable. Attacks can occur in the context of the HDFS file system. A security patch is available.

https://www.heise.de/en/news/Apache-Hadoop-Flaw-in-HDFS-Native-Client-allows-malicious-code-to-pass-11155304.html?wt_mc=sm.red.ho.mastodon.mastodon.md_beitraege.md_beitraege&utm_source=mastodon

#ApacheHadoop #IT #Security #Sicherheitslücken #Updates #news

Apache Hadoop: Fehler im HDFS-Native-Client lässt Schadcode passieren

Das Framework Apache Hadoop ist verwundbar. Attacken können im Kontext des HDFS-Dateisystems geschehen. Ein Sicherheitspatch ist verfügbar.

https://www.heise.de/news/Apache-Hadoop-Fehler-im-HDFS-Native-Client-laesst-Schadcode-passieren-11155241.html?wt_mc=sm.red.ho.mastodon.mastodon.md_beitraege.md_beitraege&utm_source=mastodon

#ApacheHadoop #IT #Security #Sicherheitslücken #Updates #news

Podcast "Techtiefen": Big Data auf Kubernetes mit Stackable

Für diese Podcast-Episode hat sich Nico Kreiling Lars Francke eingeladen. Sie schauen auf frühere Hadoop-Zeiten und moderne Datenverarbeitung.

https://www.heise.de/blog/Podcast-Techtiefen-Big-Data-auf-Kubernetes-mit-Stackable-9840945.html?wt_mc=sm.red.ho.mastodon.mastodon.md_beitraege.md_beitraege&utm_source=mastodon

#ApacheHadoop #BigData #CloudComputing #Containerisierung #Kubernetes #news

#Uber, running one of the largest #ApacheHadoop installations in the world, is moving to Google Cloud!

#CaseStudy - Discover its strategy to migrate the batch data analytics and machine learning (ML) training stack to Google Cloud Platform (GCP): https://bit.ly/4cmgonj

#DevOps #GoogleCloud #BigData #InfoQ

I hope we open source some of the #ApacheHadoop work we are doing because Dark Lord knows this is harder than it should be.

For those a little familiar with Cascading, in #java, it was originally designed to run on #ApacheHadoop, and then #ApacheTez, but it also has a local planner.

This lets developers create non-clustered data applications, without the Hadoop/Tez etc dependencies or runtime.

I've been using the local planner in production for over 5 years now.

But Parquet requires Hadoop libraries, and this is ok, there is a shim between the libraries that allow Parquet and S3AFileSystem to be used locally.

A little more color on this announcement..
https://fosstodon.org/@cwensel/110549001614086663

First, #ApacheParquet removed #Cascading support, so I had to splice the original source into Cascading. But the ParquetScheme didn't honor type information fully. So there is a new TypedParquetScheme that has native support for JSON and Timestamps.

Second, Parquet requires the #ApacheHadoop FileSystem, which means we get the wonderful S3A implementation. But we also get a 331MB jar dependency with the aws bundle.

Google brings Cloud Dataproc to Kubernetes - Cloud Dataproc is probably one of the lesser-known products in Google Cloud’s portfolio, but it’s a ... more: http://feedproxy.google.com/~r/Techcrunch/~3/ojK5tQQznp4/ #apachesoftwarefoundation #cloudinfrastructure #dataprocessing #apachehadoop #apachespark #googlecloud #kubernetes #developer #apache #google #hadoop #cloud #gke