#apachebeam — Public Fediverse posts

Apache Beam with GCP Dataflow: The Ultimate Duo for Data Integration
#apacheBeam #GCPDataflow
https://www.xtivia.com/blog/apache-beam-with-gcp-dataflow-the-ultimate-duo-for-data-integration/

Apache Beam with GCP Dataflow: The Ultimate Duo for Data Integration
#apacheBeam #GCPDataflow
https://www.xtivia.com/blog/apache-beam-with-gcp-dataflow-the-ultimate-duo-for-data-integration/

Apache Beam with GCP Dataflow: The Ultimate Duo for Data Integration
#apacheBeam #GCPDataflow
https://www.xtivia.com/blog/apache-beam-with-gcp-dataflow-the-ultimate-duo-for-data-integration/

Apache Beam with GCP Dataflow: The Ultimate Duo for Data Integration
#apacheBeam #GCPDataflow
https://www.xtivia.com/blog/apache-beam-with-gcp-dataflow-the-ultimate-duo-for-data-integration/

Apache Beam with GCP Dataflow: The Ultimate Duo for Data Integration
#apacheBeam #GCPDataflow
https://www.xtivia.com/blog/apache-beam-with-gcp-dataflow-the-ultimate-duo-for-data-integration/

@mrudokas @didier And that's why I avoid #Java. Even #Kotlin and #Scala already has way less boilerplate (but I still dislike it). Part of the problem is the language, other parts is the libraries - and the alternative #JVM languages only change one part of the equation.

Now you know why I prefer even #C++ over those. In C++ there's already way less boilerplate, and thus also way less efficiency of such tools. In fact I only ever get useful matches at all when writing code for a batch processing framework similar to #ApacheBeam.

Which has a REALLY nice #Go interface where stateless parallel functions can just be Go functions. No class/struct/whatever around it, no extra methods, no weird context objects, just pure functions from type A to type B. That's how I want things to be.

#Haskell also is a very good example, and in fact one of the languages with least amount of boilerplate I know.

Otherwise, the point is "my team does not have the power to change the existing ecosystem". We have projects to deliver, can't spend too much resources in creating better APIs to existing systems. We can do incremental improvements though - in C++ that is possible, in Java it is a lost cause.

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

I'm not feeling the warm fuzzies about trying to do GCP Dataflow (aka Apache Beam) with Typescript. Doesn't feel fully baked.

Also doesn't feel like a lot of doc/examples nor many people using it. I don't think our org should be on the bleeding edge of something like this for a core piece of our infrastructure.

Dunno. Will keep working on it for a bit.

#GCP #GoogleCloud #Dataflow #ApacheBeam

Latest version of my Whisky clustering using Apache projects talk:
https://speakerdeck.com/paulk/groovy-whiskey
Tickets are still available for CoCEU. #apachecon #communityovercode #apachewayang #ApacheFlink #ApacheSpark #ApacheBeam #ApacheIgnite #ApacheCommons @ApacheGroovy #opensource #machinelearning #groovylang

Latest version of my Whisky clustering using Apache projects talk:
https://speakerdeck.com/paulk/groovy-whiskey
Tickets are still available for CoCEU. #apachecon #communityovercode #apachewayang #ApacheFlink #ApacheSpark #ApacheBeam #ApacheIgnite #ApacheCommons @ApacheGroovy #opensource #machinelearning #groovylang

Latest version of my Whisky clustering using Apache projects talk:
https://speakerdeck.com/paulk/groovy-whiskey
Tickets are still available for CoCEU. #apachecon #communityovercode #apachewayang #ApacheFlink #ApacheSpark #ApacheBeam #ApacheIgnite #ApacheCommons @ApacheGroovy #opensource #machinelearning #groovylang

Latest version of my Whisky clustering using Apache projects talk:
https://speakerdeck.com/paulk/groovy-whiskey
Tickets are still available for CoCEU. #apachecon #communityovercode #apachewayang #ApacheFlink #ApacheSpark #ApacheBeam #ApacheIgnite #ApacheCommons @ApacheGroovy #opensource #machinelearning #groovylang

#CaseStudy - Discover how #Yelp reworked its data streaming architecture with #ApacheBeam & #ApacheFlink!

The company replaced a fragmented set of data pipelines for streaming transactional data into its analytical systems, like Amazon Redshift and in-house data lake, using Apache data streaming projects to create a unified and flexible solution.

Dive into the details: https://bit.ly/3WgkTL7

#InfoQ #SoftwareArchitecture #EventDrivenArchitecture #DataPipelines #Streaming

#CaseStudy - Discover how #Yelp reworked its data streaming architecture with #ApacheBeam & #ApacheFlink!

The company replaced a fragmented set of data pipelines for streaming transactional data into its analytical systems, like Amazon Redshift and in-house data lake, using Apache data streaming projects to create a unified and flexible solution.

Dive into the details: https://bit.ly/3WgkTL7

#InfoQ #SoftwareArchitecture #EventDrivenArchitecture #DataPipelines #Streaming

#CaseStudy - Discover how #Yelp reworked its data streaming architecture with #ApacheBeam & #ApacheFlink!

The company replaced a fragmented set of data pipelines for streaming transactional data into its analytical systems, like Amazon Redshift and in-house data lake, using Apache data streaming projects to create a unified and flexible solution.

Dive into the details: https://bit.ly/3WgkTL7

#InfoQ #SoftwareArchitecture #EventDrivenArchitecture #DataPipelines #Streaming

#CaseStudy - Discover how #Yelp reworked its data streaming architecture with #ApacheBeam & #ApacheFlink!

The company replaced a fragmented set of data pipelines for streaming transactional data into its analytical systems, like Amazon Redshift and in-house data lake, using Apache data streaming projects to create a unified and flexible solution.

Dive into the details: https://bit.ly/3WgkTL7

#InfoQ #SoftwareArchitecture #EventDrivenArchitecture #DataPipelines #Streaming

#CaseStudy - Discover how #Yelp reworked its data streaming architecture with #ApacheBeam & #ApacheFlink!

The company replaced a fragmented set of data pipelines for streaming transactional data into its analytical systems, like Amazon Redshift and in-house data lake, using Apache data streaming projects to create a unified and flexible solution.

Dive into the details: https://bit.ly/3WgkTL7

#InfoQ #SoftwareArchitecture #EventDrivenArchitecture #DataPipelines #Streaming

Good morning ☕☀️

I am #recruiting a Data Engineer into my team.

We're building pipelines in #trivago that analyse, verify and normalise the content coming from partners, to deliver them clean to the rest of the company.

I am looking for a pragmatic engineer engaged for quality and stability, that takes the challenge to process big volumes of data. We use ATM #Python and #ApacheBeam in #GCP, but you don't need them to apply if you are using other data tooling.

We offer a competitive salary, a constant challenge, a very enthusiastic team and an authentic atmosphere of multicultural colleagues.

We're based in #Düsseldorf, and we work in english in an hybrid scheme of 2 days #homeOffice / 3 days in person. Also unlimited vacation days, 20 days per year fully remote, kitchen, coffee, daily fruits...

Apply now!
https://careers.trivago.com/job/r7193037002/

Good morning ☕☀️

I am #recruiting a Data Engineer into my team.

We're building pipelines in #trivago that analyse, verify and normalise the content coming from partners, to deliver them clean to the rest of the company.

I am looking for a pragmatic engineer engaged for quality and stability, that takes the challenge to process big volumes of data. We use ATM #Python and #ApacheBeam in #GCP, but you don't need them to apply if you are using other data tooling.

We offer a competitive salary, a constant challenge, a very enthusiastic team and an authentic atmosphere of multicultural colleagues.

We're based in #Düsseldorf, and we work in english in an hybrid scheme of 2 days #homeOffice / 3 days in person. Also unlimited vacation days, 20 days per year fully remote, kitchen, coffee, daily fruits...

Apply now!
https://careers.trivago.com/job/r7193037002/

Good morning ☕☀️

I am #recruiting a Data Engineer into my team.

We're building pipelines in #trivago that analyse, verify and normalise the content coming from partners, to deliver them clean to the rest of the company.

I am looking for a pragmatic engineer engaged for quality and stability, that takes the challenge to process big volumes of data. We use ATM #Python and #ApacheBeam in #GCP, but you don't need them to apply if you are using other data tooling.

We offer a competitive salary, a constant challenge, a very enthusiastic team and an authentic atmosphere of multicultural colleagues.

We're based in #Düsseldorf, and we work in english in an hybrid scheme of 2 days #homeOffice / 3 days in person. Also unlimited vacation days, 20 days per year fully remote, kitchen, coffee, daily fruits...

Apply now!
https://careers.trivago.com/job/r7193037002/

Good morning ☕☀️

I am #recruiting a Data Engineer into my team.

We're building pipelines in #trivago that analyse, verify and normalise the content coming from partners, to deliver them clean to the rest of the company.

I am looking for a pragmatic engineer engaged for quality and stability, that takes the challenge to process big volumes of data. We use ATM #Python and #ApacheBeam in #GCP, but you don't need them to apply if you are using other data tooling.

We offer a competitive salary, a constant challenge, a very enthusiastic team and an authentic atmosphere of multicultural colleagues.

We're based in #Düsseldorf, and we work in english in an hybrid scheme of 2 days #homeOffice / 3 days in person. Also unlimited vacation days, 20 days per year fully remote, kitchen, coffee, daily fruits...

Apply now!
https://careers.trivago.com/job/r7193037002/

Good morning ☕☀️

I am #recruiting a Data Engineer into my team.

We're building pipelines in #trivago that analyse, verify and normalise the content coming from partners, to deliver them clean to the rest of the company.

I am looking for a pragmatic engineer engaged for quality and stability, that takes the challenge to process big volumes of data. We use ATM #Python and #ApacheBeam in #GCP, but you don't need them to apply if you are using other data tooling.

We offer a competitive salary, a constant challenge, a very enthusiastic team and an authentic atmosphere of multicultural colleagues.

We're based in #Düsseldorf, and we work in english in an hybrid scheme of 2 days #homeOffice / 3 days in person. Also unlimited vacation days, 20 days per year fully remote, kitchen, coffee, daily fruits...

Apply now!
https://careers.trivago.com/job/r7193037002/

Quiet before the storm – the "backstage view". 5 minutes later the room was packed! 🤩

Just done presenting on data pipelines, #apachebeam, #OSS, #Java & #Cloud @ Devfest Bucharest, on the Cloud stage. 💾

Thanks to the awesome GDGBucharest team for the organization. 👏

Quiet before the storm – the "backstage view". 5 minutes later the room was packed! 🤩

Just done presenting on data pipelines, #apachebeam, #OSS, #Java & #Cloud @ Devfest Bucharest, on the Cloud stage. 💾

Thanks to the awesome GDGBucharest team for the organization. 👏

Quiet before the storm – the "backstage view". 5 minutes later the room was packed! 🤩

Just done presenting on data pipelines, #apachebeam, #OSS, #Java & #Cloud @ Devfest Bucharest, on the Cloud stage. 💾

Thanks to the awesome GDGBucharest team for the organization. 👏

Quiet before the storm – the "backstage view". 5 minutes later the room was packed! 🤩

Just done presenting on data pipelines, #apachebeam, #OSS, #Java & #Cloud @ Devfest Bucharest, on the Cloud stage. 💾

Thanks to the awesome GDGBucharest team for the organization. 👏

Quiet before the storm – the "backstage view". 5 minutes later the room was packed! 🤩

Just done presenting on data pipelines, #apachebeam, #OSS, #Java & #Cloud @ Devfest Bucharest, on the Cloud stage. 💾

Thanks to the awesome GDGBucharest team for the organization. 👏

✍️ blogged about unified batch and stream data processing using #ApacheBeam https://mkuthan.github.io/blog/2023/09/27/unified-batch-streaming/

✍️ blogged about unified batch and stream data processing using #ApacheBeam https://mkuthan.github.io/blog/2023/09/27/unified-batch-streaming/

Data science & Groovy using #ApacheBeam #ApacheCamel #ApacheCommons @ApacheGroovy #ApacheIgnite #ApacheMXNet #ApacheOpennlp #ApacheSpark #ApacheWayang #Datumbox #deepjavalibrary #DeepNetts #EclipseDL4J #graalvm #gradle #stanfordnlp #TensorFlow #Tribuo #smile #tablesaw #opencsv

https://www.javaadvent.com/2022/12/groovy-and-data-science.html

Covers data manipulation, regression, clustering, classification, natural language processing & object detection #jsr381 #visrec #ai #ml #groovylang #neuralnets #deeplearning #javaadvent22

Data science & Groovy using #ApacheBeam #ApacheCamel #ApacheCommons @ApacheGroovy #ApacheIgnite #ApacheMXNet #ApacheOpennlp #ApacheSpark #ApacheWayang #Datumbox #deepjavalibrary #DeepNetts #EclipseDL4J #graalvm #gradle #stanfordnlp #TensorFlow #Tribuo #smile #tablesaw #opencsv

https://www.javaadvent.com/2022/12/groovy-and-data-science.html

Covers data manipulation, regression, clustering, classification, natural language processing & object detection #jsr381 #visrec #ai #ml #groovylang #neuralnets #deeplearning #javaadvent22

Data science & Groovy using #ApacheBeam #ApacheCamel #ApacheCommons @ApacheGroovy #ApacheIgnite #ApacheMXNet #ApacheOpennlp #ApacheSpark #ApacheWayang #Datumbox #deepjavalibrary #DeepNetts #EclipseDL4J #graalvm #gradle #stanfordnlp #TensorFlow #Tribuo #smile #tablesaw #opencsv

https://www.javaadvent.com/2022/12/groovy-and-data-science.html

Covers data manipulation, regression, clustering, classification, natural language processing & object detection #jsr381 #visrec #ai #ml #groovylang #neuralnets #deeplearning #javaadvent22

Data science & Groovy using #ApacheBeam #ApacheCamel #ApacheCommons @ApacheGroovy #ApacheIgnite #ApacheMXNet #ApacheOpennlp #ApacheSpark #ApacheWayang #Datumbox #deepjavalibrary #DeepNetts #EclipseDL4J #graalvm #gradle #stanfordnlp #TensorFlow #Tribuo #smile #tablesaw #opencsv

https://www.javaadvent.com/2022/12/groovy-and-data-science.html

Covers data manipulation, regression, clustering, classification, natural language processing & object detection #jsr381 #visrec #ai #ml #groovylang #neuralnets #deeplearning #javaadvent22

Data science & Groovy using #ApacheBeam #ApacheCamel #ApacheCommons @ApacheGroovy #ApacheIgnite #ApacheMXNet #ApacheOpennlp #ApacheSpark #ApacheWayang #Datumbox #deepjavalibrary #DeepNetts #EclipseDL4J #graalvm #gradle #stanfordnlp #TensorFlow #Tribuo #smile #tablesaw #opencsv

https://www.javaadvent.com/2022/12/groovy-and-data-science.html

Covers data manipulation, regression, clustering, classification, natural language processing & object detection #jsr381 #visrec #ai #ml #groovylang #neuralnets #deeplearning #javaadvent22