#datastreaming — Public Fediverse posts

We're proud to announce that SoftwareMill is now an IBM Silver Partner!

As a Confluent Elite Partner, we have a long history of helping organizations build modern, event-driven data platforms. Deepening our collaboration with IBM is a natural next step, allowing us to better help our clients bridge real-time data, AI, and enterprise-grade technology at scale.

#IBM #Confluent #DataStreaming #AI

Streambed – Stream Postgres to Iceberg on S3, Supports Postgres Wire

https://github.com/viggy28/streambed

#HackerNews #Streambed #Postgres #Iceberg #S3 #DataStreaming #TechNews

Our experts, Krzysztof Grajek and Grzegorz Kocur, will be speaking at the Data Streaming Meetup in Kraków. View the agenda and join the event: https://meetup.com/krakow-kafka/events/314177442/

#ApacheKafka #DataStreaming #Confluent #Krk #Meetup #StreamProcessing #Rustlang #DevOps

#AIagents are only as good as the event systems connecting them. @DavidKjerrumga1 explains why modern #AI needs a protocol-flexible backbone & how @apache_pulsar unifies streams & queues for reliable, real-time intelligence.

👉https://javapro.io/2025/11/06/why-ai-agents-need-a-protocol-flexible-event-bus/

#DataStreaming #EventDriven

Uber Moves In-House Search Indexing to Pull-Based Ingestion in OpenSearch | InfoQ @infoq
https://www.infoq.com/news/2026/02/uber-pull-based-opensearch/

@OpenSearchProject #OpenSearch #Uber #dataStreaming

IBM is eyeing a possible $11B acquisition of Confluent to strengthen its AI and real-time data capabilities. If finalized, the deal could boost IBM’s edge against AWS and Microsoft in the enterprise AI race—but talks are still in progress.

#IBM #Confluent #AI #BigTech #TechAcquisition #WallStreet #DataStreaming #EnterpriseAI #TechNews #TECHi

Read Full Article Here :- https://www.techi.com/ibm-to-acquire-confluent-11b-ai-deal/

Why was Apache Kafka created?

https://bigdata.2minutestreaming.com/p/why-was-apache-kafka-created

#HackerNews #ApacheKafka #WhyKafka #CreatedTechHistory #DataStreaming

Apache Kafka is a powerful tool for processing data streams - but have you ever wondered what's really happening under the hood? 🔍

You can check it with our Kafka Visualization 👉 https://softwaremill.com/kafka-visualisation/

With this tool, you can simulate how data flows through a replicated Kafka topic, to gain a better understanding of the message processing model. Have fun exploring Kafka!

#kafka #apachekafka #kafkavisualization #datastreaming

Radio for DuckDB – DuckDB Now Talks to WebSockets and Redis Pub/Sub

https://query.farm/duckdb_extension_radio.html

#HackerNews #DuckDB #WebSockets #Redis #PubSub #DataStreaming #TechNews

#DataStreaming is tough! Despite 10+ years of attempting to simplify it, teams often spend up to 80% of their time wrangling bad data at the lake and optimizing real-time pipelines.

Discover the basic challenges of Data Streaming and a few design & architecture patterns used to tackle these challenges.

This is about pragmatic solutions to build fast, scalable & manageable Data Streaming Pipelines! Watch the #InfoQ video now: https://bit.ly/3Zmjrrd

#DataEngineering

Our Client needed a robust solution to process vast amounts of data in real-time. We chose Apache Kafka for this project 🚀 See how it helped overcome all the challenges: https://softwaremill.com/case-study/data-streaming-using-kafka-for-a-retail-company/

#apachekafka #kafka #data #datastreaming #bigdata

Over the past three years in #devRel, sharing my knowledge around #dataStreaming technologies was enough to make me love everything about my job. But, we all know, it was the supportive #openSource community that truly shaped my experience and made it the very best...

It's lunch time at the datastream summit!
Leave the data, take the cannoli
#datastreaming #apacheflink #apachepulsar

#Berlin and #FlinkForward was amazing!,
But I'm in #SanFrancisco again for the #datastreaming Summit next week so I'll take it!
The 5am #Nespresso is an admission of jetlag, nothing else....


@ververicadata @streamnativeio

It's the formal opening of @FlinkFoward!
If you're here, the opening talks are starting!! #apacheflink #datastreaming #realtime!

The solution to long-running spans in is more creative than “don’t have long-running spans.” Learn how to address this common problem.

#DataStreaming

https://thenewstack.io/opentelemetry-challenges-handling-long-running-spans/

Developing stateful applications can get pretty chaotic as they move upstream and downstream. 2 open source tools that aim to tame that chaos are gaining popularity.

#Data #DataStreaming #OpenSource

https://thenewstack.io/how-apache-iceberg-and-flink-can-ease-developer-pain/

Last month @gunnarmorling and I launched #CheckpointChronicle, a roundup of interesting things in the streaming & data space.

The next edition is out soon—stay tuned to the @decodable blog, or read last month's and subscribe to receive it by email at https://www.decodable.co/blog/checkpoint-chronicle-november-2023

(scroll down to the bottom and leave your email address. we'll only use it for sending you the newsletter each month, promise 🤝)

#streamProcessing #dataEngineering #dataStreaming #openSource

🚀 Dive into the world of data streaming with Kafka Streams! 🌐 Learn DSL and Processor APIs, and master the art of building seamless data pipelines with @geethaay . https://buff.ly/47IRHPJ #Kafka #DataStreaming #Java

New blog is out!

One of #ApacheKafka’s mantra is that it preserves message ordering, but, is it true?

Check out the edge cases and how to solve them (also using #ApacheFlink)

https://aiven.io/blog/kafka-real-ordering

#datastreaming

Had the pleasure of being interviewed by @alex_casalboni for the @awscloud podcast in Italian.

Easy part: share my passion about #datastreaming with #ApacheKafka and #ApacheFlink

Complex part: talk about work in Italian after 15 years.

Check it out! https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy8xNTM4OTBiOC9wb2RjYXN0L3Jzcw/episode/MzQ2MWE2OWQtYmJjOC00NzY5LWEwMjAtYjFhMmI3ZmRjNjk5?sa=X&ved=0CAUQkfYCahcKEwiA1cvTptn9AhUAAAAAHQAAAAAQAQ

I'm very proud of the final result!

If you're in the #datastreaming world, and want to check how you can build data transformation pipelines in few minutes with SQL statements, code versioning & autocomplete and data preview...

Want to submit to #Current23 to speak about #datastreaming and #realtimeanalytics but not sure if your abstract will make the cut? Give yourself the best chance with feedback during speakers office hours!

Join us on the Confluent Community Slack speakers-office-hours channel tomorrow at 10am GMT and 11am PST! The program committee will be there to give guidance and answer any questions you may have on submitting.

Hope to see you there!

More details on our #CfP page:
https://sessionize.com/current-2023/

What’s currently one of the more affordable S3 (compatible) options out there? Both storage and ingress/egress fees? Heard Backblaze was launching something as well, has that gone out of beta yet? Also, any methods out there to prevent massive traffic bills?

#s3 #storage #datastreaming