#eventstreaming — Public Fediverse posts

Is your Kafka lag dashboard lying? Learn how log compaction and retention silently manipulate reported timestamps to understate consumer delays and how to identify these inaccuracies and ensure your monitoring reflects actual system performance.
https://softwaremill.com/compaction-and-retention-edge-cases-that-make-your-kafkas-lag-metrics-inaccurate/

#ApacheKafka #DataEngineering #DistributedSystems #EventStreaming #Observability

Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:

#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems

Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:

#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems

Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:

#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems

Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:

#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems

Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:

#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems

This is a hands-on walkthrough of building a real-time dashboard with Quarkus + Redis TimeSeries.

Live ingestion via WebSockets, automatic downsampling, multi-resolution queries, and a simple browser UI.
Crypto is just the data source. The patterns apply to metrics, IoT, and event streams.

https://www.the-main-thread.com/p/real-time-crypto-dashboard-java-quarkus-redis-timeseries

#Java #Quarkus #Redis #TimeSeries #BackendEngineering #EventStreaming

This is a hands-on walkthrough of building a real-time dashboard with Quarkus + Redis TimeSeries.

Live ingestion via WebSockets, automatic downsampling, multi-resolution queries, and a simple browser UI.
Crypto is just the data source. The patterns apply to metrics, IoT, and event streams.

https://www.the-main-thread.com/p/real-time-crypto-dashboard-java-quarkus-redis-timeseries

#Java #Quarkus #Redis #TimeSeries #BackendEngineering #EventStreaming

This is a hands-on walkthrough of building a real-time dashboard with Quarkus + Redis TimeSeries.

Live ingestion via WebSockets, automatic downsampling, multi-resolution queries, and a simple browser UI.
Crypto is just the data source. The patterns apply to metrics, IoT, and event streams.

https://www.the-main-thread.com/p/real-time-crypto-dashboard-java-quarkus-redis-timeseries

#Java #Quarkus #Redis #TimeSeries #BackendEngineering #EventStreaming

This is a hands-on walkthrough of building a real-time dashboard with Quarkus + Redis TimeSeries.

Live ingestion via WebSockets, automatic downsampling, multi-resolution queries, and a simple browser UI.
Crypto is just the data source. The patterns apply to metrics, IoT, and event streams.

https://www.the-main-thread.com/p/real-time-crypto-dashboard-java-quarkus-redis-timeseries

#Java #Quarkus #Redis #TimeSeries #BackendEngineering #EventStreaming

This is a hands-on walkthrough of building a real-time dashboard with Quarkus + Redis TimeSeries.

Live ingestion via WebSockets, automatic downsampling, multi-resolution queries, and a simple browser UI.
Crypto is just the data source. The patterns apply to metrics, IoT, and event streams.

https://www.the-main-thread.com/p/real-time-crypto-dashboard-java-quarkus-redis-timeseries

#Java #Quarkus #Redis #TimeSeries #BackendEngineering #EventStreaming

Explore key Confluent Platform features missing in open-source Apache Kafka. Learn what’s essential for scaling and securing your production deployments:
https://softwaremill.com/confluent-platform-vs-apache-kafka-feature-comparison/
#Kafka #Confluent #EventStreaming #DataEngineering

Explore key Confluent Platform features missing in open-source Apache Kafka. Learn what’s essential for scaling and securing your production deployments:
https://softwaremill.com/confluent-platform-vs-apache-kafka-feature-comparison/
#Kafka #Confluent #EventStreaming #DataEngineering

Explore key Confluent Platform features missing in open-source Apache Kafka. Learn what’s essential for scaling and securing your production deployments:
https://softwaremill.com/confluent-platform-vs-apache-kafka-feature-comparison/
#Kafka #Confluent #EventStreaming #DataEngineering

Explore key Confluent Platform features missing in open-source Apache Kafka. Learn what’s essential for scaling and securing your production deployments:
https://softwaremill.com/confluent-platform-vs-apache-kafka-feature-comparison/
#Kafka #Confluent #EventStreaming #DataEngineering

Explore key Confluent Platform features missing in open-source Apache Kafka. Learn what’s essential for scaling and securing your production deployments:
https://softwaremill.com/confluent-platform-vs-apache-kafka-feature-comparison/
#Kafka #Confluent #EventStreaming #DataEngineering

#DDD keeps my mind spinning around messaging patterns.
Should I publish each Aggregate's events to a same named topic partition it by Aggregate Id ?
On the consumer side should I stop event consumption if an event handler fails in order to ensure invariants ?

#DDD #eventstreaming

One Open-source Project Daily

Change data capture for a variety of databases.

https://github.com/debezium/debezium

#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer

One Open-source Project Daily

Change data capture for a variety of databases.

https://github.com/debezium/debezium

#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer

One Open-source Project Daily

Change data capture for a variety of databases.

https://github.com/debezium/debezium

#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer

One Open-source Project Daily

Change data capture for a variety of databases.

https://github.com/debezium/debezium

#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer

One Open-source Project Daily

Change data capture for a variety of databases.

https://github.com/debezium/debezium

#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer

Wrote another blog post on creating scalable, performant and secure serverless applications. This post covers the CQRS and event streaming implementation I used for Sale Nook. As ever, I'm still looking for work or a contract so if you, or someone you know, needs an engineering manager or freelance, fullstack developer hit me up.

https://dav3.co/blog/rust-cqrs-event-streaming

#rust #rustlang #serverless #cqrs #eventstreaming #lookingforwork

"Event Streaming is not Event Sourcing!" is probably the article I'm linking the most from those that I wrote. It's part of my Don Quixote crusade to untangle those terms, as I've seen many significant architectural decisions made without realising those differences. And the consequences were severe.

There's a skewed perspective conflating #EventSourcing with #EventStreaming.

I know those terms sound similar. I know many people tell you that you can use Kafka as an event store, but...

Event Sourcing is about making decisions, capturing their outcomes (so events) and using them to make further decisions (so events are the state).

Event Streaming is about moving information from one place to another and integrating multiple components.

Event stores are databases. They may have similar capabilities as Event Streaming solutions, but the focus is different:
- event stores on consistency, durability and quality of data,
- event streaming solutions (like #Kafka) are focused on delivery, throughput and integration.

So, to give a bold comparison, saying that Kafka is an event store is almost like saying that #RabbitMQ is a database.

I really like Kafka; I've been using it successfully, along with the Event Sourcing tool. That's why I believe it's important to know the difference and how to compose those tooling instead of mixing them and getting a hangover.

Check more in my article 👇

https://event-driven.io/en/event_streaming_is_not_event_sourcing/

To my event-driven speaker friends. There's only one week left to apply to the #EventCentric conference. There are few conferences where you can show your event-driven face and go down the rabbit hole.

The conference is a nice and safe space for discussion and showing your ideas, tools, and case studies. It's a sub-conference of @dddeu. Dates: June 4-5, 2025.

This time located in Antwerp. The city with the longest underwater walking tunnel I saw! I were there twice and enjoyed it.

I'm helping the organisers a bit, and I'd love to see talks around #EventSourcing and #EventStreaming, both modelling and applying event-driven ways in practice.

Don't wait and send your proposals here: https://2025.eventcentric.eu/cfp/

To my event-driven speaker friends. There's only one week left to apply to the #EventCentric conference. There are few conferences where you can show your event-driven face and go down the rabbit hole.

The conference is a nice and safe space for discussion and showing your ideas, tools, and case studies. It's a sub-conference of @dddeu. Dates: June 4-5, 2025.

This time located in Antwerp. The city with the longest underwater walking tunnel I saw! I were there twice and enjoyed it.

I'm helping the organisers a bit, and I'd love to see talks around #EventSourcing and #EventStreaming, both modelling and applying event-driven ways in practice.

Don't wait and send your proposals here: https://2025.eventcentric.eu/cfp/

To my event-driven speaker friends. There's only one week left to apply to the #EventCentric conference. There are few conferences where you can show your event-driven face and go down the rabbit hole.

The conference is a nice and safe space for discussion and showing your ideas, tools, and case studies. It's a sub-conference of @dddeu. Dates: June 4-5, 2025.

This time located in Antwerp. The city with the longest underwater walking tunnel I saw! I were there twice and enjoyed it.

I'm helping the organisers a bit, and I'd love to see talks around #EventSourcing and #EventStreaming, both modelling and applying event-driven ways in practice.

Don't wait and send your proposals here: https://2025.eventcentric.eu/cfp/

To my event-driven speaker friends. There's only one week left to apply to the #EventCentric conference. There are few conferences where you can show your event-driven face and go down the rabbit hole.

The conference is a nice and safe space for discussion and showing your ideas, tools, and case studies. It's a sub-conference of @dddeu. Dates: June 4-5, 2025.

This time located in Antwerp. The city with the longest underwater walking tunnel I saw! I were there twice and enjoyed it.

I'm helping the organisers a bit, and I'd love to see talks around #EventSourcing and #EventStreaming, both modelling and applying event-driven ways in practice.

Don't wait and send your proposals here: https://2025.eventcentric.eu/cfp/

To my event-driven speaker friends. There's only one week left to apply to the #EventCentric conference. There are few conferences where you can show your event-driven face and go down the rabbit hole.

The conference is a nice and safe space for discussion and showing your ideas, tools, and case studies. It's a sub-conference of @dddeu. Dates: June 4-5, 2025.

This time located in Antwerp. The city with the longest underwater walking tunnel I saw! I were there twice and enjoyed it.

I'm helping the organisers a bit, and I'd love to see talks around #EventSourcing and #EventStreaming, both modelling and applying event-driven ways in practice.

Don't wait and send your proposals here: https://2025.eventcentric.eu/cfp/

My @dddeu talk is now live! Want to know your #eventSourcing from your #eventStreaming from your #eventStorming? What about an answer to the confusion of a #domainEvent and an #integrationEvent? Or wish your PO could relate when you are explaining the need to use #queues?

Here's what you need https://www.youtube.com/watch?v=EVMPZe4V-ww&utm_source=Mastodon&utm_medium=Social&utm_campaign=professional&id=upiDLDdvb8

#softwareDesign #softwareArchitecture

My @dddeu talk is now live! Want to know your #eventSourcing from your #eventStreaming from your #eventStorming? What about an answer to the confusion of a #domainEvent and an #integrationEvent? Or wish your PO could relate when you are explaining the need to use #queues?

Here's what you need https://www.youtube.com/watch?v=EVMPZe4V-ww&utm_source=Mastodon&utm_medium=Social&utm_campaign=professional&id=upiDLDdvb8

#softwareDesign #softwareArchitecture

My @dddeu talk is now live! Want to know your #eventSourcing from your #eventStreaming from your #eventStorming? What about an answer to the confusion of a #domainEvent and an #integrationEvent? Or wish your PO could relate when you are explaining the need to use #queues?

Here's what you need https://www.youtube.com/watch?v=EVMPZe4V-ww&utm_source=Mastodon&utm_medium=Social&utm_campaign=professional&id=upiDLDdvb8

#softwareDesign #softwareArchitecture

My @dddeu talk is now live! Want to know your #eventSourcing from your #eventStreaming from your #eventStorming? What about an answer to the confusion of a #domainEvent and an #integrationEvent? Or wish your PO could relate when you are explaining the need to use #queues?

Here's what you need https://www.youtube.com/watch?v=EVMPZe4V-ww&utm_source=Mastodon&utm_medium=Social&utm_campaign=professional&id=upiDLDdvb8

#softwareDesign #softwareArchitecture

My @dddeu talk is now live! Want to know your #eventSourcing from your #eventStreaming from your #eventStorming? What about an answer to the confusion of a #domainEvent and an #integrationEvent? Or wish your PO could relate when you are explaining the need to use #queues?

Here's what you need https://www.youtube.com/watch?v=EVMPZe4V-ww&utm_source=Mastodon&utm_medium=Social&utm_campaign=professional&id=upiDLDdvb8

#softwareDesign #softwareArchitecture

Curious to hear from folks, besides #apacheKafka, what are your favorite #streaming technologies? 🤔

#streamingdata #eventstreaming #streamingtechnology #apacheFlink #apacheSpark #apachePulsar

Curious to hear from folks, besides #apacheKafka, what are your favorite #streaming technologies? 🤔

#streamingdata #eventstreaming #streamingtechnology #apacheFlink #apacheSpark #apachePulsar

Curious to hear from folks, besides #apacheKafka, what are your favorite #streaming technologies? 🤔

#streamingdata #eventstreaming #streamingtechnology #apacheFlink #apacheSpark #apachePulsar

Curious to hear from folks, besides #apacheKafka, what are your favorite #streaming technologies? 🤔

#streamingdata #eventstreaming #streamingtechnology #apacheFlink #apacheSpark #apachePulsar

We believe in being people-driven!

What people say or do influence us, whether we notice it or not. Thinking how we got ourselves into #EventStreaming, we “blame” it on Jay Kreps, @martin, and Ben Stopford

Who would you "blame"?

Am I crazy to think that kafka should not need 6GB or ram for optimal performance?

#kafka #eventstreaming

Digging into snowplow tracker as an alternative to google analytics, so much interesting work done around standardizing the protocol and schema storage. https://docs.snowplow.io/docs/collecting-data/collecting-from-own-applications/snowplow-tracker-protocol/ #datascience #eventstreaming

You’ll see how easy it is to use #RxJS primitives to create a declarative solution that is both readable and generic...

https://softwaremill.com/implement-onclick-ondoubleclick-and-onhold-streams-with-rxjs/

#StateMachines #EventStreaming #Asynchronous

Confluent CEO Jay Kreps is coming to TC Sessions: SaaS for a fireside chat - As companies process ever-increasing amounts of data, moving it in real time is a ... - http://feedproxy.google.com/~r/Techcrunch/~3/rIO9dyU4ZmI/ #tcsessions:saas2021 #softwareasaservice #cloudcomputing #eventstreaming #javiersoltero #caseyaylward #freesoftware #goldmansachs #apachekafka #kobiefuller #enterprise #opensource #developer #computing #confluent #microsoft #jaykreps #linkedin #software #netflix #google