#kafkastreams — Public Fediverse posts

Apache Kafka 4.3.1 was released. It contains a critical memory-leak bug fix for #KafkaStreams.

Thanks to our RM Bill Bejeck for the quick turnaround on this one!

https://www.apache.org/dist/kafka/4.3.1/RELEASE_NOTES.html

This #InfoQ article examines how #ApacheKafka is evolving toward a #CloudNative architecture through tiered storage, elastic consumers, virtual clusters, and diskless storage proposals.

Read now: https://bit.ly/4u0hZr0

#AI #CloudComputing #kafkastreams #softwarearchitecture

O que são Sistemas Auto-Adaptativos?

Novo vídeo publicado nos canais do LHC, registro da Tosconf[6] 🏴‍☠️] que rolou no último sábado.

Apresentação do Victor Osório : Que tal aprender sobre para que servem esses sistemas, como implementar eles, como é a arquitetura de um sistema desses e por fim ver a descrição de um trabalho de mestrado que envolve Sistemas Auto-Adaptativos e Kafka Streams.

Através de Sistemas Auto-Adaptativos podemos colocar inteligência em sistemas de longa execução.

🔗 Assista na íntegra: https://peertube.lhc.net.br/w/exZJcQTjaujv2N7JHYqZaz

#tosconf #hackerspace #campinas #sistemas #autoadaptativos #kafkastreams #desconferencia

We are happy to announce Apache Kafka 4.2.0!

Highlights are: Queues for Kafka and the new #KafkaStreams "streams" groups.

Thanks to all the 155 contributors and our RM Christo Lolov.

More details on the web page:
https://kafka.apache.org/blog/2026/01/14/apache-kafka-4.2.0-release-announcement/

We are happy to share that the Apache Kafka 4.1.1 bug-fix release is now available!

It contains a critical memory-leak fix for #KafkaStreams and many other fixes. For details see https://kafka.apache.org/blog#apache_kafka_411_release_announcement

Thanks to 32 contributors and Lianet Magrans as our RM.

Atlassian introduced Lithium - an in-house #ETL platform designed to meet the requirements of dynamic data movement.

Lithium simplifies cloud migrations, scheduled backups, and in-flight data validations with ephemeral pipelines and tenant-level isolation - ensuring efficiency, scalability & cost savings.

📢 InfoQ spoke with Niraj Mishra, Principal Engineer at Atlassian, about Lithium’s implementation and future.

🔗 Read more here: https://bit.ly/415RPYZ

#DataPipelines #KafkaStreams #ApacheKafka #ApacheFlink #SoftwareArchitecture

#InfoQ

Как в Sidec благодаря exactly-once сократили потребление ресурсов без потери производительности

Меня зовут Сергей Гребенюк, я лидер разработки Sidec ( Росреестр ). Расскажу, как решили задачу объединения двух топиков с соотношением один ко многим и почему не устроило решение на Kafka-streams ( kafka docs ) и RocksDB ( github ). А также о том, как, опираясь на гарантии доставки exactly-once (EOS) ( confluent docs ), смогли снизить требования к ресурсам в несколько раз. На иллюстрации показаны два подхода к объединению топиков: с persistent cache и in-memory cache. Мы перейдём от первой схемы ко второй.

https://habr.com/ru/companies/sberbank/articles/863688/

#Sidec #потребление_ресурсов #kafkastreams #kafkaconnect

🚀 Kafka Streams In Action - Baue deine erste Streaming-App 🚀

In seinem Vortrag auf der #BaselOne24 zeigt Thomas Müller, wie man mit der hashtag#Kafka-Streaming-API eine leistungsfähige Streaming-Anwendung erstellen kann – und das auf einfache Weise! 👨‍💻
https://lnkd.in/ggjmzerN

Wir freuen uns auf dich! 🙌

#KafkaStreams #ApacheKafka #Streaming #SoftwareDevelopment

Meet Amazon MSK Replicator - a new feature of Amazon Managed Streaming for #ApacheKafka.

MSK Replicator allows customers to reliably replicate data across Amazon MSK clusters in different or the same AWS region(s) in a few clicks.

To learn more about it, read #InfoQ! https://bit.ly/3tXtlD7

#AWS #KafkaStreams #Streaming #Database

Having fun with AVRO schemas evolution early in the morning... Not even ironic. Its 7:47 and I think AVRO schema evolution checks by schema registry already saved the day!
#kafka #kafkastreams #avro

@vepo Are you talking about #KafkaStreams? Could it be probing rebalances?

🌐 #CaseStudy - Cloudflare has generated over 1 trillion messages to #ApacheKafka for inter-service communication in less than six years!

Discover real incidents faced in recent years due to scalability limitations and the steps and patterns applied to deal with the ever-increasing demand: https://bit.ly/43yEp5T

#InfoQ #KafkaStreams #EventDrivenArchitecture #ScalingSuccess

I would love to get your feedback

When you implement a Micronaut-based application that uses Kafka, Which Java Library do you use?

cc @micronautfw @ApacheKafka

#Kafka #microservices #micronaut #java #softwaredevelopment #softwareengineering #development #kafkastreams #java20 #eventdriven #architecture

So Confluent is acquiring Immerok and diving into the world of #Flink. What does that mean for #KafkaStreams?

@jbfletch explains:
https://twitter.com/jbfletch_/status/1611493927470735362?s=20&t=CdcyN5Qn-aYEBSkC2Ley6w

#markd

Here is my #introduction
I am a #nerd that loves all things #StarTrek.

I am a #SoftwareEngineer supporting #node / #NodeJS and #JavaScript / #TypeScript systems in the #AWS cloud. I maintain #kafka / #KafkaConnect / #KafkaStreams services, and #FrontEnd #interfaces.

I enjoy #gaming with #games from #BoardGames and #CardGames to #VideoGames.

I enjoy reading #theory #SciFi and #fantasy from authors such as #UrsulaKLeGuin and #GeorgeRRMartin. I am on the #left politically.