#apachekafka — Public Fediverse posts

flask-confluent-kafka

Extensão Flask totalmente tipada (PEP 561) e testada para integrar producers e consumers do Confluent Kafka em poucas linhas — configuração direto pelo app.config, autenticação SASL opcional e suporte a múltiplos clientes nomeados, independentes do par padrão. Publicada no PyPI, com CI ativo e changelog versionado.

🔗 https://github.com/Riverfount/flask-confluent-kafka

#Python #Flask #Kafka #ApacheKafka

flask-confluent-kafka

Extensão Flask totalmente tipada (PEP 561) e testada para integrar producers e consumers do Confluent Kafka em poucas linhas — configuração direto pelo app.config, autenticação SASL opcional e suporte a múltiplos clientes nomeados, independentes do par padrão. Publicada no PyPI, com CI ativo e changelog versionado.

🔗 https://github.com/Riverfount/flask-confluent-kafka

#Python #Flask #Kafka #ApacheKafka

flask-confluent-kafka

Extensão Flask totalmente tipada (PEP 561) e testada para integrar producers e consumers do Confluent Kafka em poucas linhas — configuração direto pelo app.config, autenticação SASL opcional e suporte a múltiplos clientes nomeados, independentes do par padrão. Publicada no PyPI, com CI ativo e changelog versionado.

🔗 https://github.com/Riverfount/flask-confluent-kafka

#Python #Flask #Kafka #ApacheKafka

flask-confluent-kafka

Extensão Flask totalmente tipada (PEP 561) e testada para integrar producers e consumers do Confluent Kafka em poucas linhas — configuração direto pelo app.config, autenticação SASL opcional e suporte a múltiplos clientes nomeados, independentes do par padrão. Publicada no PyPI, com CI ativo e changelog versionado.

🔗 https://github.com/Riverfount/flask-confluent-kafka

#Python #Flask #Kafka #ApacheKafka

flask-confluent-kafka

Extensão Flask totalmente tipada (PEP 561) e testada para integrar producers e consumers do Confluent Kafka em poucas linhas — configuração direto pelo app.config, autenticação SASL opcional e suporte a múltiplos clientes nomeados, independentes do par padrão. Publicada no PyPI, com CI ativo e changelog versionado.

🔗 https://github.com/Riverfount/flask-confluent-kafka

#Python #Flask #Kafka #ApacheKafka

Kafka CLI options driving you crazy? AI might finally have a solution.
Grzegorz Kocur tested Confluent’s mcp-confluent server with Claude Code on local Kafka clusters running mTLS and SASL/SCRAM.
Read to find out what happened: https://softwaremill.com/managing-kafka-with-ai-and-mcp/

#Kafka #ApacheKafka #AI #MCP #DevOps #ClaudeAI #Confluent

Kafka CLI options driving you crazy? AI might finally have a solution.
Grzegorz Kocur tested Confluent’s mcp-confluent server with Claude Code on local Kafka clusters running mTLS and SASL/SCRAM.
Read to find out what happened: https://softwaremill.com/managing-kafka-with-ai-and-mcp/

#Kafka #ApacheKafka #AI #MCP #DevOps #ClaudeAI #Confluent

Kafka CLI options driving you crazy? AI might finally have a solution.
Grzegorz Kocur tested Confluent’s mcp-confluent server with Claude Code on local Kafka clusters running mTLS and SASL/SCRAM.
Read to find out what happened: https://softwaremill.com/managing-kafka-with-ai-and-mcp/

#Kafka #ApacheKafka #AI #MCP #DevOps #ClaudeAI #Confluent

Kafka CLI options driving you crazy? AI might finally have a solution.
Grzegorz Kocur tested Confluent’s mcp-confluent server with Claude Code on local Kafka clusters running mTLS and SASL/SCRAM.
Read to find out what happened: https://softwaremill.com/managing-kafka-with-ai-and-mcp/

#Kafka #ApacheKafka #AI #MCP #DevOps #ClaudeAI #Confluent

Kafka CLI options driving you crazy? AI might finally have a solution.
Grzegorz Kocur tested Confluent’s mcp-confluent server with Claude Code on local Kafka clusters running mTLS and SASL/SCRAM.
Read to find out what happened: https://softwaremill.com/managing-kafka-with-ai-and-mcp/

#Kafka #ApacheKafka #AI #MCP #DevOps #ClaudeAI #Confluent

𝗞𝗮𝗳𝗸𝗮𝗛𝗤:

#ApacheKafka #GUI #KafkaHQ

https://thewhale.cc/posts/kafkahq

KafkaHQ is an open source GUI for Apache Kafka. Kafka GUI for topics, topics data, consumers group and more...

𝗞𝗮𝗳𝗸𝗮𝗛𝗤:

#ApacheKafka #GUI #KafkaHQ

https://thewhale.cc/posts/kafkahq

KafkaHQ is an open source GUI for Apache Kafka. Kafka GUI for topics, topics data, consumers group and more...

𝗞𝗮𝗳𝗸𝗮𝗛𝗤:

#ApacheKafka #GUI #KafkaHQ

https://thewhale.cc/posts/kafkahq

KafkaHQ is an open source GUI for Apache Kafka. Kafka GUI for topics, topics data, consumers group and more...

𝗞𝗮𝗳𝗸𝗮𝗛𝗤:

#ApacheKafka #GUI #KafkaHQ

https://thewhale.cc/posts/kafkahq

KafkaHQ is an open source GUI for Apache Kafka. Kafka GUI for topics, topics data, consumers group and more...

Apache Kafka concepts can be tricky; visualizing them helps.

The SoftwareMill Kafka Visualization tool breaks down the fundamentals interactively so you can see how things work in real time.

🆕 Now updated to support Kafka Share Groups.

Give it a spin: https://softwaremill.com/kafka-visualisation/

#ApacheKafka #Kafka #DistributedSystems #SoftwareEngineering

Apache Kafka concepts can be tricky; visualizing them helps.

The SoftwareMill Kafka Visualization tool breaks down the fundamentals interactively so you can see how things work in real time.

🆕 Now updated to support Kafka Share Groups.

Give it a spin: https://softwaremill.com/kafka-visualisation/

#ApacheKafka #Kafka #DistributedSystems #SoftwareEngineering

Apache Kafka concepts can be tricky; visualizing them helps.

The SoftwareMill Kafka Visualization tool breaks down the fundamentals interactively so you can see how things work in real time.

🆕 Now updated to support Kafka Share Groups.

Give it a spin: https://softwaremill.com/kafka-visualisation/

#ApacheKafka #Kafka #DistributedSystems #SoftwareEngineering

Apache Kafka concepts can be tricky; visualizing them helps.

The SoftwareMill Kafka Visualization tool breaks down the fundamentals interactively so you can see how things work in real time.

🆕 Now updated to support Kafka Share Groups.

Give it a spin: https://softwaremill.com/kafka-visualisation/

#ApacheKafka #Kafka #DistributedSystems #SoftwareEngineering

Apache Kafka concepts can be tricky; visualizing them helps.

The SoftwareMill Kafka Visualization tool breaks down the fundamentals interactively so you can see how things work in real time.

🆕 Now updated to support Kafka Share Groups.

Give it a spin: https://softwaremill.com/kafka-visualisation/

#ApacheKafka #Kafka #DistributedSystems #SoftwareEngineering

any #kafka committers around here that could review this? https://github.com/apache/kafka/pull/22826

#apachekafka

any #kafka committers around here that could review this? https://github.com/apache/kafka/pull/22826

#apachekafka

any #kafka committers around here that could review this? https://github.com/apache/kafka/pull/22826

#apachekafka

any #kafka committers around here that could review this? https://github.com/apache/kafka/pull/22826

#apachekafka

I need to work on an #apachekafka project. Thinking of doing something for #netlabelday or maybe @friendsofccmusic more generally.

Any ideas on what would be useful for #ccmusic and #netlabels ?

I need to work on an #apachekafka project. Thinking of doing something for #netlabelday or maybe @friendsofccmusic more generally.

Any ideas on what would be useful for #ccmusic and #netlabels ?

I need to work on an #apachekafka project. Thinking of doing something for #netlabelday or maybe @friendsofccmusic more generally.

Any ideas on what would be useful for #ccmusic and #netlabels ?

I need to work on an #apachekafka project. Thinking of doing something for #netlabelday or maybe @friendsofccmusic more generally.

Any ideas on what would be useful for #ccmusic and #netlabels ?

A Kafka authentication bypass lets attackers replay expired JWTs against 4.0.x brokers. The OAUTHBEARER path checks nbf but not exp. No fix yet.

#ApacheKafka #Kafka #OAUTHBEARER #JWT #InfoSec

https://securityonline.info/kafka-oauthbearer-jwt-bypass/?utm_source=mastodon&utm_medium=jetpack_social

A Kafka authentication bypass lets attackers replay expired JWTs against 4.0.x brokers. The OAUTHBEARER path checks nbf but not exp. No fix yet.

#ApacheKafka #Kafka #OAUTHBEARER #JWT #InfoSec

https://securityonline.info/kafka-oauthbearer-jwt-bypass/?utm_source=mastodon&utm_medium=jetpack_social

Event-driven architecture promises scalability, but the real tradeoffs in Java-based real-time systems only show up in production.

Drawing on a Java/Kafka contact center platform handling 80k BHCC across 10k agents, Sagar Deepak Joshi's new #InfoQ article explores exactly where things break down:
🔹 State management & partition limits
🔹 Message deduplication
🔹 JVM tuning challenges
🔹 Cascading consumer failures

Discover the Redis-backed patterns used to solve them and keep the system resilient.

🔗 Read now for more insights: https://bit.ly/4bmaRPb

#Java #SpringBoot #ApacheKafka #Redis #Microservices #SoftwareArchitecture

Event-driven architecture promises scalability, but the real tradeoffs in Java-based real-time systems only show up in production.

Drawing on a Java/Kafka contact center platform handling 80k BHCC across 10k agents, Sagar Deepak Joshi's new #InfoQ article explores exactly where things break down:
🔹 State management & partition limits
🔹 Message deduplication
🔹 JVM tuning challenges
🔹 Cascading consumer failures

Discover the Redis-backed patterns used to solve them and keep the system resilient.

🔗 Read now for more insights: https://bit.ly/4bmaRPb

#Java #SpringBoot #ApacheKafka #Redis #Microservices #SoftwareArchitecture

Event-driven architecture promises scalability, but the real tradeoffs in Java-based real-time systems only show up in production.

Drawing on a Java/Kafka contact center platform handling 80k BHCC across 10k agents, Sagar Deepak Joshi's new #InfoQ article explores exactly where things break down:
🔹 State management & partition limits
🔹 Message deduplication
🔹 JVM tuning challenges
🔹 Cascading consumer failures

Discover the Redis-backed patterns used to solve them and keep the system resilient.

🔗 Read now for more insights: https://bit.ly/4bmaRPb

#Java #SpringBoot #ApacheKafka #Redis #Microservices #SoftwareArchitecture

Event-driven architecture promises scalability, but the real tradeoffs in Java-based real-time systems only show up in production.

Drawing on a Java/Kafka contact center platform handling 80k BHCC across 10k agents, Sagar Deepak Joshi's new #InfoQ article explores exactly where things break down:
🔹 State management & partition limits
🔹 Message deduplication
🔹 JVM tuning challenges
🔹 Cascading consumer failures

Discover the Redis-backed patterns used to solve them and keep the system resilient.

🔗 Read now for more insights: https://bit.ly/4bmaRPb

#Java #SpringBoot #ApacheKafka #Redis #Microservices #SoftwareArchitecture

Are Apache Kafka follower replicas synchronous or asynchronous?
The confusing answer is: both.
This article clears it up:
https://softwaremill.com/apache-kafka-replica-followers-synchronous-or-asynchronous/

#ApacheKafka #Confluent

Are Apache Kafka follower replicas synchronous or asynchronous?
The confusing answer is: both.
This article clears it up:
https://softwaremill.com/apache-kafka-replica-followers-synchronous-or-asynchronous/

#ApacheKafka #Confluent

Are Apache Kafka follower replicas synchronous or asynchronous?
The confusing answer is: both.
This article clears it up:
https://softwaremill.com/apache-kafka-replica-followers-synchronous-or-asynchronous/

#ApacheKafka #Confluent

Are Apache Kafka follower replicas synchronous or asynchronous?
The confusing answer is: both.
This article clears it up:
https://softwaremill.com/apache-kafka-replica-followers-synchronous-or-asynchronous/

#ApacheKafka #Confluent

Spring News Roundup: Point Releases of Boot, Security, Integration, Modulith and Spring AI 2.0

There was a flurry of activity in the Spring ecosystem during the week of June…
#NewsBeep #News #US #USA #UnitedStates #UnitedStatesOfAmerica #Artsanddesign #AMQP #ApacheKafka #Architecture&Design #Arts #ArtsAndDesign #Design #development #Entertainment #gRPC #Java #LDAP #SpringAI #SpringBoot #SpringData #SpringIntegration #springnewsroundupjun082026 #SpringSecurity
https://www.newsbeep.com/us/707101/

Spring News Roundup: Point Releases of Boot, Security, Integration, Modulith and Spring AI 2.0

There was a flurry of activity in the Spring ecosystem during the week of June…
#NewsBeep #News #US #USA #UnitedStates #UnitedStatesOfAmerica #Artsanddesign #AMQP #ApacheKafka #Architecture&Design #Arts #ArtsAndDesign #Design #development #Entertainment #gRPC #Java #LDAP #SpringAI #SpringBoot #SpringData #SpringIntegration #springnewsroundupjun082026 #SpringSecurity
https://www.newsbeep.com/us/707101/

https://www.europesays.com/ie/537265/ Spring News Roundup: Point Releases of Boot, Security, Integration, Modulith and Spring AI 2.0 #AMQP #ApacheKafka #Architecture&Design #Arts #ArtsAndDesign #ArtsAndDesign #ArtsDesign #Design #Development #Éire #Entertainment #gRPC #IE #Ireland #Java #LDAP #SpringAI #SpringBoot #SpringData #SpringIntegration #SpringNewsRoundupJun082026 #SpringSecurity

Повторная обработка сообщений в Kafka Consumer

Привет! Меня зовут Дмитрий Михеев, я ведущий разработчик в MAGNIT OMNI — бизнес-группе ритейлера «Магнит», которая отвечает за развитие омниканального опыта для клиентов. В своих сервисах для межсервисных коммуникаций помимо gRPC-запросов мы используем брокер сообщений Kafka. Если описывать его в двух словах, Kafka — это распределённый журнал событий (event log), через который сервисы обмениваются данными в реальном времени. Не буду подробно останавливаться на устройстве Kafka — это хорошо описано в документации. В этой статье хочу подсветить один неочевидный момент, который может привести к проблемам при работе с consumer’ами — повторную обработку сообщений (retry).

https://habr.com/ru/companies/magnit/articles/1043068/

#kafka #apachekafka #kafkaconsumer #retry #повторнаяобработка #идемпотентность #высоконагруженныесистемы #java

Повторная обработка сообщений в Kafka Consumer

Привет! Меня зовут Дмитрий Михеев, я ведущий разработчик в MAGNIT OMNI — бизнес-группе ритейлера «Магнит», которая отвечает за развитие омниканального опыта для клиентов. В своих сервисах для межсервисных коммуникаций помимо gRPC-запросов мы используем брокер сообщений Kafka. Если описывать его в двух словах, Kafka — это распределённый журнал событий (event log), через который сервисы обмениваются данными в реальном времени. Не буду подробно останавливаться на устройстве Kafka — это хорошо описано в документации. В этой статье хочу подсветить один неочевидный момент, который может привести к проблемам при работе с consumer’ами — повторную обработку сообщений (retry).

https://habr.com/ru/companies/magnit/articles/1043068/

#kafka #apachekafka #kafkaconsumer #retry #повторнаяобработка #идемпотентность #высоконагруженныесистемы #java

Повторная обработка сообщений в Kafka Consumer

Привет! Меня зовут Дмитрий Михеев, я ведущий разработчик в MAGNIT OMNI — бизнес-группе ритейлера «Магнит», которая отвечает за развитие омниканального опыта для клиентов. В своих сервисах для межсервисных коммуникаций помимо gRPC-запросов мы используем брокер сообщений Kafka. Если описывать его в двух словах, Kafka — это распределённый журнал событий (event log), через который сервисы обмениваются данными в реальном времени. Не буду подробно останавливаться на устройстве Kafka — это хорошо описано в документации. В этой статье хочу подсветить один неочевидный момент, который может привести к проблемам при работе с consumer’ами — повторную обработку сообщений (retry).

https://habr.com/ru/companies/magnit/articles/1043068/

#kafka #apachekafka #kafkaconsumer #retry #повторнаяобработка #идемпотентность #высоконагруженныесистемы #java

Schema proliferation builds slowly and gets expensive fast.

One schema per event type seems reasonable - until you're:
• Managing 10+ tables
• Writing union queries across all of them
• Propagating a single field rename everywhere

The Alternative❓ Discriminator-based schema consolidation.

It reduces schema count, simplifies downstream consumption, and makes schema evolution manageable. New variants become additive changes instead of breaking existing consumers.

🔗 Check out the #InfoQ article for a practical look at the pattern and its trade-offs ⇨ https://bit.ly/4uC023n

#Java #ApacheKafka #ApacheFlink

Schema proliferation builds slowly and gets expensive fast.

One schema per event type seems reasonable - until you're:
• Managing 10+ tables
• Writing union queries across all of them
• Propagating a single field rename everywhere

The Alternative❓ Discriminator-based schema consolidation.

It reduces schema count, simplifies downstream consumption, and makes schema evolution manageable. New variants become additive changes instead of breaking existing consumers.

🔗 Check out the #InfoQ article for a practical look at the pattern and its trade-offs ⇨ https://bit.ly/4uC023n

#Java #ApacheKafka #ApacheFlink

Schema proliferation builds slowly and gets expensive fast.

One schema per event type seems reasonable - until you're:
• Managing 10+ tables
• Writing union queries across all of them
• Propagating a single field rename everywhere

The Alternative❓ Discriminator-based schema consolidation.

It reduces schema count, simplifies downstream consumption, and makes schema evolution manageable. New variants become additive changes instead of breaking existing consumers.

🔗 Check out the #InfoQ article for a practical look at the pattern and its trade-offs ⇨ https://bit.ly/4uC023n

#Java #ApacheKafka #ApacheFlink

Schema proliferation builds slowly and gets expensive fast.

One schema per event type seems reasonable - until you're:
• Managing 10+ tables
• Writing union queries across all of them
• Propagating a single field rename everywhere

The Alternative❓ Discriminator-based schema consolidation.

It reduces schema count, simplifies downstream consumption, and makes schema evolution manageable. New variants become additive changes instead of breaking existing consumers.

🔗 Check out the #InfoQ article for a practical look at the pattern and its trade-offs ⇨ https://bit.ly/4uC023n

#Java #ApacheKafka #ApacheFlink

This #InfoQ article examines how #ApacheKafka is evolving toward a #CloudNative architecture through tiered storage, elastic consumers, virtual clusters, and diskless storage proposals.

Read now: https://bit.ly/4u0hZr0

#AI #CloudComputing #kafkastreams #softwarearchitecture

This #InfoQ article examines how #ApacheKafka is evolving toward a #CloudNative architecture through tiered storage, elastic consumers, virtual clusters, and diskless storage proposals.

Read now: https://bit.ly/4u0hZr0

#AI #CloudComputing #kafkastreams #softwarearchitecture

This #InfoQ article examines how #ApacheKafka is evolving toward a #CloudNative architecture through tiered storage, elastic consumers, virtual clusters, and diskless storage proposals.

Read now: https://bit.ly/4u0hZr0

#AI #CloudComputing #kafkastreams #softwarearchitecture

This #InfoQ article examines how #ApacheKafka is evolving toward a #CloudNative architecture through tiered storage, elastic consumers, virtual clusters, and diskless storage proposals.

Read now: https://bit.ly/4u0hZr0

#AI #CloudComputing #kafkastreams #softwarearchitecture

Kafka Streaming for Cyber Security 🔐🚀

Built a multi-source streaming engine pushing to Kafka:

• Network logs – CICIDS2017 style (500/sec, 5% attacks)
• User activity – Insider threat patterns (50/sec)
• System events – ADFA-LD host intrusions (200/sec)
• Correlated alerts – Real-time threat detection

Attack simulation: DDoS, Botnet, Web Shell, Rootkit

Kafka = Perfect for SIEM data ingestion! 📊

#ApacheKafka #CyberSecurity #ThreatDetection

#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.

✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architectures

Read the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot

#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics

#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.

✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architectures

Read the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot

#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics

#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.

✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architectures

Read the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot

#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics

#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.

✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architectures

Read the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot

#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics

Grafana Labs announced #Grafana 13, introducing a new Loki Kafka-backed ingestion architecture and AI Observability in Grafana Cloud for real-time monitoring and evaluation of AI systems.

The release also includes GCX, a new CLI designed to surface Grafana Cloud data inside agentic development environments.

Details here 👉 https://bit.ly/4mPUqz8

#Observability #AI #DevOps #ApacheKafka #InfoQ

Grafana Labs announced #Grafana 13, introducing a new Loki Kafka-backed ingestion architecture and AI Observability in Grafana Cloud for real-time monitoring and evaluation of AI systems.

The release also includes GCX, a new CLI designed to surface Grafana Cloud data inside agentic development environments.

Details here 👉 https://bit.ly/4mPUqz8

#Observability #AI #DevOps #ApacheKafka #InfoQ

Grafana Labs announced #Grafana 13, introducing a new Loki Kafka-backed ingestion architecture and AI Observability in Grafana Cloud for real-time monitoring and evaluation of AI systems.

The release also includes GCX, a new CLI designed to surface Grafana Cloud data inside agentic development environments.

Details here 👉 https://bit.ly/4mPUqz8

#Observability #AI #DevOps #ApacheKafka #InfoQ

Grafana Labs announced #Grafana 13, introducing a new Loki Kafka-backed ingestion architecture and AI Observability in Grafana Cloud for real-time monitoring and evaluation of AI systems.

The release also includes GCX, a new CLI designed to surface Grafana Cloud data inside agentic development environments.

Details here 👉 https://bit.ly/4mPUqz8

#Observability #AI #DevOps #ApacheKafka #InfoQ