#apachekafka — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #apachekafka, aggregated by home.social.
-
Kafka Streaming for Cyber Security 🔐🚀
Built a multi-source streaming engine pushing to Kafka:
• Network logs – CICIDS2017 style (500/sec, 5% attacks)
• User activity – Insider threat patterns (50/sec)
• System events – ADFA-LD host intrusions (200/sec)
• Correlated alerts – Real-time threat detectionAttack simulation: DDoS, Botnet, Web Shell, Rootkit
Kafka = Perfect for SIEM data ingestion! 📊
-
Kafka Streaming for Cyber Security 🔐🚀
Built a multi-source streaming engine pushing to Kafka:
• Network logs – CICIDS2017 style (500/sec, 5% attacks)
• User activity – Insider threat patterns (50/sec)
• System events – ADFA-LD host intrusions (200/sec)
• Correlated alerts – Real-time threat detectionAttack simulation: DDoS, Botnet, Web Shell, Rootkit
Kafka = Perfect for SIEM data ingestion! 📊
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
Grafana Labs announced #Grafana 13, introducing a new Loki Kafka-backed ingestion architecture and AI Observability in Grafana Cloud for real-time monitoring and evaluation of AI systems.
The release also includes GCX, a new CLI designed to surface Grafana Cloud data inside agentic development environments.
Details here 👉 https://bit.ly/4mPUqz8
-
https://www.europesays.com/ie/455555/ Spring News Roundup: First Release Candidates of Boot, Security, Integration, Modulith, AMQP #AMQP #ApacheKafka #Architecture&Design #Development #Éire #IE #Ireland #Java #LDAP #SpringBoot #SpringFramework #SpringIntegration #SpringModulith #SpringNewsRoundupApr202026 #SpringSecurity #Technology
-
Our experts, Krzysztof Grajek and Grzegorz Kocur, will be speaking at the Data Streaming Meetup in Kraków. View the agenda and join the event: https://meetup.com/krakow-kafka/events/314177442/
#ApacheKafka #DataStreaming #Confluent #Krk #Meetup #StreamProcessing #Rustlang #DevOps
-
Our experts, Krzysztof Grajek and Grzegorz Kocur, will be speaking at the Data Streaming Meetup in Kraków. View the agenda and join the event: https://meetup.com/krakow-kafka/events/314177442/
#ApacheKafka #DataStreaming #Confluent #Krk #Meetup #StreamProcessing #Rustlang #DevOps
-
Our experts, Krzysztof Grajek and Grzegorz Kocur, will be speaking at the Data Streaming Meetup in Kraków. View the agenda and join the event: https://meetup.com/krakow-kafka/events/314177442/
#ApacheKafka #DataStreaming #Confluent #Krk #Meetup #StreamProcessing #Rustlang #DevOps
-
Our experts, Krzysztof Grajek and Grzegorz Kocur, will be speaking at the Data Streaming Meetup in Kraków. View the agenda and join the event: https://meetup.com/krakow-kafka/events/314177442/
#ApacheKafka #DataStreaming #Confluent #Krk #Meetup #StreamProcessing #Rustlang #DevOps
-
Our experts, Krzysztof Grajek and Grzegorz Kocur, will be speaking at the Data Streaming Meetup in Kraków. View the agenda and join the event: https://meetup.com/krakow-kafka/events/314177442/
#ApacheKafka #DataStreaming #Confluent #Krk #Meetup #StreamProcessing #Rustlang #DevOps
-
Kafka has reached commodity status — and that's actually its greatest achievement. Here's what it means for where streaming innovation goes next. https://hackernoon.com/kafka-has-become-the-postgres-of-streaming-and-that-changes-everything #apachekafka
-
Kafka in-cluster replication won't save you from a regional outage. You need a battle-tested Multi-Region strategy.
Read this to master:
- RPO/RTO trade-offs for global scale
- Active-Active vs. Stretched Clusters (3-DC & 2.5-DC)
- Solving the offset translation nightmare
- Real-world failover testing
https://softwaremill.com/guide-to-apache-kafka-disaster-recovery-and-multi-region-architectures/#ApacheKafka #SystemArchitecture #DisasterRecovery #DataEngineering
-
Meet Tansu!
An #opensource, Kafka-compatible broker that’s stateless, leaderless, and scales to zero.
• Pluggable storage: S3, SQLite, Postgres
• Broker-side schema validation
• Direct writes to Iceberg & Delta LakeBuilt in #RustLang, - 20MB RAM, ~10ms startup
Learn more ⇨ https://bit.ly/4d119nc
-
Check out what's new in the #Spring community 👉 https://bit.ly/3NMwcbY
The third milestone releases of: Spring Boot, Spring Security, Spring Integration, Spring AI and Spring AMQP; along with the second milestone releases of Spring Data and Spring for Apache Kafka.
#Java #SpringBoot #SpringData #SpringSecurity #SpringAI #SpringVault #ApacheKafka
-
Check out what's new in the #Spring community 👉 https://bit.ly/3NMwcbY
The third milestone releases of: Spring Boot, Spring Security, Spring Integration, Spring AI and Spring AMQP; along with the second milestone releases of Spring Data and Spring for Apache Kafka.
#Java #SpringBoot #SpringData #SpringSecurity #SpringAI #SpringVault #ApacheKafka
-
Check out what's new in the #Spring community 👉 https://bit.ly/3NMwcbY
The third milestone releases of: Spring Boot, Spring Security, Spring Integration, Spring AI and Spring AMQP; along with the second milestone releases of Spring Data and Spring for Apache Kafka.
#Java #SpringBoot #SpringData #SpringSecurity #SpringAI #SpringVault #ApacheKafka
-
Check out what's new in the #Spring community 👉 https://bit.ly/3NMwcbY
The third milestone releases of: Spring Boot, Spring Security, Spring Integration, Spring AI and Spring AMQP; along with the second milestone releases of Spring Data and Spring for Apache Kafka.
#Java #SpringBoot #SpringData #SpringSecurity #SpringAI #SpringVault #ApacheKafka
-
Spring News Roundup: Third Milestone Releases of Boot, Security, Integration, AI and AMQP
There was a flurry of activity in the Spring ecosystem during the week of March 16th, 2026, hig…
#NewsBeep #News #US #USA #UnitedStates #UnitedStatesOfAmerica #Artsanddesign #AMQP #ApacheKafka #Architecture&Design #Arts #ArtsAndDesign #Design #development #Entertainment #Java #SpringAI #SpringBoot #SpringData #SpringIntegration #springnewsroundupmar162026 #SpringSecurity
https://www.newsbeep.com/us/540537/ -
Spring News Roundup: Third Milestone Releases of Boot, Security, Integration, AI and AMQP
There was a flurry of activity in the Spring ecosystem during the week of March 16th, 2026, hig…
#NewsBeep #News #US #USA #UnitedStates #UnitedStatesOfAmerica #Artsanddesign #AMQP #ApacheKafka #Architecture&Design #Arts #ArtsAndDesign #Design #development #Entertainment #Java #SpringAI #SpringBoot #SpringData #SpringIntegration #springnewsroundupmar162026 #SpringSecurity
https://www.newsbeep.com/us/540537/ -
Spring News Roundup: Third Milestone Releases of Boot, Security, Integration, AI and AMQP
There was a flurry of activity in the Spring ecosystem during the week of March 16th, 2026, highlighting…
#NewsBeep #News #Artsanddesign #AMQP #ApacheKafka #Architecture&Design #Arts #ArtsAndDesign #AU #Australia #Design #Development #Entertainment #Java #SpringAI #SpringBoot #SpringData #SpringIntegration #springnewsroundupmar162026 #SpringSecurity
https://www.newsbeep.com/au/558792/ -
Spring News Roundup: Third Milestone Releases of Boot, Security, Integration, AI and AMQP
There was a flurry of activity in the Spring ecosystem during the week of March 16th, 2026, highlighting…
#NewsBeep #News #Artsanddesign #AMQP #ApacheKafka #Architecture&Design #Arts #ArtsAndDesign #AU #Australia #Design #Development #Entertainment #Java #SpringAI #SpringBoot #SpringData #SpringIntegration #springnewsroundupmar162026 #SpringSecurity
https://www.newsbeep.com/au/558792/ -
Spring News Roundup: Third Milestone Releases of Boot, Security, Integration, AI and AMQP
There was a flurry of activity in the Spring ecosystem during the week of March 16th, 2026, highlighting…
#NewsBeep #News #Artsanddesign #AMQP #ApacheKafka #Architecture&Design #Arts #ArtsAndDesign #Design #Development #Entertainment #Java #SpringAI #SpringBoot #SpringData #SpringIntegration #springnewsroundupmar162026 #SpringSecurity #UK #UnitedKingdom
https://www.newsbeep.com/uk/490681/ -
https://www.europesays.com/uk/844527/ Spring News Roundup: Third Milestone Releases of Boot, Security, Integration, AI and AMQP #AMQP #ApacheKafka #Architecture&Design #Arts #ArtsAndDesign #Design #Development #Entertainment #Java #SpringAI #SpringBoot #SpringData #SpringIntegration #SpringNewsRoundupMar162026 #SpringSecurity #UK #UnitedKingdom
-
https://www.europesays.com/ie/399094/ Spring News Roundup: Third Milestone Releases of Boot, Security, Integration, AI and AMQP #AMQP #ApacheKafka #Architecture&Design #Development #Éire #IE #Ireland #Java #SpringAI #SpringBoot #SpringData #SpringIntegration #SpringNewsRoundupMar162026 #SpringSecurity #Technology
-
https://www.europesays.com/ie/389867/ IBM Completes Acquisition of Confluent, Making Real Time Data the Engine of Enterprise AI and Agents #Acquisition #AI #ApacheKafka #ArtificialIntelligence #ArtificialIntelligence #Confluent #Éire #EnterpriseAIAndAgents #IBM #IE #Inc #Ireland #JayKreps #RobThomas #SanjeevMohan #Technology
-
Apache Kafka has gotten rather long in the tooth, is Apache Iggy the successor? https://hackernoon.com/what-the-heck-is-apache-iggy #apachekafka
-
Is your Kafka lag dashboard lying? Learn how log compaction and retention silently manipulate reported timestamps to understate consumer delays and how to identify these inaccuracies and ensure your monitoring reflects actual system performance.
https://softwaremill.com/compaction-and-retention-edge-cases-that-make-your-kafkas-lag-metrics-inaccurate/#ApacheKafka #DataEngineering #DistributedSystems #EventStreaming #Observability
-
#Pinterest launched a next-gen CDC-based ingestion framework.
Using #ApacheKafka, #ApacheFlink, #ApacheSpark & #ApacheIceberg, they achieved:
• Latency cut from 24+ hours to 15 minutes
• Processing of only changed records
• Support for incremental updates & deletions
• Petabyte-scale data across 1,000+ pipelinesWin: optimized cost & efficiency!
Read the architectural deep dive on InfoQ 👉 https://bit.ly/4rMJB2H
-
#Pinterest launched a next-gen CDC-based ingestion framework.
Using #ApacheKafka, #ApacheFlink, #ApacheSpark & #ApacheIceberg, they achieved:
• Latency cut from 24+ hours to 15 minutes
• Processing of only changed records
• Support for incremental updates & deletions
• Petabyte-scale data across 1,000+ pipelinesWin: optimized cost & efficiency!
Read the architectural deep dive on InfoQ 👉 https://bit.ly/4rMJB2H
-
#Pinterest launched a next-gen CDC-based ingestion framework.
Using #ApacheKafka, #ApacheFlink, #ApacheSpark & #ApacheIceberg, they achieved:
• Latency cut from 24+ hours to 15 minutes
• Processing of only changed records
• Support for incremental updates & deletions
• Petabyte-scale data across 1,000+ pipelinesWin: optimized cost & efficiency!
Read the architectural deep dive on InfoQ 👉 https://bit.ly/4rMJB2H
-
#Pinterest launched a next-gen CDC-based ingestion framework.
Using #ApacheKafka, #ApacheFlink, #ApacheSpark & #ApacheIceberg, they achieved:
• Latency cut from 24+ hours to 15 minutes
• Processing of only changed records
• Support for incremental updates & deletions
• Petabyte-scale data across 1,000+ pipelinesWin: optimized cost & efficiency!
Read the architectural deep dive on InfoQ 👉 https://bit.ly/4rMJB2H
-
#Pinterest launched a next-gen CDC-based ingestion framework.
Using #ApacheKafka, #ApacheFlink, #ApacheSpark & #ApacheIceberg, they achieved:
• Latency cut from 24+ hours to 15 minutes
• Processing of only changed records
• Support for incremental updates & deletions
• Petabyte-scale data across 1,000+ pipelinesWin: optimized cost & efficiency!
Read the architectural deep dive on InfoQ 👉 https://bit.ly/4rMJB2H
-
Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems
-
Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems
-
Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems
-
Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems
-
Apache Kafka 4.2.0 is here – and it’s a big one. The headliner? Queues for Kafka (KIP-932) is officially GA. This means you can finally use Kafka for classic "competing consumer" queuing patterns without the rigid constraints of partition assignments.
But there is much more:#ApacheKafka #Kafka42 #EventStreaming #DataEngineering #DistributedSystems
-
#Uber has open-sourced #uForwarder - a push-based #ApacheKafka consumer proxy built to handle trillions of messages & multiple petabytes of data daily.
uForwarder introduces:
🔹 Context-aware routing
🔹 Head-of-line blocking mitigation
🔹 Adaptive auto-rebalancing
🔹 Partition-level delay processingThe result ❓ Read #InfoQ to find out: https://bit.ly/4u9T2Lg
#SoftwareArchitecture #EventDrivenArchitecture #Microservices #DistributedSystems #OpenSource
-
Check out what's new in the #Spring community 👉 https://bit.ly/4kZSJyw
The second milestone releases of: Spring Boot, Spring Security, Spring Integration, Spring Modulith and Spring AMQP; along with the first milestone releases of Spring Session, Spring for Apache Kafka and Spring LDAP.
#Java #SpringBoot #SpringData #SpringSecurity #SpringAMQP #ApacheKafka
-
Check out what's new in the #Spring community 👉 https://bit.ly/4kZSJyw
The second milestone releases of: Spring Boot, Spring Security, Spring Integration, Spring Modulith and Spring AMQP; along with the first milestone releases of Spring Session, Spring for Apache Kafka and Spring LDAP.
#Java #SpringBoot #SpringData #SpringSecurity #SpringAMQP #ApacheKafka
-
Check out what's new in the #Spring community 👉 https://bit.ly/4kZSJyw
The second milestone releases of: Spring Boot, Spring Security, Spring Integration, Spring Modulith and Spring AMQP; along with the first milestone releases of Spring Session, Spring for Apache Kafka and Spring LDAP.
#Java #SpringBoot #SpringData #SpringSecurity #SpringAMQP #ApacheKafka
-
Check out what's new in the #Spring community 👉 https://bit.ly/4kZSJyw
The second milestone releases of: Spring Boot, Spring Security, Spring Integration, Spring Modulith and Spring AMQP; along with the first milestone releases of Spring Session, Spring for Apache Kafka and Spring LDAP.
#Java #SpringBoot #SpringData #SpringSecurity #SpringAMQP #ApacheKafka
-
𝗞𝗮𝗳𝗸𝗮𝗛𝗤:
https://thewhale.cc/posts/kafkahq
KafkaHQ is an open source GUI for Apache Kafka. Kafka GUI for topics, topics data, consumers group and more...
-
#LinkedIn just upgraded its legacy ZooKeeper service discovery platform to enhance scalability & performance.
How❓ By leveraging #ApacheKafka & the xDS protocol.
The result❓ The new architecture enables eventual consistency, supports multiple languages, and allows migration without downtime.Details here ⇨ https://bit.ly/3NRZFRP
-
Becoming a Confluent Elite Partner is an important milestone for SoftwareMill.
We are one of the few companies in Europe and the only one in Poland to hold this title. It showcases our extensive experience in helping organizations build scalable data platforms and fully harness the potential of continuous data flow using the Confluent platform and Apache Kafka-powered solutions.
👉 Learn more about our experience and services: sml.io/confluent-partner
-
Becoming a Confluent Elite Partner is an important milestone for SoftwareMill.
We are one of the few companies in Europe and the only one in Poland to hold this title. It showcases our extensive experience in helping organizations build scalable data platforms and fully harness the potential of continuous data flow using the Confluent platform and Apache Kafka-powered solutions.
👉 Learn more about our experience and services: sml.io/confluent-partner