Search
65 results for “ApacheKafka”
-
Kafka Streaming for Cyber Security 🔐🚀
Built a multi-source streaming engine pushing to Kafka:
• Network logs – CICIDS2017 style (500/sec, 5% attacks)
• User activity – Insider threat patterns (50/sec)
• System events – ADFA-LD host intrusions (200/sec)
• Correlated alerts – Real-time threat detectionAttack simulation: DDoS, Botnet, Web Shell, Rootkit
Kafka = Perfect for SIEM data ingestion! 📊
-
Becoming a Confluent Elite Partner is an important milestone for SoftwareMill.
We are one of the few companies in Europe and the only one in Poland to hold this title. It showcases our extensive experience in helping organizations build scalable data platforms and fully harness the potential of continuous data flow using the Confluent platform and Apache Kafka-powered solutions.
👉 Learn more about our experience and services: sml.io/confluent-partner
-
Becoming a Confluent Elite Partner is an important milestone for SoftwareMill.
We are one of the few companies in Europe and the only one in Poland to hold this title. It showcases our extensive experience in helping organizations build scalable data platforms and fully harness the potential of continuous data flow using the Confluent platform and Apache Kafka-powered solutions.
👉 Learn more about our experience and services: sml.io/confluent-partner
-
Join the Apache Kafka x Apache Pinot meetup hosted by VirtusLab and featuring @adamwarski
The event will take place on November 26th from 6:00 p.m. to 8:00 p.m. in Kraków. Register here: https://www.meetup.com/krakow-kafka/events/304395169/?eventOrigin=group_events_list
-
Join the Apache Kafka x Apache Pinot meetup hosted by VirtusLab and featuring @adamwarski
The event will take place on November 26th from 6:00 p.m. to 8:00 p.m. in Kraków. Register here: https://www.meetup.com/krakow-kafka/events/304395169/?eventOrigin=group_events_list
-
📚 Translating #ApacheKafka messages from JSON to AVRO allows you to use #KafkaConnect sink connectors which require a schema, like the JDBC one.
📽️ Check how to convert messages with #ApacheFlink https://www.youtube.com/watch?v=FED4u6er9DE
-
📚 Translating #ApacheKafka messages from JSON to AVRO allows you to use #KafkaConnect sink connectors which require a schema, like the JDBC one.
📽️ Check how to convert messages with #ApacheFlink https://www.youtube.com/watch?v=FED4u6er9DE
-
Need to sink data including timestamps from #ApacheKafka to #opensearch via #KafkaConnect?
Maybe you need a dedicated TimestampConverter SMT!
https://ftisiot.net/posts/kafka_connect_sink_elasticsearch_opensearch_timestamp/
-
Need to sink data including timestamps from #ApacheKafka to #opensearch via #KafkaConnect?
Maybe you need a dedicated TimestampConverter SMT!
https://ftisiot.net/posts/kafka_connect_sink_elasticsearch_opensearch_timestamp/
-
Ingest data from #ApacheKafka to @AzDataExplorer
#365daysofADX Day59The #ADX #KafkaConnect sink connector makes ingestion from #Kafka, code free and configuration based, scalable and fault tolerant, easy to deploy, manage and monitor.
Learn More: https://learn.microsoft.com/en-us/azure/data-explorer/ingest-data-kafka
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architecturesRead the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
-
#Uber has open-sourced #uForwarder - a push-based #ApacheKafka consumer proxy built to handle trillions of messages & multiple petabytes of data daily.
uForwarder introduces:
🔹 Context-aware routing
🔹 Head-of-line blocking mitigation
🔹 Adaptive auto-rebalancing
🔹 Partition-level delay processingThe result ❓ Read #InfoQ to find out: https://bit.ly/4u9T2Lg
#SoftwareArchitecture #EventDrivenArchitecture #Microservices #DistributedSystems #OpenSource
-
#Uber has open-sourced #uForwarder - a push-based #ApacheKafka consumer proxy built to handle trillions of messages & multiple petabytes of data daily.
uForwarder introduces:
🔹 Context-aware routing
🔹 Head-of-line blocking mitigation
🔹 Adaptive auto-rebalancing
🔹 Partition-level delay processingThe result ❓ Read #InfoQ to find out: https://bit.ly/4u9T2Lg
#SoftwareArchitecture #EventDrivenArchitecture #Microservices #DistributedSystems #OpenSource
-
Very cool post how to handle schemaless data and still use the JDBC Sink Connector:
https://www.kineticedge.io/blog/jdbc-sink-noschema/
Especially useful for Confluent Cloud.
Oh, I got the link to the post from @MickaelMaison toot:
-
If you’re trying to get #Database data into #ApacheKafka, you might be using the JDBC Source connector
This 🎥 explains the various modes you can use
More info at https://ftisiot.net/talks/kafka-jdbc-what-can-go-wrong/
-
If you’re trying to get #Database data into #ApacheKafka, you might be using the JDBC Source connector
This 🎥 explains the various modes you can use
More info at https://ftisiot.net/talks/kafka-jdbc-what-can-go-wrong/
-
Sometimes defining #KafkaConnect connectors can seem like dark magic 🧙♂️
Check out the 8 tips to have a better developer experience
-
One Open-source Project Daily
Change data capture for a variety of databases.
https://github.com/debezium/debezium
#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer -
One Open-source Project Daily
Change data capture for a variety of databases.
https://github.com/debezium/debezium
#1ospd #opensource #apachekafka #cdc #changedatacapture #datapipeline #database #debezium #eventstreaming #kafka #kafkaconnect #kafkaproducer -
#CaseStudy - Karrot replaced its legacy recommendation system with a new scalable architecture powered by multiple AWS services.
The shift addresses issues of tight coupling, limited scalability, and poor reliability in the previous setup - moving to a distributed, event-driven design built on scalable cloud infrastructure.
🔗 Learn how they did it: https://bit.ly/4pzELow
#AWS #EventDrivenArchitecture #DistributedCache #ApacheKafka #InfoQ
-
#CaseStudy - Karrot replaced its legacy recommendation system with a new scalable architecture powered by multiple AWS services.
The shift addresses issues of tight coupling, limited scalability, and poor reliability in the previous setup - moving to a distributed, event-driven design built on scalable cloud infrastructure.
🔗 Learn how they did it: https://bit.ly/4pzELow
#AWS #EventDrivenArchitecture #DistributedCache #ApacheKafka #InfoQ
-
Dive into the latest releases from #Spring 👉 https://bit.ly/3K9wRmf
GA releases of Spring Boot, Spring Security, Spring for GraphQL, Spring Integration, Spring Modulith, Spring REST Docs and Spring Batch.
#Java #SpringBoot #SpringSecurity #SpringFramework #ApacheKafka #AMQP #GraphQL
