home.social

#kafka — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #kafka, aggregated by home.social.

  1. The Architecture Decisions CAIOs Cannot Delegate to Engineering

    Architecture decisions, batch versus online prediction, cloud versus edge, offline versus online learning, coupled versus decoupled models. determine whether an AI system scales safely or collapses under real-world use. CAIOs and architects who get these trade-offs wrong don't get bad models; they get expensive rebuilds, stale predictions, or systems that optimize for outrage instead of value.

    hernanhuwyler.wordpress.com/20

  2. The Architecture Decisions CAIOs Cannot Delegate to Engineering

    Architecture decisions, batch versus online prediction, cloud versus edge, offline versus online learning, coupled versus decoupled models. determine whether an AI system scales safely or collapses under real-world use. CAIOs and architects who get these trade-offs wrong don't get bad models; they get expensive rebuilds, stale predictions, or systems that optimize for outrage instead of value.

    hernanhuwyler.wordpress.com/20

  3. The Architecture Decisions CAIOs Cannot Delegate to Engineering

    Architecture decisions, batch versus online prediction, cloud versus edge, offline versus online learning, coupled versus decoupled models. determine whether an AI system scales safely or collapses under real-world use. CAIOs and architects who get these trade-offs wrong don't get bad models; they get expensive rebuilds, stale predictions, or systems that optimize for outrage instead of value.

    hernanhuwyler.wordpress.com/20

  4. The Architecture Decisions CAIOs Cannot Delegate to Engineering

    Architecture decisions, batch versus online prediction, cloud versus edge, offline versus online learning, coupled versus decoupled models. determine whether an AI system scales safely or collapses under real-world use. CAIOs and architects who get these trade-offs wrong don't get bad models; they get expensive rebuilds, stale predictions, or systems that optimize for outrage instead of value.

    hernanhuwyler.wordpress.com/20

  5. The Architecture Decisions CAIOs Cannot Delegate to Engineering

    Architecture decisions, batch versus online prediction, cloud versus edge, offline versus online learning, coupled versus decoupled models. determine whether an AI system scales safely or collapses under real-world use. CAIOs and architects who get these trade-offs wrong don't get bad models; they get expensive rebuilds, stale predictions, or systems that optimize for outrage instead of value.

    hernanhuwyler.wordpress.com/20

  6. 📢 Data Prepper 2.16 is out!
    It's got some highlights around , , pull-based ingestion and more:
    ▶️ scrape Prometheus metrics with pull-based ingestion
    ▶️ direct time-series (metrics) data ingestion for the TSDB engine
    ▶️ support for pull-based ingestion (using Apache topic or similar)
    ▶️ support for logs & traces in the OTLP sink

    release blog:
    lnkd.in/d4StMYDP
    @OpenSearchProject

  7. Kafka Consumer в тестовой автоматизации: архитектурный разбор

    Привет, Хабр! На связи Егор Лаптев — QA Fullstack Java в SENSE на проекте крупного российского банка. End-to-end тесты UI проверяют только то, что видно на экране: кнопка нажалась, форма открылась, данные отобразились. Но в распределённых системах значительная часть бизнес-логики уходит за кадр — в асинхронные события, которые летят через Kafka. Если событие не дошло до топика или пришло с неверным payload, пользователь этого не увидит, а бизнес-процесс сломается. В этой статье расскажу, как мы научились проверять Kafka-события прямо в автотестах — без Kafka UI, kcat и обёрточных сервисов, одной зависимостью и так, чтобы это работало в корпоративной сети с SSL. Покажу архитектуру коннектора, разберу три основных проблемы (SSL-сертификаты, конфликты consumer group и асинхронные тайминги), и поделюсь моделью работы инженера в связке с AI-агентом. Кому будет полезно: QA-инженерам и специалистам по автоматизации, которые тестируют распределённые системы и хотят проверять Kafka-события прямо в автотестах; и инженерам, которым интересна практическая модель работы в связке с AI-агентом — как она ускоряет разработку тестовой инфраструктуры.

    habr.com/ru/companies/it_sense

    #kafka #kafka_consumer #kafka_в_тестировании #qa_automation #sasl #асинхронное_тестирование #aiагенты #allure #consumer_group #распределенные_системы

  8. I wrote up a quick how-to for running data backups inside a Kubernetes cluster using CronJobs. I wish it was as simple as a crontab + bash script like the olden days, but it works well enough. It is nice how declarative and stateless it is though!

    nbailey.ca/post/backup-k8s-cro

    #kubernetes #backup #backups #cronjob #postgres #postgresql #kafka #aws #s3 #eks #bash #terraform #sysadmin #linux #blog #blogpost

  9. "A #minissérie austríaca #Kafka, que celebra a vida e o legado de um dos mais importantes escritores do século XX, tem estreia marcada já para o dia 12 de outubro na #RTP2.

    A série, escrita por #DanielKehlmann e realizada por #DavidSchalko, conta com seis episódios que exploram a complexa vida de Franz Kafka (1883-1924), destacando os seus “tumultuosos casos amorosos com Felice Bauer, Milena Jesenska e Dora Diamant, a relação tensa com o pai autoritário e (...)"

    seriesdatv.pt/noticias/estreia

  10. Join us in #Lucerne on October 15, 2025 for an exciting talk by Viktor Gamov about #StreamProcessing with #Apache #Flink!

    Stream processing has come a long way. Today’s systems handle strict correctness guarantees, low latency, and terabytes of state. In this talk, Viktor will introduce #ApacheFlink, explain concepts like stateful and event-time stream processing, and explore its APIs and ecosystem.

    More info & registration: jug.ch/html/events/2025/statef

    #Java #Flink #Kafka #CloudNative

  11. ⚡ Process streaming data with #PyFlink + #FlinkSQL.

    See how to build pipelines using PyFlink Table API, #UDFs & #SQL—no JVM needed. Watch Diptiman Raichaudhuri demo windowing, event time processing & real-time #Kafka stream ingestion.

    🎥 Click here: youtu.be/PnpHp3Y12xw
    #StreamProcessing #FOSSASIA #OpenSource

  12. Our tech experts & business representatives are ready to discuss your ideas and needs! See where you can meet them this month:

    Current London: Michał Matłoka & Marcin Głasek
    Kotlin Conf 2025: Rafał Maciak
    CTO Craft Toronto: Tomasz Szymański & Konrad Łucka

    #ctocraft #datastreaminf #kotlin #java #kafka #confluent #cto

  13. Für manch Einen ist es gar #Kafka
    der das Herz erbeben lässt
    Für andere ist es im #Sommer
    ein rauschendes Wiesenfest

    Ich bin #verliebt in das Leben
    die Vielfalt, die es erbringt
    Es hat so viele Facetten
    dass mein Herz Koloratur singt

    #Reimbattle #poetry

    @poetry

  14. Ingest data from to @AzDataExplorer
    Day59

    The sink connector makes ingestion from , code free and configuration based, scalable and fault tolerant, easy to deploy, manage and monitor.

    Learn More: learn.microsoft.com/en-us/azur