#azuredataexplorer — Public Fediverse posts

Storing events is easy. Turning them into actionable insights in real-time? That’s where ADX shines. Follow along with a simple demo to ingest data in real-time ready for querying.
#lowlatencyanalytics #azuredataexplorer #adx #eventanalytics
https://snape.me/2025/12/event-streams-need-analytics/

Storing events is easy. Turning them into actionable insights in real-time? That’s where ADX shines. Follow along with a simple demo to ingest data in real-time ready for querying.
#lowlatencyanalytics #azuredataexplorer #adx #eventanalytics
https://snape.me/2025/12/event-streams-need-analytics/

Storing events is easy. Turning them into actionable insights in real-time? That’s where ADX shines. Follow along with a simple demo to ingest data in real-time ready for querying.
#lowlatencyanalytics #azuredataexplorer #adx #eventanalytics
https://snape.me/2025/12/event-streams-need-analytics/

Discover why Azure Data Explorer (ADX) outperforms Cosmos DB for event stream analytics. Learn why ADX should be your default choice for real-time insights.
https://snape.me/2025/11/adx-hidden-gem/
#lowlatencyanalytics #azuredataexplorer #eventanalytics

Discover why Azure Data Explorer (ADX) outperforms Cosmos DB for event stream analytics. Learn why ADX should be your default choice for real-time insights.
https://snape.me/2025/11/adx-hidden-gem/
#lowlatencyanalytics #azuredataexplorer #eventanalytics

Discover why Azure Data Explorer (ADX) outperforms Cosmos DB for event stream analytics. Learn why ADX should be your default choice for real-time insights.
https://snape.me/2025/11/adx-hidden-gem/
#lowlatencyanalytics #azuredataexplorer #eventanalytics

🚀 Weekly Blog Post Highlights! 📚

🤝Discover the power of #AzureDataExplorer in building a self-serve analytics platform.

🌐 Unlock valuable insights into customer lifetime value (CLV) using the Lakehouse architecture.

🎯 Databricks acquire MosaicML to enhance #generativeAI capabilities for enterprises.

🤝 Dive into the top sessions from #Kafka Summit London 2023!

📊 ACERTUS & Confluent to provide real-time order notifications.

🚚 Don't miss Data Saturday Durban

👉 https://nielsberglund.com/post/2023-07-23-interesting-stuff---week-29-2023/

🌟 Exciting discoveries in this week's blog post! 🌟

🔍 Azure Data Explorer & Kusto Detective Academy #azuredataexplorer #kql

📚 GPT4Readability, for creating README.md files using GPT-3.5 & GPT-4. #python

🚀 Uncover the integration of #Kafka, Debezium, and BentoML

📊 RisingWave vs. Flink #ApacheFlink #RisingWave

🎉 Data Saturday Durban 2023 is just around the corner!

Read all about it here 👉 https://nielsberglund.com/post/2023-07-16-interesting-stuff---week-28-2023/

New post: "Interesting Stuff - Week 19, 2023".

This week:

* @azuredataexplorer as Vector DB! How cool is that!
* Rust Polars; high-performance data analysis.
* Langchain LLM with Streamlit and Pinecone.
* PandasAI, the love child between ChatGPT and Pandas.
* Hubert's next post about the real-time streaming ecosystem. Awesome!
* Real-time sentiment analysis using Kafka and Spark Streaming.

Read all about it:

https://nielsberglund.com/post/2023-05-14-interesting-stuff---week-19-2023/

#AI #ML #kafka #azuredataexplorer #Python

New post: "Interesting Stuff - Week 18, 2023".

This week:

* AI improving their programming abilities using self-play!
* Build ML-driven segmentation using chatbots, ChatGPT and LangChain.
* Use diffusion models to mimic human behaviour.
* Inferring rewards through interaction. Use of IGL-P!
* Confluent Platform 7.4 released. Cool!
* Niels is busy with @azuredataexplorer post

Read all about it:

https://nielsberglund.com/post/2023-05-07-interesting-stuff---week-18-2023/

#AI #ML #kafka #azuredataexplorer #openai

New post: "Interesting Stuff - Week 17, 2023".

This week:

* The gambler that beat roulette!
* I finally created a repo covering how to stream data from Kafka to @azuredataexplorer.
* Real-time ML pipelines.
* Databricks and Hugging Face, love is in the air.
* Very interesting about the real-time streaming ecosystem by Hubert.

Read all about it:

https://nielsberglund.com/post/2023-04-30-interesting-stuff---week-17-2023/

#AI #ML #streaming #kafka #databricks #azuredataexplorer

New post: "Interesting Stuff - Week 16, 2023".

This week:

* How to optimize the Azure Databricks Delta Engine.
* Link to my post about the multi-platform Docker Image for @azuredataexplorer Kusto Sink and Kafka Connect.
* Create Synthetic Data using Generative AI.
* Databricks SQL and the ability to call LLMs!

Read all about it:

https://nielsberglund.com/post/2023-04-23-interesting-stuff---week-16-2023/

#AI #ML #openai #databricks #azuredataexplorer

New post: "Cross-Platform Compatibility Made Easy with Multi-Platform Docker Images: Azure Data Explorer Sink Connector & Kafka Connect"

Docker has revolutionized the way we package and deploy software applications.

However, it's challenging to maintain a single image that can work across multiple platforms.

This blog post explores the steps required to build and deploy multi-platform Docker images.

https://nielsberglund.com/post/2023-04-17-cross-platform-compatibility-made-easy-with-multi-platform-docker-images-azure-data-explorer-sink-connector--kafka-connect/

#kafka #azuredataexplorer #kusto #kafkaconnect

New post: "Interesting Stuff - Week 15, 2023".

This week:

* Generative AI and focus shift from tech-driven dev to product-driven dev.
* Game analytics solution for Game Studios!
* Late arriving events in Flink and ways to handle them.
* Very cool around materialized views.
* Me plugging an upcoming post about how to build multi-platform Docker images.

Read all about it:

https://nielsberglund.com/post/2023-04-16-interesting-stuff---week-15-2023/

#kafka #flink #AI #ML #openai #databricks #azuredataexplorer

New post: "Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - II"

This is the third post about using Kafka and @azuredataexplorer (ADX) to develop a real-time leaderboard for online gaming.

In this post, you will see more about ingesting data into ADX and some "cool stuff" related to that. Specifically, what to do if you need to update/transform the data you ingest.

https://nielsberglund.com/post/2023-04-03-develop-a-real-time-leaderboard-using-kafka-and-azure-data-explorer---ii/

#kafka #azuredataexplorer #kql #kusto

New post: "Interesting Stuff - Week 13, 2023".

This week:

* Cool post about Polars vs Pandas.
* How to ingest data into @azuredataexplorer. Must read!
* How do you do canary releases for data streaming?
* Data streaming and AI/ML - very interesting

Read all about it:

https://nielsberglund.com/post/2023-04-02-interesting-stuff---week-13-2023/

#kafka #python #azuredataexplorer

New post: "Develop a Real-Time Leaderboard Using Kafka and Azure Data Explorer - I"

The second post in a series about using Kafka and @azuredataexplorer
(ADX) to develop a real-time leaderboard for online gaming.

In this post, you will learn more about ADX and why it is an excellent choice for near real-time applications, how to "hook up" Kafka to ADX and how to ingest data into an ADX database using streaming ingestion.

https://nielsberglund.com/post/2023-03-19-develop-a-real-time-leaderboard-using-kafka-and-azure-data-explorer---i/

#kafka #python #docker #azuredataexplorer

New post: "Interesting Stuff - Week 11, 2023".

This week:

* Learn all about @azuredataexplorer and #Kusto, thanks to Akshay Dixit.
* I finally finished the second post in the Leaderboard, Kafka, and ADX series
* ChatGPT and dialogue prompting. Very interesting
* An old colleague of mine -Ted Neward - ponders the impact of AI on developers.
* Where has all the Big Data gone?

Read all about it:

https://nielsberglund.com/post/2023-03-19-interesting-stuff---week-11-2023/

#AzureDataExplorer #KQL #kafka #kafkaconnect #AI #ml #openai

Data Analysis in @azuredataexplorer using #KQL

In this learning path, you will learn through 6 training modules, how to analyze data in #AzureDataExplorer (#ADX) using the #Kusto Query Language (#KQL).

https://learn.microsoft.com/en-us/training/paths/data-analysis-data-explorer-kusto-query-language/

(Reshared from another site 😀)

New post: "Interesting Stuff - Week 9, 2023".

Lots of streaming stuff this week:

* Prompt engineering (again). This one looks at different "frameworks" for prompt engineering.
* Article about stream-processing vs real-time OLAP databases.
* Build data lakes using open-source tools.
* How to combine Spark Structured Streaming with REST APIs.
* Niels is still working on an @azuredataexplorer post.

Read all about it:

https://nielsberglund.com/post/2023-03-05-interesting-stuff---week-9-2023/

#openai #kafka #azuredataexplorer #spark

Ingest data from #Logstash to @AzDataExplorer
#365daysofADX Day60

#AzureDataExplorer (#ADX) Logstash plugin enables you to process events from Logstash into an Azure Data Explorer database for later analysis.

Learn More
[1] https://learn.microsoft.com/en-us/azure/data-explorer/ingest-data-logstash
[2] https://learn.microsoft.com/en-us/azure/data-explorer/connector-overview

Ingest data in @AzDataExplorer using #Telegraf Output Plugin
#365daysofADX Day58

#AzureDataExplorer output supports both streaming and queued ingestion of data from many types of telegraf input plugins into #ADX.

[1] https://lnkd.in/dSPGMmRJ
[2] https://learn.microsoft.com/en-us/azure/data-explorer/connector-overview

New post: "Interesting Stuff - Week 8, 2023".

This week there is a fair chunk of Kafka (plus other stuff):

* Linux containers on Apple Silicone.
* Deep-dive into Microsoft Research LMOps
* Yours truly: Leaderboards, Kafka & @azuredataexplorer - Prelude
* Cool stuff with Mastodon, Kafka and OpenSearch.
* Kafka and Kubernetes.
* Niels, Mike Mallet and Derivco graduates

Read all about it:

https://nielsberglund.com/post/2023-02-26-interesting-stuff---week-8-2023/

#openai #kafka #azuredataexplorer #derivco

Right Anti Join in @AzDataExplorer
#365daysofADX Day50

Right anti-join returns all records from the right side that don't match any record from the left side.

Try: https://lnkd.in/d98BhDNS
Learn More: https://lnkd.in/dKCZpyEe

#ADX #KQL #AzureDataExplorer #Kusto #Azure #Data

Left Anti join in @AzDataExplorer
#365daysofADX Day49

Left anti-join returns all records from the left side that don't match any record from the right side.

Try: https://lnkd.in/dmCi_th4
Learn More: https://lnkd.in/dXg9xTB7

#Kusto #KQL #AzureDataExplorer #Joins #SQL #NoSQL #ADX

Create a dashboard from a query in @AzDataExplorer
#365daysofADX Day43

Dashboards are an excellent way to communicate data science insights visually. You can pin a query as a visual tile in ADX KWE

Learn More: https://lnkd.in/dH4r9NWJ

#KQL #Kusto #AzureDataExplorer #ADX #Azure

Join operator in @AzDataExplorer
#365daysofADX Day42

Merge the rows of two tables to form a new table by matching values of the specified columns from each table.

Run the sample - https://dataexplorer.azure.com/clusters/help/databases/ContosoSales?query=H4sIAAAAAAAAA3MuLS7Jz00tKuaqUcjKz8xTyM7MS7HNzMtLLVIITsxJLXZLTC5RyM9TcIYq9E6tBCotScxOVTA0AABvXAKoPgAAAA==

Learn more: https://learn.microsoft.com/en-us/azure/data-explorer/kusto/query/joinoperator?pivots=azuredataexplorer

#Kusto #KQL #AzureDataExplorer #ADX

#Timechart in @AzDataExplorer
#365daysofADX Day40

The time chart visual is similar to a line chart except the x-axis is always time.

Syntax
T | render timechart [with ( PropertyName = PropertyValue [, ...] )]

#KQL #Kusto #ADX #AzureDataExplorer

https://learn.microsoft.com/en-us/azure/data-explorer/kusto/query/visualization-timechart?pivots=azuredataexplorer

Checkout KQL Search: http://kqlsearch.com
A aggregator for KQL Queries that are shared on GitHub by @UgurKocDe

#KQL #365daysofADX #Kusto #AzureDataExplorer
---
RT @UgurKocDe
I also want to thank the community members that share KQL Learning materials and queries with the Community:
- @reprise_99
- @rodtrent
- @kustonaut
- @BertJanCyber
- @castello_johnny
- @ep3p
- @AzDataExplorer
https://twitter.com/UgurKocDe/status/1622983034889699330

Scatter chart in @AzDataExplorer
#365daysofADX Day37

Scatter plots are used to observe relationships between variables. The scatter chart visual can also be used in the context of Geospatial visualizations.

More: https://learn.microsoft.com/en-us/azure/data-explorer/kusto/query/visualization-scatterchart?pivots=azuredataexplorer

#KQL #ADX #AzureDataExplorer #Kusto

#Areachart in @AzDataExplorer
#365daysofADX Day35

The area chart visual shows a time-series relationship. Area charts are ideal for indicating the change among different data sets.

Learn More: https://learn.microsoft.com/en-us/azure/data-explorer/kusto/query/visualization-areachart?pivots=azuredataexplorer

#KQL #ADX #AzureDataExplorer #Kusto

#Areachart in @AzDataExplorer
#365daysofADX Day35

The area chart visual shows a time-series relationship. Area charts are ideal for indicating the change among different data sets.

Learn More: https://learn.microsoft.com/en-us/azure/data-explorer/kusto/query/visualization-areachart?pivots=azuredataexplorer

#KQL #ADX #AzureDataExplorer #Kusto

Bar chart visual in @AzDataExplorer
#365daysofADX Day34

Learn more: https://learn.microsoft.com/en-us/azure/data-explorer/kusto/query/visualization-barchart?pivots=azuredataexplorer

#KQL #ADX #AzureDataExplorer

Visualize query results within seconds in @AzDataExplorer using render operator
#365daysofADX Day31

Learn More:

Learn Documentation: https://lnkd.in/dAhzUbF9

#KWE #KE #KQL #Kusto #Visualization #AzureDataExplorer #PowerBI #Data #Microsoft #synapseinfluencers #msftadvocate

Visualize query results within seconds in @AzDataExplorer using render operator
#365daysofADX Day31

Learn More:

Learn Documentation: https://lnkd.in/dAhzUbF9

#KWE #KE #KQL #Kusto #Visualization #AzureDataExplorer #PowerBI #Data #Microsoft #synapseinfluencers #msftadvocate

Round values down in @AzDataExplorer using bin function.
#365daysofADX Day30

It returns the nearest multiple of roundTo below value. Null values, a null bin size, or a negative bin size will result in null.

More: https://learn.microsoft.com/en-us/azure/data-explorer/kusto/query/binfunction

#KQL #ADX #Kusto #AzureDataExplorer

Aggregate contents of an input table in @AzDataExplorer using summarize operator.

#365daysofADX Day29

The summarize operator produces a table that aggregates the content of the input table.

Learn more: https://lnkd.in/dhQr2T_Q

#Kusto #KQL #ADX #AzureDataExplorer #synapse

New post: "Interesting Stuff - Week 3, 2023".

So, what do we have for Week 3, 2023:

* Support for Plotly in @azuredataexplorer. Very cool!
* Solution to Case 2 in Kusto Detective Agency. The hardest case for me to solve.
* Benefits and challenges of distributed computing. Very good!
* Comparison of SQL-based streaming technologies. Interesting!
* Time support in Flink.

Read all about it:

https://nielsberglund.com/post/2023-01-22-interesting-stuff---week-3-2023/

#ksqldb #flink #flinksql #ksqldb #distributedcomputing #azuredataexplorer

New post: "Interesting Stuff - XMas, New Year 2022, Week 1 2023".

This post is the "roundup" for holiday period 2022, and week 1 2023. It of a mixed bag of topics:

* The obligatory post about ChatGPT and creating a Python app.
* Tinder for Azure Data Explorer - "Find my partner".
* The big one: Kafka and Flink! I can't help but wonder where this leaves ksqlDB

Read all about it:

https://nielsberglund.com/post/2023-01-08-interesting-stuff---xmas-new-year-2022-week-1-2023/

#apachekafka #ai #ml #chatgpt #azuredataexplorer #azureml

New post: "Interesting Stuff - XMas, New Year 2022, Week 1 2023".

This post is the "roundup" for holiday period 2022, and week 1 2023. It of a mixed bag of topics:

* The obligatory post about ChatGPT and creating a Python app.
* Tinder for Azure Data Explorer - "Find my partner".
* The big one: Kafka and Flink! I can't help but wonder where this leaves ksqlDB

Read all about it:

https://nielsberglund.com/post/2023-01-08-interesting-stuff---xmas-new-year-2022-week-1-2023/

#apachekafka #ai #ml #chatgpt #azuredataexplorer #azureml

New post: "Interesting Stuff - XMas, New Year 2022, Week 1 2023".

This post is the "roundup" for holiday period 2022, and week 1 2023. It of a mixed bag of topics:

* The obligatory post about ChatGPT and creating a Python app.
* Tinder for Azure Data Explorer - "Find my partner".
* The big one: Kafka and Flink! I can't help but wonder where this leaves ksqlDB

Read all about it:

https://nielsberglund.com/post/2023-01-08-interesting-stuff---xmas-new-year-2022-week-1-2023/

#apachekafka #ai #ml #chatgpt #azuredataexplorer #azureml

The Azure Data Explorer team announced support for the Lsv3-series SKUs in June 2022 #AzureDataExplorer #Lsv3-series #SKUs #sharegeneratedinpartwithgpt3 https://techcommunity.microsoft.com/t5/azure-data-explorer-blog/migrate-seamlessly-your-adx-cluster-to-lsv3-series-for-reduced/ba-p/3683328

The Azure Data Explorer team announced support for the Lsv3-series SKUs in June 2022 #AzureDataExplorer #Lsv3-series #SKUs #sharegeneratedinpartwithgpt3 https://techcommunity.microsoft.com/t5/azure-data-explorer-blog/migrate-seamlessly-your-adx-cluster-to-lsv3-series-for-reduced/ba-p/3683328

The Azure Data Explorer team announced support for the Lsv3-series SKUs in June 2022 #AzureDataExplorer #Lsv3-series #SKUs #sharegeneratedinpartwithgpt3 https://techcommunity.microsoft.com/t5/azure-data-explorer-blog/migrate-seamlessly-your-adx-cluster-to-lsv3-series-for-reduced/ba-p/3683328