#1brc — Public Fediverse posts

Thanks for attending my talk. More than 200 people showed up. It was a blast. Thanks for all the positive feedback.

And yes, it is still Java code, but highly optimized. :)

As promised, the slides: https://training.xceptance.com/java/460-the-first-80p-of-1BRC-parallel-edition.html

#1brc #talk #jcon2026 #performance #java

And of course, I am still fiddling with my presentation for @jcon

Almost 40 different ways to multithread the #1brc. Most of them are stupid of course, but it is about learning and understanding why, not just saying "Tata". The journey is our goal.

#jcon2026

Wie schnell kann #Java 1 Mrd. Zeilen (13,8GB) verarbeiten – ohne „Wettbewerbs-Code“? @ReneSchwietzke zeigt die ersten 80%: weniger Allokationen, bessere I/O, schnelleres Parsing.

Lies es für Praxis-Optimierungen statt Hype: https://javapro.io/de/1brc-die-ersten-80-performance/

#JVM #Performance #1BRC

Discover how #DataFrames serve as a vital tool for data-oriented programming in the #Java ecosystem.

By analyzing The One Billion Row Challenge, Vladimir Zakharov shares how Java frameworks can outperform Python in memory management while maintaining code readability.

Discover how DataFrames elevate your Java programming experience in this #InfoQ video.

🎬 Watch now | 📄 #transcript included ⇨ https://bit.ly/3MeWqDr

#DataOrientedProgramming #1BRC

Wie schnell kann #Java 1 Mrd. Zeilen (13,8GB) verarbeiten – ohne „Wettbewerbs-Code“? @ReneSchwietzke zeigt die ersten 80%: weniger Allokationen, bessere I/O, schnelleres Parsing.

Lies es für Praxis-Optimierungen statt Hype: https://javapro.io/de/1brc-die-ersten-80-performance/

#JVM #Performance #1BRC

Do you remember the #1BRC? When I asked AI back in 2024 for a solution, I got a normal stream suggestion or something similar as a plain Java loop. When I ask AI now, I get the winning solution or parts of it suggested. Even if I try to exclude these, it always wants to come back to some of these rather cutting-edge-hacky solutions.

So, no open source means no AI programming helpers or agents. More AI programmed content means no new ideas and no innovation. At least for now!

Did #AI write better Java? The experiment's back—#1BRC tests #IDE battles & hallucination. #Zencoder #JetBrains shine, but the flaws are surprising. All about context, integration #parsing. Read Steve Poole´s article now: https://javapro.io/2025/01/15/maximize-productivity-with-ai-tools-in-java-development/

#DevTools #LLM

Did #AI write better Java? The experiment's back—#1BRC tests #IDE battles & hallucination. #Zencoder #JetBrains shine, but the flaws are surprising. All about context, integration #parsing. Read Steve Poole´s article now: https://javapro.io/2025/01/15/maximize-productivity-with-ai-tools-in-java-development/

#DevTools #LLM

Did #AI write better Java? The experiment's back—#1BRC tests #IDE battles & hallucination. #Zencoder #JetBrains shine, but the flaws are surprising. All about context, integration #parsing. Read Steve Poole´s article now: https://javapro.io/2025/01/15/maximize-productivity-with-ai-tools-in-java-development/

#DevTools #LLM

Did #AI write better Java? The experiment's back—#1BRC tests #IDE battles & hallucination. #Zencoder #JetBrains shine, but the flaws are surprising. All about context, integration #parsing. Read Steve Poole´s article now: https://javapro.io/2025/01/15/maximize-productivity-with-ai-tools-in-java-development/

#DevTools #LLM

Did #AI write better Java? The experiment's back—#1BRC tests #IDE battles & hallucination. #Zencoder #JetBrains shine, but the flaws are surprising. All about context, integration #parsing. Read Steve Poole´s article now: https://javapro.io/2025/01/15/maximize-productivity-with-ai-tools-in-java-development/

#DevTools #LLM

Dive into the latest InfoQ #Java #TrendsReport with Ixchel Ruiz & Gunnar Morling!

🔍 Topics covered:
➡️ Benefits of Java's six-month release cadence
➡️ Project Lilliput & compact object headers
➡️ Nullability in Java
➡️ Python's impact on the Java ecosystem
➡️ The One Billion Row Challenge

🎧 Listen now 👉 https://bit.ly/3VP0xaF

💪 Knowledge is power! #StayAhead #StayInformed #SoftwareTrends

#InfoQ #ProjectLiliput #Python #OneBillionRowChallenge #1BRC

1 billion lines of code? No problem for AI, right? An AI didn't want to program! Steve Poole convinced it. Read his surprising results: https://javapro.io/2024/11/07/1-billion-record-challenge-ai-style/

#AI #1BRC #Java #ChatGpt #ClaudeAI #Codeium #Jetbrains #JAVAPRO

1BRC Coding Challenge: Nerd Sniping the Java Community
https://www.infoq.com/presentations/1brc/
#ycombinator #1brc #Development #Architecture_Design #ML_Data_Engineering #InfoQ_Dev_Summit_Munich_2024 #Java #InfoQ_Dev_Summit #Transcripts #QCon_Software_Development_Conference #Streaming #InfoQ #Data

1BRC Coding Challenge: Nerd Sniping the Java Community
https://www.infoq.com/presentations/1brc/
#ycombinator #1brc #Development #Architecture_Design #ML_Data_Engineering #InfoQ_Dev_Summit_Munich_2024 #Java #InfoQ_Dev_Summit #Transcripts #QCon_Software_Development_Conference #Streaming #InfoQ #Data

1BRC Coding Challenge: Nerd Sniping the Java Community
https://www.infoq.com/presentations/1brc/
#ycombinator #1brc #Development #Architecture_Design #ML_Data_Engineering #InfoQ_Dev_Summit_Munich_2024 #Java #InfoQ_Dev_Summit #Transcripts #QCon_Software_Development_Conference #Streaming #InfoQ #Data

1BRC Coding Challenge: Nerd Sniping the Java Community
https://www.infoq.com/presentations/1brc/
#ycombinator #1brc #Development #Architecture_Design #ML_Data_Engineering #InfoQ_Dev_Summit_Munich_2024 #Java #InfoQ_Dev_Summit #Transcripts #QCon_Software_Development_Conference #Streaming #InfoQ #Data

The #OneBillionRowChallenge (#1BRC) went viral in the Java community earlier this year.

In this #InfoQ talk, Gunnar Morling dives into some of the tricks employed by the fastest solutions for processing the challenge’s 13 GB input file within less than two seconds.

Expect insights into:
• Parallelization and efficient memory access
• Optimized parsing routines with SIMD/SWAR
• Custom map implementations

He also shares personal stories and key takeaways from leading this challenge for and with the community.

A must-watch video: https://bit.ly/3Yl7y3v

#transcript included

#Java #EventStreming #ChangeDataCapture #SoftwareArchitecture #DataEngineering

The #OneBillionRowChallenge (#1BRC) went viral in the Java community earlier this year.

In this #InfoQ talk, Gunnar Morling dives into some of the tricks employed by the fastest solutions for processing the challenge’s 13 GB input file within less than two seconds.

Expect insights into:
• Parallelization and efficient memory access
• Optimized parsing routines with SIMD/SWAR
• Custom map implementations

He also shares personal stories and key takeaways from leading this challenge for and with the community.

A must-watch video: https://bit.ly/3Yl7y3v

#transcript included

#Java #EventStreming #ChangeDataCapture #SoftwareArchitecture #DataEngineering

The #OneBillionRowChallenge (#1BRC) went viral in the Java community earlier this year.

In this #InfoQ talk, Gunnar Morling dives into some of the tricks employed by the fastest solutions for processing the challenge’s 13 GB input file within less than two seconds.

Expect insights into:
• Parallelization and efficient memory access
• Optimized parsing routines with SIMD/SWAR
• Custom map implementations

He also shares personal stories and key takeaways from leading this challenge for and with the community.

A must-watch video: https://bit.ly/3Yl7y3v

#transcript included

#Java #EventStreming #ChangeDataCapture #SoftwareArchitecture #DataEngineering

The #OneBillionRowChallenge (#1BRC) went viral in the Java community earlier this year.

In this #InfoQ talk, Gunnar Morling dives into some of the tricks employed by the fastest solutions for processing the challenge’s 13 GB input file within less than two seconds.

Expect insights into:
• Parallelization and efficient memory access
• Optimized parsing routines with SIMD/SWAR
• Custom map implementations

He also shares personal stories and key takeaways from leading this challenge for and with the community.

A must-watch video: https://bit.ly/3Yl7y3v

#transcript included

#Java #EventStreming #ChangeDataCapture #SoftwareArchitecture #DataEngineering

The #OneBillionRowChallenge (#1BRC) went viral in the Java community earlier this year.

In this #InfoQ talk, Gunnar Morling dives into some of the tricks employed by the fastest solutions for processing the challenge’s 13 GB input file within less than two seconds.

Expect insights into:
• Parallelization and efficient memory access
• Optimized parsing routines with SIMD/SWAR
• Custom map implementations

He also shares personal stories and key takeaways from leading this challenge for and with the community.

A must-watch video: https://bit.ly/3Yl7y3v

#transcript included

#Java #EventStreming #ChangeDataCapture #SoftwareArchitecture #DataEngineering

TIL about the #1brc ...

Hope to see you tomorrow!

For all #1brc fans, we will lay the basic foundation for that exercise, without elaborating on tuning, by seeing the magic of the JVM and hardware... because it will hit us when benchmarking too naively.
@Devoxx #jmh #1brc

Created a repo with the step-by-step progress of the fastest #1brc solution. Key takeaways:

- @graalvm JIT provides 8+% for free. 🚀
- Parallellize and optimize data structures to get 95% of the way.
- Squeeze out the max by understanding the CPU.

https://github.com/thomaswue/1brc-steps

Wer meinen Vortrag zu den ersten 80% der #1brc in Stuttgart verpasst hat, hat auf der #JavaForumNord die Chance, es nachzuholen. Ich freue mich auf Fragen und Diskussionen.

"Die 1 Milliarde Zeilen Herausforderung - #1BRC - Die ersten 80%"

Story of 1 Billion rows of data, where it is started from and how it is ended, incredible, in short, this video is saying never stop optimizing in #java or any language, we should improve ourselves and the code should work faster and faster. Thanks to @royvanrijn to collect all story in this video and keeping up with #1brc, Also respect to @graalvm feels like future of Java is bright. To be honest, I will rewatch/study this video more 🤓 hard to comprehend at first watch.

https://youtu.be/EFXxXFHpS0M?si=wQRPjEpYPM4T-CY_

#jfs2024 Vielen Dank an alle, die meinen Talk besucht haben und auch vielen Dank für die Interaktionen. Super Schätzungen teilweise. #1brc

Nicht vergessen, 11:10 CEST im Schiller-Saal gibt es "Die ersten 80% des 1 Milliarde Zeilen Wettbewerbs #1brc" zu sehen. Freue mich auf rege Teilnahme und jede Menge Fragen. Ich werde nach Schätzungen fragen, damit es nicht langweilig wird. Jeder wird aus den ersten 80% etwas mitnehmen können, versprochen.

#jfs2024

https://www.java-forum-stuttgart.de/vortraege/die-1-milliarde-zeilen-herausforderung-1brc/

Waiting for my train to Java Forum Stuttgart. Join me for my talk about the first 80% of the #1BRC.

https://www.java-forum-stuttgart.de/vortraege/die-1-milliarde-zeilen-herausforderung-1brc/

German followers, for your schedule, in case you can make it and attend one of my upcoming talks.

18 July 2024, JUG Darmstadt, "Microbenchmarks - Wer misst, misst Mist."
https://www.jug-da.de/2024/07/microbenchmarks/

31 July 2024, Java Forum Stuttgart, "Die 1 Milliarde Zeilen Herausforderung – #1brc"
https://www.java-forum-stuttgart.de/vortraege/die-1-milliarde-zeilen-herausforderung-1brc/

Hope to meet you soon in real life.

As usual, the slides for instant consumption: "#1BRC - THE FIRST 80% How to Read One Billion Rows Fast Enough". Thanks to the audience and thanks to all who came up and asked questions.

https://training.xceptance.com/java/450-the-first-80p-of-1BRC-2024.html

#dexoxxpl @devoxxpl

Join me for "The First 80% of Reading One Billion Rows Really Fast - #1BRC" on Thursday, 20 June 2024, 14:40 CEST at #DevoxxPL
https://devoxx.pl/talk-details/?id=5039

Join me for "The First 80% of Reading One Billion Rows Really Fast - #1BRC" on Thursday, 20 June 2024, 14:40 CEST at #DevoxxPL
https://devoxx.pl/talk-details/?id=5039

Join me for "The First 80% of Reading One Billion Rows Really Fast - #1BRC" on Thursday, 20 June 2024, 14:40 CEST at #DevoxxPL
https://devoxx.pl/talk-details/?id=5039

Join me for "The First 80% of Reading One Billion Rows Really Fast - #1BRC" on Thursday, 20 June 2024, 14:40 CEST at #DevoxxPL
https://devoxx.pl/talk-details/?id=5039

Join me for "The First 80% of Reading One Billion Rows Really Fast - #1BRC" on Thursday, 20 June 2024, 14:40 CEST at #DevoxxPL
https://devoxx.pl/talk-details/?id=5039

Nice video for pure Java perf-hacks 💪🏼 Remember that 1-billion row challenge a few months ago. https://youtube.com/watch?v=9-S_nZ5gzGE

Learning points: my bit-ops need refreshing 😅

#1brc

My #rustlang implementation for the 1 Billion Row Challenge:
https://github.com/mtelahun/onebrc-rs

No special optimizations other than using ArrayString from the arrayvec crate to minimize string allocations on the heap. On my workstation it's nearly 100 sec. faster than the reference java implementation.

#1brc

Also new today: The last chapters added to the #MEAP for #DuckDB in Action, including the appendix in which I wrote a bit about using DuckDB from #Java. I used the #1BRC by @gunnarmorling as an example.

https://www.manning.com/books/duckdb-in-action

Now the whole things just need to make its way through the print production.

#Happy

Wednesday Links - Edition 2024-03-06
https://dev.to/0xkkocel/wednesday-links-edition-2024-03-06-53d1
#java #jvm #loom #zgc #spring #1BRC #kotlin

12 Lessons Learned From Doing The One Billion Row Challenge: How fast can you process a 1 billion rows text file in Java?

#1brc #foojay #java

https://foojay.io/today/12-lessons-learned-from-doing-the-one-billion-row-challenge/?utm_medium=erik.in&utm_source=mastodon

@sasuke___420 Hi, have you already submitted a solution? After #AdventOfCode I decided not to get nerd-sniped by #1brc but I did run a few of the earlier leading OpenJDK-based solutions through #JITWatch and found you could squeeze out some single digit percentage gains by changing the JVM options that control inlining.

Should I works on #harss a bit? It's been a while...

...Naaaaah let's try to gain 0.02 seconds on my #1brc in #rust

Should I works on #harss a bit? It's been a while...

...Naaaaah let's try to gain 0.02 seconds on my #1brc in #rust

Should I works on #harss a bit? It's been a while...

...Naaaaah let's try to gain 0.02 seconds on my #1brc in #rust

Should I works on #harss a bit? It's been a while...

...Naaaaah let's try to gain 0.02 seconds on my #1brc in #rust

Should I works on #harss a bit? It's been a while...

...Naaaaah let's try to gain 0.02 seconds on my #1brc in #rust

I've just released #JITWatch 1.4.9 binaries which rolls up a lot of fixes and makes the sandbox easier to use with external source files (such as #1brc).

https://github.com/AdoptOpenJDK/jitwatch/releases/tag/1.4.9

Learn about how the #Java #JVM JIT compilers optimise your program at runtime using techniques like inlining, intrinsics, escape analysis, DCE, lock elision, loop unrolling, vectorisation, and lots more :)