#p99conf — Public Fediverse posts

#P99CONF is going live in just minutes! Here's a peek at the behind-the-scenes prep. If you haven't registered yet, hurry over to p99conf.io. It's free and virtual, so no excuses. 😅

I'm going to be holding a talk at this years #p99conf about some of the optimization work that I've done earlier at Climatiq, to achieve sub-10ms latencies for some of our endpoints. More details in this short intro video:

https://www.youtube.com/watch?v=6B_bu1aDa2w

I'm speaking at this year's #P99CONF as well! Launching the latest version of my https://0x.tools xcapture tool as promised, using modern eBPF & all the benefits it provides!

"xCapture v3: Efficient, Always-On Thread Level Observability with eBPF"

https://www.p99conf.io/

P99CONF

A virtual conference with 26k participants. Awesome talks. Lively chatrooms compared to most online events. Not vendor driven, but experience focused talks. No technology is left out. The concept of this conference is just so good - and also so simple, yet noone else is doing it. So solid, that I am already looking forward to the next edition.

I wish more conferences would be like this.

#p99conf

Final talk of #p99conf is Jose Fernandez of Netflix, talking about their noisy-neighbor detection work using #ebpf : https://netflixtechblog.com/noisy-neighbor-detection-with-ebpf-64b1f4b3bbdd

I think the first slide here is a good guide for what observability needs in general:
* Has to be always on, rather than spun up after the problem disappears
* Needs to be accessible to the average engineer on the team, not just the lead.

They instrumented the kernel scheduler to measure time on queue, and which processes were getting preempted. (This is the data they put on application engineer dashboards, rather than further refining it -- didn't capture that slide.)

Geography matters! Christian Velazquez at #p99conf, talking about optimizing latency using 3rd-party APIs.

* Connect to the right geographic region
* TLS1.3 to avoid extra round-trip
* HTTP1.1 -> HTTP2 to avoid additional new connection
* It's always DNS -- created a background process to keep the DNS cache warm, avoiding 250ms lookups (!!)
* If your provider is terminating your connection, send some junk traffic to keep the connection open (!!?!)

#performance #api

Big promises from Michael Stonebraker at #p99conf, about DBOS

#OperatingSystems

Interesting performance tools from Tanel Poder at #p99conf: https://0x.tools/

Today's #p99conf keynote was Andy Pavlo on "The Next Chapter in the Sordid Love/Hate Relationship Between DBs and OSes", The talk was about how operating system kernel decisions often work counter to database implementer desires or requirements. He talked about some of the research his doing with #eBPF to move some database functionality into the kernel.

This tension is a familiar refrain, and not a new one. We have been talking about getting the operating system out of the way of database applications for decades, and yet... databases are still mainly deployed on stock Linux.

So what gives? What is missing in efforts like Mirage or DBOS (speaking later today!) https://www.nextplatform.com/2024/03/12/the-cloud-outgrows-linux-and-sparks-a-new-operating-system/

Some theories:
* It's still too hard to actually deploy and maintain a niche OS (the easiest way is to virtualize it which... puts you on top of a conventional kernel.)
* Worse is better: people have learned how to build on top of existing OSes and the benefit is not actually big for the vast majority. (Sort of like how people figured out how to adapt NAT, meaning there's less pressure for IPv6 because it does not actually enable new applications.)
* Databases actually use many more OS features than they are willing to admit, and duplicating all of them is too hard. (Like... eBPF or dTrace for performance monitoring/debugging. Or file systems for logging.)

#OperatingSystems #database #performance

Watching https://www.p99conf.io/ having several good talks this year about performance, databases and related technology. #P99CONF

Amos Wenger's #P99CONF chat had me in stitches. "Once we were through the usual pleasantries like, how did you get my address and what are you doing in my driveway..."

https://fasterthanli.me/

Great #p99conf so far -- a masterclass on all the kinds of latency in services, and then a really interesting talk from someone building their own toy operating system, and the latency challenges they solved in it.

Watching #p99conf now.

Free Online Conference about performance starting soon

#P99CONF
https://www.p99conf.io

#p99conf featured me in the Speaker Spotlight. Here's some info of what I'm up to and what I'll talk about at P99 CONF on this October!

https://www.p99conf.io/2024/09/05/p99-conf-speaker-spotlight-tanel-poder/

Versatility, Speed.

Pick Two.

October 23 and 24th, come see the magic. And,

the crime we use to get it. https://www.p99conf.io/

#p99conf #ScyllaDB #DevTalk #programming

I'm speaking at #P99CONF this year too. See you there! (23-24 Oct 2024)

p99conf.io

Time to update my #p99conf slide with "injected SSH backdoor" as a potentially significant source of latency.