2y ago: we are a tech company we run 1000rps per core
Today: we are tech company we run an agent as service with 1rps per core
No wonder why everyone wants you to believe it's the way to go.
I already wondered >=2y ago when google created a nodejs application you need to run for google analytics. If you know node in production it's ~10-25 rps per core.
Better use a coding agent to build an application in c/c++/rust/go/jvm and run again at 1k rps per core. You will save a lot of money and heat up the world less.
You know you can do it, please do it!