#reliabilityengineering — Public Fediverse posts

🤖 As AI becomes part of critical business operations, reliability is no longer just an infrastructure concern.

From latency and model drift to observability and trust, AI workloads introduce a new set of challenges for modern SRE teams.

In our latest article, we look at how reliability engineering is evolving in the age of AI and what organizations need to do to keep AI services resilient, predictable, and scalable.

🔗 https://www.relianoid.com/blog/ai-reliability-engineering-the-new-era-of-sre/

#AI #SRE #AIOps #DevOps #ReliabilityEngineering

The Engineering Leadership Crisis Nobody Talks About 🚨 #EngineeringLeadership #SoftwareEngineering #PlatformEngineering #TechLeadership #Microservices #SRE

https://atozofsoftwareengineering.blog/2026/05/19/the-engineering-leadership-crisis-nobody-talks-about-%f0%9f%9a%a8-engineeringleadership-softwareengineering-platformengineering-techleadership-microservices-sre/

The Engineering Leadership Crisis Nobody Talks About 🚨 #EngineeringLeadership #SoftwareEngineering #PlatformEngineering #TechLeadership #Microservices #SRE

https://atozofsoftwareengineering.blog/2026/05/19/the-engineering-leadership-crisis-nobody-talks-about-%f0%9f%9a%a8-engineeringleadership-softwareengineering-platformengineering-techleadership-microservices-sre/

SRE is about sleeping well 🌙

The goal is not midnight heroics.
It is building systems that fail safely so humans can rest.

#SRE #ReliabilityEngineering #OnCall

https://webdad.eu/2026/05/14/%f0%9f%98%b4-sre-is-about-sleeping-well/

SLIs, SLOs, and Error Budgets explained with pizza 🍕

Reliability isn’t about perfection.
It’s about delivering most pizzas on time — and having room to improve.

#SRE #DevOps #ReliabilityEngineering

https://webdad.eu/2026/03/19/%f0%9f%8d%95-slis-slos-and-error-budgets-explained-with-pizza-delivery/

Spacecraft controls don’t get a second chance — every input must be reliable, clean, and redundant. 🚀🔘
know more:https://zurl.co/zmWFi
#Smidmart #SpaceTech #AerospaceComponents #SealedSwitches #LowOutgassing #Spacecraft #ReliabilityEngineering #Redundancy #Avionics

Global availability incident: Facebook.
Meta confirmed service disruptions impacting account access, alongside high disruptions reported in Ad Manager and business APIs.
Operational characteristics:
• Sudden spike in user reports (~4:15 PM ET)
• Global impact footprint
• No immediate root cause transparency
• Service restoration within ~2 hours
Availability is a security pillar — and outages expose:
- Centralization risk
- Cascading dependency exposure
- Business continuity gaps
- API reliance vulnerabilities

For security and reliability engineers:
Are social platforms integrated into your risk register and DR modeling?

Source: https://www.bleepingcomputer.com/news/technology/facebook-hit-with-worldwide-outage-stating-accounts-are-unavailable/

Engage below.
Follow @technadu for infrastructure resilience, cybersecurity, and outage intelligence.
Repost to inform your network.

#Infosec #ServiceAvailability #CloudRisk #Meta #FacebookOutage #BusinessContinuity #DigitalInfrastructure #ReliabilityEngineering #CyberResilience #PlatformRisk #ITOperations

Global availability incident: Facebook.
Meta confirmed service disruptions impacting account access, alongside high disruptions reported in Ad Manager and business APIs.
Operational characteristics:
• Sudden spike in user reports (~4:15 PM ET)
• Global impact footprint
• No immediate root cause transparency
• Service restoration within ~2 hours
Availability is a security pillar — and outages expose:
- Centralization risk
- Cascading dependency exposure
- Business continuity gaps
- API reliance vulnerabilities

For security and reliability engineers:
Are social platforms integrated into your risk register and DR modeling?

Source: https://www.bleepingcomputer.com/news/technology/facebook-hit-with-worldwide-outage-stating-accounts-are-unavailable/

Engage below.
Follow @technadu for infrastructure resilience, cybersecurity, and outage intelligence.
Repost to inform your network.

#Infosec #ServiceAvailability #CloudRisk #Meta #FacebookOutage #BusinessContinuity #DigitalInfrastructure #ReliabilityEngineering #CyberResilience #PlatformRisk #ITOperations

The 2024 CrowdStrike outage caused a worldwide Windows Blue Screen crash, impacting airlines, banks, and enterprises.
This deep dive explains how DevOps & SRE teams mitigated impact, recovered systems, and prevented total failure.
🔗 https://shorturl.at/VLqxz

#CrowdStrikeOutage #DevOps #SRE #IncidentManagement #CyberResilience #CloudOps #PostMortem #ReliabilityEngineering #aws

As I always say, when your teams tell you it’s “just a routine #upgrade”, be extra wary.

In this case, a “routine upgrade” disabled emergency calling and contributed to two *deaths*.

#networks #qa #reliability #reliabilityengineering #process

https://www.theregister.com/2025/12/19/optus_emergency_outages_cause_report

As I always say, when your teams tell you it’s “just a routine #upgrade”, be extra wary.

In this case, a “routine upgrade” disabled emergency calling and contributed to two *deaths*.

#networks #qa #reliability #reliabilityengineering #process

https://www.theregister.com/2025/12/19/optus_emergency_outages_cause_report

Most reliability incidents don’t start with a failure.
They start with “we’ll fix it later.”

A brittle deploy, a noisy alert, a manual process that “rarely runs.”
Months pass, context fades, the system grows.

Then something small breaks — and the deferred work becomes the incident.

Reliability doesn’t fail all at once.
It erodes quietly, then shows up loudly.

#ReliabilityEngineering #TechDebt

🚀 AI is redefining Site Reliability Engineering (SRE)

What started as ensuring web apps were fast and resilient has now entered a new era: AI Reliability Engineering. Inference workloads demand speed, trust, and observability far beyond traditional infrastructure challenges.

RELIANOID’s role as SRE experts, supporting organizations in building systems where AI can truly thrive

🔗 https://www.relianoid.com/blog/ai-reliability-engineering-the-new-era-of-sre/

#AI #SRE #DevOps #ReliabilityEngineering #Observability #RELIANOID

Thanks for all the boosts y'all!!

Someone pointed out I should mention: I am in Southern California, fully remote.

#SRE #FediHire #ReliabilityEngineering #IncidentResponse #resilience

Thanks for all the boosts y'all!!

Someone pointed out I should mention: I am in Southern California, fully remote.

#SRE #FediHire #ReliabilityEngineering #IncidentResponse #resilience

Four applications out today, thank you for the suggestions and links!

#SRE #FediHire #ReliabilityEngineering #IncidentResponse #resilience

Four applications out today, thank you for the suggestions and links!

#SRE #FediHire #ReliabilityEngineering #IncidentResponse #resilience

Hey everyone!

I just got a rejection from a long interview cycle. It's weighing on me very heavy right now, my migraine is making sure of it.

Currently I am feeling emotionally drained and today I don't feel like I can keep doing this for much longer. Yet I must persist.

If you know of anything having to do with Site Reliability, Observability, or Incident Management... please, please, send it my way. I will take anything at this point, junior roles, mid-level, I will do anything.

Pretty soon our savings will be completely gone.

#SRE #FediHire #ReliabilityEngineering #IncidentResponse #resilience

Hey everyone!

I just got a rejection from a long interview cycle. It's weighing on me very heavy right now, my migraine is making sure of it.

Currently I am feeling emotionally drained and today I don't feel like I can keep doing this for much longer. Yet I must persist.

If you know of anything having to do with Site Reliability, Observability, or Incident Management... please, please, send it my way. I will take anything at this point, junior roles, mid-level, I will do anything.

Pretty soon our savings will be completely gone.

#SRE #FediHire #ReliabilityEngineering #IncidentResponse #resilience

Here's a new blog post from me! It's a small "book" review, which is actually a workbook with some essays at the beginning.

The short book is Maj. John Schmitt's exercise book on Tactical Decision Games (TDGs) for the Marines (and likely other branches), and I noticed how much the philosophy behind them is shared with the sorts of Practice of Practice games we play to understand the system and prepare ourselves for incidents.

https://www.sounding.com/2025/05/02/schmitt-tdg-sre/

#SRE #TDG #PracticeOfPractice #TabletopExercises #OperationalReadiness #IncidentResponse #TacticalDecisionGames #Resilience #ResilienceEngineering #ReliabilityEngineering

Here's a new blog post from me! It's a small "book" review, which is actually a workbook with some essays at the beginning.

The short book is Maj. John Schmitt's exercise book on Tactical Decision Games (TDGs) for the Marines (and likely other branches), and I noticed how much the philosophy behind them is shared with the sorts of Practice of Practice games we play to understand the system and prepare ourselves for incidents.

https://www.sounding.com/2025/05/02/schmitt-tdg-sre/

#SRE #TDG #PracticeOfPractice #TabletopExercises #OperationalReadiness #IncidentResponse #TacticalDecisionGames #Resilience #ResilienceEngineering #ReliabilityEngineering

My second report from #SREcon: Some of the same lessons -- and unsolved problems -- from supporting #machinelearning apps in production carry over to #generativeAI apps, but not all. Attendees discussed the similarities and important differences. #reliabilityengineering #ML #GenAI #LLM #AI #MLOps #LLMOps https://www.techtarget.com/searchitoperations/news/366621071/Site-Reliability-Engineers-weigh-MLOps-vs-LLMOps

My second report from #SREcon: Some of the same lessons -- and unsolved problems -- from supporting #machinelearning apps in production carry over to #generativeAI apps, but not all. Attendees discussed the similarities and important differences. #reliabilityengineering #ML #GenAI #LLM #AI #MLOps #LLMOps https://www.techtarget.com/searchitoperations/news/366621071/Site-Reliability-Engineers-weigh-MLOps-vs-LLMOps

Google SREs reveal how search handled record World Cup traffic spike: Google's Search Reliability team discusses challenges, strategies, and successes in maintaining service during peak events. https://ppc.land/google-sres-reveal-how-search-handled-record-world-cup-traffic-spike-2/?utm_source=dlvr.it&utm_medium=mastodon #GoogleSRE #WorldCup #SearchEngine #TechNews #ReliabilityEngineering

Perhaps you need a distraction, why not read about the importance of making Documentation part of your workflow?

https://www.sounding.com/2024/11/01/to-doc-or-not/

#SRE #ReliabilityEngineering #DevOps #Observability #ProductionReadiness

Perhaps you need a distraction, why not read about the importance of making Documentation part of your workflow?

https://www.sounding.com/2024/11/01/to-doc-or-not/

#SRE #ReliabilityEngineering #DevOps #Observability #ProductionReadiness

Hey y'all! Any SREs out there?

Any *aspirational* SREs out there?

Maybe there's a team at work who they call "SRE" and you're really not sure what they do if it's not infra/platform/deploy?

A coworker is interested in switching careers to SRE and asked me for reading recommendations. So I put together the most solid top-five for me, from my experience and perspective of doing Ops for 30 years and SRE for 12:

https://www.sounding.com/2024/10/03/five-reads-for-learning-sre/

#SRE #ContinuousLearning #ResilienceEngineering #ReliabilityEngineering #DevOps #TechOps #HumanError #ComplexSystems #SystemsThinking

Hey y'all! Any SREs out there?

Any *aspirational* SREs out there?

Maybe there's a team at work who they call "SRE" and you're really not sure what they do if it's not infra/platform/deploy?

A coworker is interested in switching careers to SRE and asked me for reading recommendations. So I put together the most solid top-five for me, from my experience and perspective of doing Ops for 30 years and SRE for 12:

https://www.sounding.com/2024/10/03/five-reads-for-learning-sre/

#SRE #ContinuousLearning #ResilienceEngineering #ReliabilityEngineering #DevOps #TechOps #HumanError #ComplexSystems #SystemsThinking

A Peek Inside Apple Durability Testing Labs https://hackaday.com/2024/06/10/a-peek-inside-apple-durability-testing-labs/ #reliabilityengineering #handheldshacks #repairability #wateringress #durability #vibration #hardware #droptest #robotarm #apple #spray

A Peek Inside Apple Durability Testing Labs https://hackaday.com/2024/06/10/a-peek-inside-apple-durability-testing-labs/ #reliabilityengineering #handheldshacks #repairability #wateringress #durability #vibration #hardware #droptest #robotarm #apple #spray

A Peek Inside Apple Durability Testing Labs - Apple is well-known for its secrecy, which is understandable given the high stakes... - https://hackaday.com/2024/06/10/a-peek-inside-apple-durability-testing-labs/ #reliabilityengineering #handheldshacks #repairability #wateringress #durability #vibration #hardware #droptest #robotarm #apple #spray

A Peek Inside Apple Durability Testing Labs - Apple is well-known for its secrecy, which is understandable given the high stakes... - https://hackaday.com/2024/06/10/a-peek-inside-apple-durability-testing-labs/ #reliabilityengineering #handheldshacks #repairability #wateringress #durability #vibration #hardware #droptest #robotarm #apple #spray

https://news.ycombinator.com/item?id=40397637

Clear-eyed explanation of disastrous fragility in current technical systems, yet it’s also very funny. Plus discussion. Well worth your time, and good inspiration for systems builders/sysadmins.

#sysadmin #antifragile #reliabilityengineering #softwaredevelopment

https://news.ycombinator.com/item?id=40397637

Clear-eyed explanation of disastrous fragility in current technical systems, yet it’s also very funny. Plus discussion. Well worth your time, and good inspiration for systems builders/sysadmins.

#sysadmin #antifragile #reliabilityengineering #softwaredevelopment

👋 My last #introduction was in 2022, so here's an update:

- Security Squad Lead at #Chainguard
- Keenly interested in #InfoSec and #ReliabilityEngineering
- 30 years of experience messing with the Internet & UNIX
- I build bamboo bicycle frames & spend more time tinkering than riding
- Spend my idle time playing #guitar and wandering on 2-wheel EVs
- Live in #Carrboro NC with my wife & kids
- Contributed to 150+ #OpenSource projects including 50+ I've created - #malcontent is my latest.

👋 My last #introduction was in 2022, so here's an update:

- Security Squad Lead at #Chainguard
- Keenly interested in #InfoSec and #ReliabilityEngineering
- 30 years of experience messing with the Internet & UNIX
- I build bamboo bicycle frames & spend more time tinkering than riding
- Spend my idle time playing #guitar and wandering on 2-wheel EVs
- Live in #Carrboro NC with my wife & kids
- Contributed to 150+ #OpenSource projects including 50+ I've created - #malcontent is my latest.

Explore Site Reliability Engineering (SRE) - the innovative blend of software engineering and IT operations reshaping digital infrastructures! Uncover its core principles, evolution, and vital role in ensuring flawless performance and reliability. #SRE #DigitalInfrastructure #ReliabilityEngineering
Discover how load balancers bolster SRE practices by evenly distributing traffic across servers, optimizing performance, and reducing downtime. #LoadBalancers #Resilience

https://www.relianoid.com/resources/knowledge-base/misc/site-reliability-engineering/

Cameron's pseudocode guide to comprehensive error handling

int main()
{
while(true)
{
try
{
Application.Run()
}
catch (Exception)
{
MessageBox("Whatever you just did, don't")
}
}
}

#Programming
#SoftwareDevelopment
#ReliabilityEngineering

`Introduction to the Cox model`

https://www.youtube.com/watch?v=CzHt22YL_-w

#coxModel #proportionalHazardModel #davidCox #sirDavidCox #survivalAnalysis #failureAnalysis #failureTimeAnalysis #forceOfMortality #reliabilityEngineering #kaplanMeier #failureDistribution #failureTimeDistribution #failureRate #hazardFunction #hazardRate #failureRate #nonParametric #model #modeling #statistics #stats #mortality #function #mathematics #math #proportionality #regression #regressionModel #leastSquares

Happy Friday!! In case you missed yesterday’s webinar on What 2022 Taught Us About SRE’s Future, you can catch the recording here: ⬇️⬇️⬇️

https://youtu.be/o0Pgo2fWIUc

The panel includes @anamedina, @austinlparker, KC Tessarek, and Chad Beaudin, Mitch Ashley, and me.

#SiteReliabilityEngineering #observability #reliability #ReliabilityEngineering

Happy Friday!! In case you missed yesterday’s webinar on What 2022 Taught Us About SRE’s Future, you can catch the recording here: ⬇️⬇️⬇️

https://youtu.be/o0Pgo2fWIUc

The panel includes @anamedina, @austinlparker, KC Tessarek, and Chad Beaudin, Mitch Ashley, and me.

#SiteReliabilityEngineering #observability #reliability #ReliabilityEngineering

Hard Disk Drives Have Made Precision Engineering Commonplace - Modern-day hard disk drives (HDDs) hold the interesting juxtaposition of being simultaneously the pi... - https://hackaday.com/2020/09/23/hard-disk-drives-have-made-precision-engineering-commonplace/ #reliabilityengineering #reliability #harddrives #backblaze #featured #hardware #interest #storage #hdd