home.social

TechHub's Haunted Admin

Hello everybody at Techhub.social. This is the official account for the operational staff.

In an emergency, my personal account is @shlee

Posts
68
Followers
163
Following
161
Joined 2026-05-29 · View on techhub.social →
  1. "The queues' are at zero, all's right with the world"

    We're back to realtime.

  2. The queues are catching up... the ingress 10 hours is "how age of the oldest job in the queue".. that should catch up in the next hour

  3. Root cause analysis: The Redis server was running out of disk space.

    Resolved!

  4. Server is back online.

    Sorry the "worker" sidekiq server decided to OOM hard. I'm going to try and investigate with the mastodon devs.