~learn.
?
SEV-1 · Patra · 17:28

The database ran out of numbers.

Fictional company and people. Modelled on a real public postmortem, named at the end.

you're on call tonight

Patra runs a transactional email API that sends OTPs, receipts and alerts for 40,000 apps. It's 17:28. The channel fills up as the night goes on; at 5 points you make the call. A wrong move costs minutes and users, and someone tells you why.

in the channel
  • YouOn-call engineer, sending platform
  • Shalini VermaEngineering manager, incident commander
  • Mukund IyerDatabase engineer, Postgres
  • Ayesha SiddiquiEngineer, send queue and workers
  • Varsha PillaiCustomer support and status lead
  • Nikhil AroraCTO
~13 min · 5 calls · +60 XP