More servers made it worse.
Fictional company and people. Modelled on a real public postmortem, named at the end.
you're on call tonight
Dhara Cloud runs a managed event-streaming service that 30 other services in the region build on. It's 18:45. The channel fills up as the night goes on; at 5 points you make the call. A wrong move costs minutes and users, and someone tells you why.
in the channel
- YouOn-call engineer, streams front-end
- Revathi KrishnanPrincipal SRE, incident commander
- Harsh VardhanPrincipal engineer, front-end fleet
- Nisha AroraEngineer, sign-in service
- Tara D'SouzaCustomer communications lead
- Ashok ReddyVP Engineering
~13 min · 5 calls · +60 XP