nanog mailing list archives
Re: Disaster Recovery Process
From: Jared Mauch <jared () puck nether net>
Date: Tue, 5 Oct 2021 10:13:51 -0400
On Oct 5, 2021, at 10:05 AM, Karl Auer <kauer () biplane com au> wrote: On Tue, 2021-10-05 at 08:50 -0400, Jared Mauch wrote:A few reminders for people: [excellent list snipped]I'd add one "soft" list item: - in your emergency plan, have one or two people nominated who are VERY high up in the organisation. Their lines need to be open to the decisionmakers in the emergency team(s). Their job is to put the fear of a vengeful god into any idiot who tries to interfere with the recovery process by e.g. demanding status reports at ten-minute intervals.
At $dayjob we split the technical updates on a different bridge from the business updates. There is a dedicated team to coordinate an entire thing, they can be low severity (risk) or high severity (whole business impacting). They provide the timeline to next update and communicate what tasks are being done. There’s even training on how to be a SME in the environment. Nothing is perfect but this runs very smooth at $dayjob - Jared
Current thread:
- Re: facebook outage, (continued)
- Re: facebook outage Bill Woodcock (Oct 04)
- Re: facebook outage Ryan Brooks (Oct 04)
- Re: facebook outage Bill Woodcock (Oct 04)
- Re: facebook outage Patrick W. Gilmore (Oct 04)
- Re: facebook outage John Lee (Oct 04)
- Re: facebook outage Niels Bakker (Oct 05)
- Re: massive facebook outage presently Jay Hennigan (Oct 04)
- Re: massive facebook outage presently Jorge Amodio (Oct 05)
- Disaster Recovery Process Jared Mauch (Oct 05)
- Re: Disaster Recovery Process Karl Auer (Oct 05)
- Re: Disaster Recovery Process Jared Mauch (Oct 05)
- Re: Disaster Recovery Process Sean Donelan (Oct 05)
- Re: Disaster Recovery Process Wolfgang Tremmel (Oct 06)
- Re: Disaster Recovery Process Jeff Shultz (Oct 05)
- Re: Disaster Recovery Process jim deleskie (Oct 05)
- Re: Disaster Recovery Process Niels Bakker (Oct 05)
- Re: Disaster Recovery Process jim deleskie (Oct 05)
- Re: Disaster Recovery Process Jamie Dahl (Oct 05)
- Re: Disaster Recovery Process Warren Kumari (Oct 05)
- RE: massive facebook outage presently Jean St-Laurent via NANOG (Oct 04)
- Re: massive facebook outage presently Bryan Fields (Oct 04)