nanog mailing list archives
Re: Facebook post-mortems...
From: Mark Tinka <mark@tinka.africa>
Date: Tue, 5 Oct 2021 15:40:39 +0200
On 10/5/21 15:04, Joe Greco wrote:
You don't think at least 10,000 helpdesk requests about Facebook being down were sent yesterday?
That and Jane + Thando likely re-installing all their apps and iOS/Android on their phones, and rebooting them 300 times in the hopes that Facebook and WhatsApp would work.
Yes, total nightmare yesterday, but sure that 9,999 of the helpdesk tickets had nothing to do with DNS. They likely all were - "Your Internet is down, just fix it; we don't wanna know".
There's something to be said for building these things to be resilient in a manner that isn't just convenient internally, but also externally to those people that network operators sometimes forget also support their network issues indirectly.
I don't disagree with you one bit. It's for that exact reason that we built: https://as37100.net/... not for us, but specifically for other random network operators around the world whom we may never get to drink a crate of wine with.
I have to say that it has likely cut e-mails to our NOC as well as overall pain in half, if not more.
Mark.
Current thread:
- Re: update - Re: Facebook post-mortems..., (continued)
- Re: update - Re: Facebook post-mortems... Michael Thomas (Oct 04)
- Re: update - Re: Facebook post-mortems... Rabbi Rob Thomas (Oct 04)
- Re: Facebook post-mortems... Michael Thomas (Oct 04)
- Re: Facebook post-mortems... William Herrin (Oct 04)
- Re: Facebook post-mortems... Jeff Tantsura (Oct 04)
- RE: Facebook post-mortems... Jean St-Laurent via NANOG (Oct 05)
- Re: Facebook post-mortems... Mark Tinka (Oct 05)
- Re: Facebook post-mortems... Joe Greco (Oct 05)
- Re: Facebook post-mortems... Mark Tinka (Oct 05)
- Re: Facebook post-mortems... Joe Greco (Oct 05)
- Re: Facebook post-mortems... Mark Tinka (Oct 05)
- Re: Facebook post-mortems... - Update! Mark Tinka (Oct 05)
- Re: Facebook post-mortems... - Update! Warren Kumari (Oct 05)
- BGP communities, was: Re: Facebook post-mortems... - Update! Jay Hennigan (Oct 05)
- Re: BGP communities, was: Re: Facebook post-mortems... - Update! Ross Tajvar (Oct 07)
- Re: Facebook post-mortems... - Update! Randy Bush (Oct 05)
- Re: Facebook post-mortems... William Herrin (Oct 04)
- Re: Facebook post-mortems... Joe Greco (Oct 05)
- Re: Facebook post-mortems... Mark Tinka (Oct 05)
- RE: Facebook post-mortems... Jean St-Laurent via NANOG (Oct 05)
- Re: Facebook post-mortems... Mark Tinka (Oct 05)
- Re: Facebook post-mortems... Joe Maimon (Oct 05)