Re: massive facebook outage presently

[Blake Dunlap <ikiris () gmail com>]

You laugh but that kind of sounds like what happened so far as oops we
isolated prod and are scrambling on DR. There was someone supposedly live
tweeting from their incident response for a bit before their account panic
deleted.

On Mon, Oct 4, 2021, 13:42 Baldur Norddahl <baldur.norddahl () gmail com>
wrote:

> I got a mail that Facebook was leaving NLIX. Maybe someone botched the
> script so they took down all BGP sessions instead of just NLIX and now they
> can't access the equipment to put it back... :-)
>
>
> man. 4. okt. 2021 20.31 skrev Billy Croan <BCroan () unrealservers net>:
>
> > I know what this is.....  They forgot to update the credit card on their
> > godaddy account and the domain lapsed.  I guess it will be facebook.info
> > when they get it back online.  The post mortem should be an interesting
> > read.
> >
> > On Mon, Oct 4, 2021 at 11:46 AM Jason Kuehl <jason.w.kuehl () gmail com>
> > wrote:
> >
> > > Looks like they run there own nameservers and I see the soa records are
> > > even missing.
> > >
> > > On Mon, Oct 4, 2021, 12:23 PM Mel Beckman <mel () beckman org> wrote:
> > >
> > > > Here’s a screenshot:
> > > >
> > > >
> > > >
> > > >  -mel beckman
> > > >
> > > > On Oct 4, 2021, at 9:06 AM, Eric Kuhnke <eric.kuhnke () gmail com> wrote:
> > > >
> > > > 
> > > > https://downdetector.com/status/facebook/
> > > >
> > > > Normally not worth mentioning random $service having an outage here,
> > > > but this will undoubtedly generate a large volume of customer service
> > > > calls.
> > > >
> > > > Appears to be failure in DNS resolution.