Re: Famous operational issues

[Owen DeLong <owen () delong com>]

In the case of Exodus when I was working there, it was literally dictated to us by
the fire marshal of the city of Santa Clara (and enough other cities where we had
datacenters to make a universal policy the only sensible choice).

Owen
 
> On Feb 18, 2021, at 1:07 AM, Eric Kuhnke <eric.kuhnke () gmail com> wrote:
>
> On that note, I'd be very interested in hearing stories of actual incidents that are the cause of why cardboard boxes 
> are banned in many facilities, due to loose particulate matter getting into the air and setting off very sensitive 
> fire detection systems.
>
> Or maybe it's more mundane and 99% of the reason is people unpack stuff and don't always clean up properly after 
> themselves.
>
> On Wed, Feb 17, 2021, 6:21 PM Owen DeLong <owen () delong com <mailto:owen () delong com>> wrote:
> Stolen isn’t nearly as exciting as what happens when your (used) 6509 arrives and
> gets installed and operational before anyone realizes that the conductive packing
> peanuts that it was packed in have managed to work their way into various midplane
> connectors. Several hours later someone notices that the box is quite literally
> smoldering in the colo and the resulting combination of panic, fire drill, and
> management antics that ensue.
>
> Owen
>
>
> > On Feb 16, 2021, at 2:08 PM, Jared Mauch <jared () puck nether net <mailto:jared () puck nether net>> wrote:
> >
> > I was thinking about how we need a war stories nanog track. My favorite was being on call when the router was 
> > stolen. 
> >
> > Sent from my TI-99/4a
> >
> > > On Feb 16, 2021, at 2:40 PM, John Kristoff <jtk () dataplane org <mailto:jtk () dataplane org>> wrote:
> > >
> > > Friends,
> > >
> > > I'd like to start a thread about the most famous and widespread Internet
> > > operational issues, outages or implementation incompatibilities you
> > > have seen.
> > >
> > > Which examples would make up your top three?
> > >
> > > To get things started, I'd suggest the AS 7007 event is perhaps  the
> > > most notorious and likely to top many lists including mine.  So if
> > > that is one for you I'm asking for just two more.
> > >
> > > I'm particularly interested in this as the first step in developing a
> > > future NANOG session.  I'd be particularly interested in any issues
> > > that also identify key individuals that might still be around and
> > > interested in participating in a retrospective.  I already have someone
> > > that is willing to talk about AS 7007, which shouldn't be hard to guess
> > > who.
> > >
> > > Thanks in advance for your suggestions,
> > >
> > > John