nanog mailing list archives

Re: Internet operations during pandemics


From: Andrew Latham <lathama () gmail com>
Date: Thu, 19 Mar 2020 07:34:42 -0500

In my past it has always benefited me to set use cases and plan
accordingly. For many it is difficult to imagine these less than awesome
use cases. Having working to get datacentres back online in 8.8 earthquakes
and dealing with fires in co-location sites it is hard.

1. Document
2. Generate use cases, DR plans, OOBM, document peers phone numbers offline
3. Implement, share, discuss
4. Profit

While this sounds ideal and simple it is not a small effort. I have two
talks I must finish up where on is on *Organizations as Code* and how to
survive the worst.



On Wed, Mar 18, 2020 at 5:25 PM Christopher Morrow <morrowc.lists () gmail com>
wrote:

Did other folk on nanog-l see the nLnog-l note copied here?
I wonder how folk are planning for things (noted in the slides)
  o  supply chain for parts/equipment
     Wait, I can't get me a new shiny shipped because what??

  o ongoing rollout of new equipment
     I'm deploying next week in KIX, I'm currently in LAX how do I get
there? equipment arrives.. in between...oops!

  o noc/etc support staff
    omg.. wait, I can't have my noc staff in the same room? our 'wfh'
solution is ... wait, where is that?
    how do i get their phone queue sent to them? omg :( <sadness!>

  o services capacity crunches
    I love my shiny new dns service.. .wait, why is there a smoking
hole where my dns servers were?

I think some of this has been discussed (shifts in peaks, leveling of
peaks)
Some hasn't really...  I expect that at least sharing some 'err, our
WFH changed now we do: X, Y , Z and use M to get N solved'
could be super cool to discuss/share and iterate for better solutions
for all of our users.

thoughts? :)

thanks!
-chris
(note all the hard work in this message is not mine... thanks Job!)

---------- Forwarded message ---------
From: Job Snijders <job () ntt net>
Date: Wed, Mar 18, 2020 at 6:02 PM
Subject: Internet operations during pandemics
To: <nlnog () nlnog net>


Dear all,

I threw together a slidedeck today on the potential impact and second
order effects of COVID-19 on Internet network operations.

    http://instituut.net/~job/netops_during_pandemics.pdf

I hope we together over time can add and extend projections in the deck
on what will happen and how we can mitigate the negative effects on
Internet operations.

We have to answer questions such as:

    1) what problems already exist today because of a few weeks of C19?
    2) What problems are still coming? Will those be localized or globally?
    3) What possible workarounds can we plan for those problems?

I would appreciate feedback, comments, corrections or whatever you want
to tell me. None of us have been in this situation before, so my guess
is as good as yours.

Kind regards,

Job



-- 
- Andrew "lathama" Latham -

Current thread: