RE: Someone didn't get the leap second memo...

["Chuck Church" <chuckchurch () gmail com>]

That bug note indicates all 3.13.* are vulnerable to this, but our 3.13.3 lab router seemed ok, no reload.  Logged:

Dec 31 23:59:59: %IOSXE-5-PLATFORM: R0/0: kernel: Clock: inserting leap second 23:59:60 UTC

But the release notes seem to indicate that bugs:
CSCut82336      ASR1002-X: Handle leap second in ToD IN
CSCut65374     PTP Leap Second: ASR1002-X incorporate leap second addition 6/30/15

are open caveats in 3.13.3, and resolved in 3.13.4.   I guess I'll find out which of our 300+ ASR 1000s misbehaved on 
Tuesday.  They're pretty much all on 3.13.5.  Hopefully none had an issue.  There are a lot of PSIRTs with ASRs, that's 
the main reason we're on later 3.13 versions.

Chuck

-----Original Message-----
From: NANOG [mailto:nanog-bounces () nanog org] On Behalf Of Richard Hicks
Sent: Saturday, December 31, 2016 9:17 PM
To: Hugo Slabbert <hugo () slabnet com>
Cc: nanog () nanog org
Subject: Re: Someone didn't get the leap second memo...

We had some ASR1001s routers reboot.

Looks like we hit this bug:
https://bst.cloudapps.cisco.com/bugsearch/bug/CSCvb01730


On Sat, Dec 31, 2016 at 5:47 PM, Hugo Slabbert <hugo () slabnet com> wrote:

> Had a set of Cisco ASR1004s running 15.4(3)S1 (on IOS-XE 03.13.01.S) 
> all restart at around midnight UTC, and all with `Last reload reason:
> Watchdog`, with those boxes being at separate DCs in different regions.
> I'm assuming when I call TAC I'll get a "whoops; sorry".
>
> --
> Hugo Slabbert       | email, xmpp/jabber: hugo () slabnet com
> pgp key: B178313E   | also on Signal
>
>
> On Sun 2017-Jan-01 01:02:24 +0000, Matthew Huff <mhuff () ox com> wrote:
>
> [root@hayden ~]# ntpq -p
> >     remote           refid      st t when poll reach   delay   offset
> > jitter
> > ============================================================
> > ==================
> > LOCAL(0)        .LOCL.          10 l  20d   64    0    0.000    0.000
> >  0.000
> > -clock.xmission. 132.163.4.103 2 u  169  256  377   66.078   -1.302
> >  0.164
> > xclock.sjc.he.ne 10.200.208.2     2 u   13  256  315   65.689  999.633
> >  2.015
> > +tock.usshc.com  .GPS.            1 u   87 256 377 26.930   -0.550
> >  0.121
> > *ntp.your.org    .CDMA.           1 u   43 256 217 23.339    0.544
> >  0.069
> >
> > Our batch system went belly up, but other than that, no other 
> > apparent leap second issues.
> >
> > ----
> > Matthew Huff             | 1 Manhattanville Rd
> > Director of Operations   | Purchase, NY 10577
> > OTA Management LLC       | Phone: 914-460-4039
> > aim: matthewbhuff        | Fax:   914-694-5669