nanog mailing list archives

Re: Global issues @ Telia - doing a "FB/hold my beer" move?


From: Eric Dugas via NANOG <nanog () nanog org>
Date: Thu, 7 Oct 2021 16:28:45 -0400

I've just sent this update over the Outages ML:

Dear Customer,

We regret to inform you that your services were affected by an incident occurred at 16:00 UTC during a routine update 
of a routing policy for aggregated prefixes in Telia Carrier IP Core network. This caused traffic to prefixes 
contained within the aggregates >to be blackholed, resulting in a impact on some parts of the network.

When the underlying problem source was traced, the configuration was rolled back to the earlier working version of the 
routing policy (17:05 UTC). Affected services started to recover gradually after this operation was applied. No 
further disturbances >related to this incident are expected.

Due to the wide impact on several customer services, a number of complaints was received by our Customer Support 
Centre, resulting in delays in the communication with customers via email and/or phone. We apologize for any 
inconvenience this incident >has caused to your services.

On Thu, Oct 7, 2021 at 3:48 PM Max Tulyev <maxtul () netassist ua> wrote:

Really it depends on the problem source. BGP do not know either route
really reachable or not. This time we was just lucky.

07.10.21 22:36, Ca By пише:


On Thu, Oct 7, 2021 at 11:47 AM Max Tulyev <maxtul () netassist ua
<mailto:maxtul () netassist ua>> wrote:

    We have 2 ports from Telia, one in Kiev (Ukraine) and one in New York
    (USA). I have seen both ports simultaneously dropped traffic volume for
    about one hour today.

    It was not critical (for us), as traffic was shifted to another links,
    and there was no unreachable destinations like BGP announces with
    traffic blackholed. But looks strange.


Thats why it is called the bridging gap protocol

While Telia barfed, it bridged the gap.

See, bgp is not all bad. There are no bad routes, only bad days



    07.10.21 21:23, Vincentz Petzholtz пише:
     > Hi everyone,
     >
     > Looks like the season for outages is on. Does anyone has more
    details regarding the issues at Telia? I didn't found any public
    available information. They say it's over but this is clearly not
    the case.
     >
     > Best regards,
     > Vincentz
     >



Current thread: