nanog mailing list archives
Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion
From: Adam Thompson <athompson () merlin mb ca>
Date: Wed, 8 Jul 2020 11:56:16 +0000
If jitter were defined anywhere vis-à-vis LACP, it would be _de jure_, not _de facto_ as I said. Yes, if you have *guaranteed* that TCP sessions hash uniquely to a single link in your network, you might be able to successfully tunnel LACP (or EtherChannel, or any other L1 link-bonding technique). The last time I attempted to do this on my network, I discovered that guarantee wasn't nearly as ironclad as I expected. I don't remember the gory details, at this remove, sorry. Maybe it wasn't TCP? Maybe it wasn't the default hashing algorithm? Dunno. -Adam On Jul. 8, 2020 00:48, Saku Ytti <saku () ytti fi> wrote: Hey Adam, On Wed, 8 Jul 2020 at 00:11, Adam Thompson <athompson () merlin mb ca> wrote:
Good luck with tunnelling LACP, no matter what boxes you have - LACP has (de facto) hard jitter requirements of under 1msec, or you'll be getting TCP resets coming out your ears due to mis-ordered packets.
Can you elaborate on this? Where is LACP jitter defined and for what purpose? We push packets around the globe in sub 200us jitter on any given day, so 1000us isn't for us a particularly hard goal. Only reason why I could imagine someone would care about jitter here is if protocol measures delay (LACP doesn't) and relies on delay to remain static and then balances per-packet or per-byte or otherwise between multiple links. However we of course put all packets from given TCP session to always same LACP interface, so from TCP session POV, each LACP is exactly a 1 interface. Per-packet balancing on LACP is possible via a special configuration, but anyone who does it, doesn't care about reordering, no matter of jitter, because even in very stable jitter, the paths may be unequal length and cause reordering. LACP hellos are sent every 1s when in fast mode with 3s keepalive, which also isn't particularly tight. We do have customers running LACP over MPLS pseudowires over great distances. -- ++ytti
Current thread:
- L2VPN/L2transport, Cumulus Linux & hardware suggestion Jürgen Jaritsch (Jul 07)
- RE: L2VPN/L2transport, Cumulus Linux & hardware suggestion Adam Thompson (Jul 07)
- AW: L2VPN/L2transport, Cumulus Linux & hardware suggestion Jürgen Jaritsch (Jul 07)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Adam Thompson (Jul 08)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Saku Ytti (Jul 07)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Adam Thompson (Jul 08)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Saku Ytti (Jul 08)
- AW: L2VPN/L2transport, Cumulus Linux & hardware suggestion Jürgen Jaritsch (Jul 07)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Mark Tinka (Jul 08)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Radu-Adrian Feurdean (Jul 08)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Saku Ytti (Jul 08)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Valdis Klētnieks (Jul 08)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Baldur Norddahl (Jul 09)
- RE: L2VPN/L2transport, Cumulus Linux & hardware suggestion Adam Thompson (Jul 07)
- Re: L2VPN/L2transport, Cumulus Linux & hardware suggestion Mark Tinka (Jul 08)