nanog mailing list archives
Re: CIDR cleanup
From: "Markus Weber (FvD)" <fvd-ml-net () uucp de>
Date: Fri, 2 Oct 2020 19:27:56 +0200
On 02.10.2020 at 12:03 Job Snijders wrote:
Marco Marzetti (PCCW) wrote an even faster compression tool! https://github.com/lamehost/aggregate-prefixes Both these python implementations are meant as replacements for ISC's vintage 'aggregate' Unix utility, with the notable difference that they also support IPv6. Example: job@bench ~$ pip3 install aggregate-prefix job@bench ~$ wc -l dfz_ipv4 810607 job@bench ~$ cat dfz_ipv4 | time aggregate-prefixes - | wc -l 141645 1m40.17s real 1m37.39s user 0m01.60s system Compressing the whole IPv4 DFZ prefix list takes only 100 seconds.
First time I uploaded/publish something to/on Github ... so please be kind: https://github.com/FvDxxx/pfxaggrIn case you need it even faster (and can accept the little known issues and that it's old, ugly and never reviewed):
> wc -l dfz-pfx-20201002-A-v4.txt 813542 dfz-pfx-20201002-A-v4.txt > time cat dfz-pfx-20201002-A-v4.txt | ./pfxagg -a1 > dfz-4-agg-pfx.log real 0m1.034s user 0m0.909s sys 0m0.232s> time cat dfz-pfx-20201002-A-v4.txt | aggregate-prefixes > dfz-4-agg-pyth.log
real 1m11.691s user 1m10.879s sys 0m0.786s > diff dfz-4-agg-pyth.log dfz-4-agg-pfx.log > wc -l dfz-4-agg-pyth.log dfz-4-agg-pfx.log 141754 dfz-4-agg-pyth.log 141754 dfz-4-agg-pfx.log 283508 total Cheers, Markus
Current thread:
- CIDR cleanup John Von Essen (Oct 01)
- Re: CIDR cleanup Tim Jackson (Oct 01)
- Re: CIDR cleanup Jon Meek (Oct 01)
- Re: CIDR cleanup Marcos Manoni (Oct 01)
- Re: CIDR cleanup Job Snijders (Oct 02)
- Re: CIDR cleanup Randy Bush (Oct 02)
- Re: CIDR cleanup Job Snijders (Oct 02)
- Re: CIDR cleanup Randy Bush (Oct 02)
- Re: CIDR cleanup Job Snijders (Oct 02)
- Re: CIDR cleanup Markus Weber (FvD) (Oct 02)
- Re: CIDR cleanup Tim Jackson (Oct 01)
- <Possible follow-ups>
- Re: CIDR cleanup Charles Cloughly (Oct 01)
- Re: CIDR cleanup John Kristoff (Oct 01)