nanog mailing list archives

RE: BGP Experiment


From: <adamv0025 () netconsultings com>
Date: Thu, 24 Jan 2019 16:43:00 -0000

From: Saku Ytti <saku () ytti fi>
Sent: Thursday, January 24, 2019 4:28 PM

On Thu, 24 Jan 2019 at 17:52, <adamv0025 () netconsultings com> wrote:

This actually makes me thing that it might be worthwhile including
these types of test to the regression testing suite.

I seem to recall one newish entrant to SP market explaining that they are
limited by wall-time in blackbox testing. They would have no particularly
challenge testing everything, but the amount of permutations and wall-time
to execute single test simply makes it impossible to test comprehensively. So
if you can't test everything, what do you test? How do you predict what is
more likely to be broken?

We fight with that all the time, 
I'd say that from the whole Design->Certify->Deploy->Verify->Monitor service lifecycle time budget, the service 
certification testing is almost half of it.
That's why I'm so interested in a model driven design and testing approach.
I really need to have this ever growing library of test cases that the automat will churn through with very little 
human intervention, in order to reduce the testing from months to days or weeks at least.

There are some commercial BGP fuzzers, I've only tested one of them:
https://www.synopsys.com/software-integrity/security-testing/fuzz-
testing/defensics/protocols/bgp4-server.html

Thank you very much for the link.

adam


Current thread: