nanog mailing list archives

Re: Yahoo! clue (Slightly OT: Spiders)


From: Valdis.Kletnieks () vt edu
Date: Thu, 29 Mar 2007 09:15:38 -0400

On Thu, 29 Mar 2007 09:05:12 EDT, Kradorex Xeron said:
Slightly OT: Does anyone know what is with the web spiders from Yahoo/Inktomi?
I've been seeing reports and have seen a problem with them opening 10 to 100
connections to any specific site.

And 10 concurrent connections (or 100) causes a production-quality webserver
difficulties, how, exactly?

Attachment: _bin
Description:


Current thread: