nanog mailing list archives

RE: STILL Paging Google...


From: "Hannigan, Martin" <hannigan () verisign com>
Date: Tue, 15 Nov 2005 22:46:51 -0500



Still no word from google, or indication that there's anything wrong 
with the robots.txt.  Google's estimated hit count is going 
slightly up, 
instead of way down.
Why am I bugging NANOG with this? Well, I'm sure if Googlebot keeps 
ignoring my robots.txt file, thereby hammering the server and 
facilitating s pam, they're doing the same with a google 
other sites.  
(Well, ok, not a google, but you get my point.) 

Why would they read/respond on NANOG to an application problem?
(seriously)


-M<


Current thread: