nanog mailing list archives

Paging Google's Googlebot developers re. bugs


From: Matthew Elvey <matthew () elvey com>
Date: Sun, 13 Nov 2005 11:08:25 -0800


Googlebot keeps ignoring my robots.txt file, thereby hammering the server and facilitating spam.

I think I found at least 2 bugs; see this thread in the robots.txt forum thread:
http://www.webmasterworld.com/forum93/782.htm

I've used Google's direct contact form last Wednesday; still no ack or response.

Please don't reply w/o reading the above thread, to avoid repetition.
I'm looking for a fix, not a workaround (such as a temporary total Googlebot ban).


Current thread: