nanog mailing list archives
Re: Paging Google's Googlebot developers re. bugs
From: Jeff Rosowski <rosowskij () ie ymp gov>
Date: Mon, 14 Nov 2005 09:26:35 -0800 (PST)
Googlebot keeps ignoring my robots.txt file, thereby hammering the server and facilitating spam.I think I found at least 2 bugs; see this thread in the robots.txt forum thread:http://www.webmasterworld.com/forum93/782.htmI've used Google's direct contact form last Wednesday; still no ack or response.Please don't reply w/o reading the above thread, to avoid repetition.I'm looking for a fix, not a workaround (such as a temporary total Googlebot ban).
Requires you to register to read it. Sorry.
Current thread:
- Paging Google's Googlebot developers re. bugs Matthew Elvey (Nov 13)
- Re: Paging Google's Googlebot developers re. bugs Tony Finch (Nov 13)
- Re: Paging Google's Googlebot developers re. bugs Jeff Rosowski (Nov 14)
- Re: Paging Google's Googlebot developers re. bugs Mark Owen (Nov 14)
- Re: Paging Google's Googlebot developers re. bugs Patrick W. Gilmore (Nov 14)
- Re: Paging Google's Googlebot developers re. bugs Mark Owen (Nov 14)
- Re: Paging Google's Googlebot developers re. bugs Mark Owen (Nov 14)