Vulnerability Development mailing list archives
Re: Google lists vulnerable sites.
From: Skot <skot () canada com>
Date: 8 Jul 2002 15:55:00 -0000
In-Reply-To: <5.1.0.14.0.20020706205941.00ba75c8 () email telnor net>
From: Octavio / Super <alvarezp () telnor net> Google (or any other robot/search engine) might as well ignore robots.txt. I think not to trust these.
Keep an eye on your logs: I've always noticed Google droping the hunt after the first hit it got was the robots.txt file. There are other search robots that are not quite as polite though, they get blocked. Skot.
Current thread:
- Re: Google lists vulnerable sites., (continued)
- Re: Google lists vulnerable sites. KF (Jul 05)
- Re: Google lists vulnerable sites. Adam [wp-ckkl] (Jul 05)
- RE: Google lists vulnerable sites. Erick Arturo Perez Huemer (Jul 05)
- RE: Google lists vulnerable sites. Bryan Allerdice (Jul 05)
- Re: Google lists vulnerable sites. Kurt Seifried (Jul 05)
- Re: Google lists vulnerable sites. Charles 'core' Stevenson (Jul 06)
- Re: Google lists vulnerable sites. Muhammad Faisal Rauf Danka (Jul 06)
- Re: Google lists vulnerable sites. Octavio / Super (Jul 06)
- Re: Google lists vulnerable sites. Ron DuFresne (Jul 07)
- Re: Google lists vulnerable sites. Alex DeLarge (Jul 08)
- Re: Google lists vulnerable sites. Skot (Jul 08)