Nmap Development mailing list archives
httpspider lib and hostnames with special characters
From: Gutek <ange.gutek () gmail com>
Date: Mon, 05 Mar 2012 15:30:43 +0100
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi all, I'm on a script designed to measure the times a website takes to deliver its pages (DDOS attackers are looking for pages with a longer delay, as this is often a sign that this kind of page uses more server ressources). To do this I'm using the http spidering lib. <script working draft attached> It works (no error triggered in debug), but I have noticed something : when the hostname is just an alphanum format (eg: azerty.com), no problem when the hostname has hyphen (eg: az-erty.com), httpspider treats all links as "Link is not within host: http://az-erty.com/foo.bar", and I have to add the withindomain argument to make it work correctly. Am I doing something wrong here, or missing a key point ? Thanks, A.G. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk9UzhMACgkQ3aDTTO0ha7hBlgCfcRFh2quF97lHB/FmKV/009I6 rwsAmQHoru9IotsT5w9nw++JKcs/odfG =Y8r/ -----END PGP SIGNATURE-----
Attachment:
http-chrono.nse
Description:
_______________________________________________ Sent through the nmap-dev mailing list http://cgi.insecure.org/mailman/listinfo/nmap-dev Archived at http://seclists.org/nmap-dev/
Current thread:
- httpspider lib and hostnames with special characters Gutek (Mar 05)
- Re: httpspider lib and hostnames with special characters Djalal Harouni (Mar 05)
- Re: httpspider lib and hostnames with special characters Djalal Harouni (Mar 05)
- Re: httpspider lib and hostnames with special characters Gutek (Mar 05)
- Re: httpspider lib and hostnames with special characters Djalal Harouni (Mar 05)
- Re: httpspider lib and hostnames with special characters Patrik Karlsson (Mar 05)
- Re: httpspider lib and hostnames with special characters David Fifield (Mar 05)
- Re: httpspider lib and hostnames with special characters Patrik Karlsson (Mar 06)
- Re: httpspider lib and hostnames with special characters Gutek (Mar 06)
- Re: httpspider lib and hostnames with special characters Djalal Harouni (Mar 05)
- Re: httpspider lib and hostnames with special characters Djalal Harouni (Mar 05)