Re: httpspider lib and hostnames with special characters

[Djalal Harouni <tixxdz () opendz org>]

Hi,

On Mon, Mar 05, 2012 at 03:30:43PM +0100, Gutek wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Hi all,
>
> I'm on a script designed to measure the times a website takes to deliver
> its pages (DDOS attackers are looking for pages with a longer delay, as
> this is often a sign that this kind of page uses more server
> ressources). To do this I'm using the http spidering lib.
> <script working draft attached>
>
> It works (no error triggered in debug), but I have noticed something :
> when the hostname is just an alphanum format (eg: azerty.com), no problem
> when the hostname has hyphen (eg: az-erty.com), httpspider treats all
> links as "Link is not within host: http://az-erty.com/foo.bar";, and I
> have to add the withindomain argument to make it work correctly.
>
> Am I doing something wrong here, or missing a key point  ?
You're right: hostnames may contain hyphens but at the end.

-- 
tixxdz
http://opendz.org
_______________________________________________
Sent through the nmap-dev mailing list
http://cgi.insecure.org/mailman/listinfo/nmap-dev
Archived at http://seclists.org/nmap-dev/