Re: [NSE] http-useragent-tester.nse

[George Chatzisofroniou <sophron () latthi com>]

On Thu, Jul 25, 2013 at 09:10:56PM +0300, George Chatzisofroniou wrote:
> The attached script sets various User-Agent headers that are used by different
> ultities and crawling libraries (for example CURL or wget). If a request is
> redirected to a page different than a (valid) browser request would, that
> means that this ultity is banned.

I sorted the results by "allowed" and "forbidden" so now the output looks like this:

 | http-useragent-tester:
 |
 |     Allowed User Agents:
 |
 |     lwp-trivial
 |     PHP/
 |     Python-urllib/2.5
 |     GT::WWW
 |     Snoopy
 |     MFC_Tear_Sample
 |     HTTP::Lite
 |     PHPCrawl
 |     URI::Fetch
 |     Zend_Http_Client
 |     http client
 |     PECL::HTTP
 |     WWW-Mechanize/1.34
 |
 |     Forbidden User Agents:
 |
 |     libwww redirected to: https://www.facebook.com/unsupportedbrowser (different host)
 |     libcurl-agent/1.0 redirected to: https://www.facebook.com/unsupportedbrowser (different host)
 |_    Wget/1.13.4 (linux-gnu) redirected to: https://www.facebook.com/unsupportedbrowser (different host)

I commited the script to the trunk as revision 31730. I may come back and do
further improvements on the script later based on the research i'm doing.

-- 
George Chatzisofroniou
_______________________________________________
Sent through the dev mailing list
http://nmap.org/mailman/listinfo/dev
Archived at http://seclists.org/nmap-dev/