Re: Looking for a good web spider

[Jim Halfpenny <jim.halfpenny () gmail com>]

Hi,
With Java applictions like Paros and Burp consider increasing the heap
size if you are going to do a large crawl. Because the JVM is
contrained to the max memory value on start up (e.g. -Xmx512M) it may
run  out of memory well before your system does. I'm just guessing
that this is the cause, check your logs for more info if they exist.

If you look in suite.bat you'll see that the max heap size is set to
-Xmx512m. Try increasing this and see how you get on.

Cheers,
Jim


On 26 September 2010 13:30, Adrian Crenshaw <irongeek () irongeek com> wrote:
> Playing with Paros and Burp, both seem to hang after a long enough spider.
> Bummer. I may end up modding some of Robin's code.
>
> Adrian
>
> _______________________________________________
> Pauldotcom mailing list
> Pauldotcom () mail pauldotcom com
> http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom
> Main Web Site: http://pauldotcom.com
_______________________________________________
Pauldotcom mailing list
Pauldotcom () mail pauldotcom com
http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom
Main Web Site: http://pauldotcom.com