Re: Python and asynchronous sockets question

[David Hoelzer <dhoelzer () enclaveforensics com>]

Threading can be for more CPU intensive stuff... but it's really for any application where you would like more than one 
thing to happen at the same time rather than serially.  For a scanner, you want multiple simultaneous babysitters, not 
one babysitter going from port to port.

On Jan 10, 2013, at 10:34 AM, allison nixon <elsakoo () gmail com> wrote:

> AFAIK threading is more for cpu intensive stuff
>
> In my case I'm opening a socket and sending the request(faster)
> and then babysitting the socket until it times out or receives the response(very slow)
> then parse the input(not nearly as much of this)
>
> since this is I/O heavy, i saw asyncore recommended as the fastest option.  i already artificially set the timeout 
> limit very low for a socket to cut overhead.
>
> On Thu, Jan 10, 2013 at 10:22 AM, Scott Kragen <skragen () gmail com> wrote:
> Allison,
>
> Have you looked into threading for python?  I have used this library in several of projects because writing a thread 
> pool from scratch started to give me a headache.
>
> http://code.activestate.com/recipes/577105-synchronization-decorator-for-class-methods/
>
> The advantage of a thread pool is it can que based on the max amount of threads you define.
>
> Scott  
>
> On Thu, Jan 10, 2013 at 10:06 AM, allison nixon <elsakoo () gmail com> wrote:
> Say I'm writing a broadscanner for a pet project and I accidentally wrote the entire thing in Python.
>
> Using asyncore and sockets, the best I can get is 3 http requests per second, maybe 10 per second at the very max.  
> For a scanner this is of course, very lame.
>
> My goal is to of course make as many http request as a desktop computer will handle, so perhaps 200 per second with 
> whatever number of sockets waiting in the background for a response(which I check periodically for a response and 
> parse when I get it)
>
> Is there any way I can acheive 200 requests per second without learning another programming language?
>
> _______________________________________________
> Pauldotcom mailing list
> Pauldotcom () mail pauldotcom com
> http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom
> Main Web Site: http://pauldotcom.com
>
>
>
> -- 
> ----------------------------------------------------------------------------------------------------------------------
> There is only one metric in security that can be truly measured and that is failure!
>
> --- Jack Daniels 
> ----------------------------------------------------------------------------------------------------------------------
>  
> _______________________________________________
> Pauldotcom mailing list
> Pauldotcom () mail pauldotcom com
> http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom
> Main Web Site: http://pauldotcom.com
>
>
>
> -- 
> _________________________________
> Note to self: Pillage BEFORE burning.
> _______________________________________________
> Pauldotcom mailing list
> Pauldotcom () mail pauldotcom com
> http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom
> Main Web Site: http://pauldotcom.com


---------------------------------------------------------
David Hoelzer
Director of Research, Enclave Forensics
dhoelzer () enclaveforensics com




_______________________________________________
Pauldotcom mailing list
Pauldotcom () mail pauldotcom com
http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom
Main Web Site: http://pauldotcom.com