PaulDotCom mailing list archives

Re: Python and asynchronous sockets question


From: Scott Kragen <skragen () gmail com>
Date: Thu, 10 Jan 2013 10:22:23 -0500

Allison,

Have you looked into threading for python?  I have used this library in
several of projects because writing a thread pool from scratch started to
give me a headache.

http://code.activestate.com/recipes/577105-synchronization-decorator-for-class-methods/

The advantage of a thread pool is it can que based on the max amount of
threads you define.

Scott

On Thu, Jan 10, 2013 at 10:06 AM, allison nixon <elsakoo () gmail com> wrote:

Say I'm writing a broadscanner for a pet project and I accidentally wrote
the entire thing in Python.

Using asyncore and sockets, the best I can get is 3 http requests per
second, maybe 10 per second at the very max.  For a scanner this is of
course, very lame.

My goal is to of course make as many http request as a desktop computer
will handle, so perhaps 200 per second with whatever number of sockets
waiting in the background for a response(which I check periodically for a
response and parse when I get it)

Is there any way I can acheive 200 requests per second without learning
another programming language?

_______________________________________________
Pauldotcom mailing list
Pauldotcom () mail pauldotcom com
http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom
Main Web Site: http://pauldotcom.com




-- 
----------------------------------------------------------------------------------------------------------------------
There is only one metric in security that can be truly measured and that is
failure!

--- Jack Daniels
----------------------------------------------------------------------------------------------------------------------
_______________________________________________
Pauldotcom mailing list
Pauldotcom () mail pauldotcom com
http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom
Main Web Site: http://pauldotcom.com

Current thread: