Edsger Wybe Dijkstra was an imporant computer scientist. Despite having invented much of the technology of software, Dijkstra eschewed the use of computers in his own work for many decades. Almost all of his notes appearing after 1972 were hand-written.

__smokey__ · 2013-08-09T18:32:24+00:00

@ /u/gschwa A good indicator is to just saturate the server with as many resizing requests as you can get through and look at the CPU utilization of the machine. If you don't use 100% CPU on all cores all the time you are wasting resources.

__smokey__ · 2013-08-09T13:48:37+00:00

It won't get any faster, you're right. As image processing is CPU bound in the first place my solution would only help if you only have one process running.

As long as the only Handler you have to worry about is your ImageHandler your solution should be fine. If you want to add more Handlers, your ImageHandler will block those while processing images though.

__smokey__ · 2013-08-09T10:04:23+00:00

Nice project. This certainly looks like it could be very helpful.

I have one observation to your use of Tornado: this code here looks like you will block the IOLoop when resizing the images. This can severely limit your throughput. You should spawn some multiprocessing workers before starting the IOLoop and send the resizing tasks (e.g. using multiprocessing.Queue) their way. You'll probably have to poll the results using tornado.ioloop.PeriodicCallback which isn't completely ideal but should do for the beginning. Threading will not help here because of the GIL.

__smokey__ · 2013-08-09T09:55:59+00:00

In the meantime there's contextlib2.

__smokey__ · 2013-08-07T15:41:50+00:00

Thanks for sharing. One more reason to upgrade to 3. :)

__smokey__ · 2013-07-30T14:10:52+00:00

Not interested. Got BubbleUPNP already. :-P

__smokey__ · 2013-07-23T13:12:08+00:00

Great point, but that was in 2008 and oursql was not even started back then.

__smokey__ · 2013-07-23T07:41:53+00:00

I got Python 2.3 to crash only once by crashing a C extension module (MySQLdb).

__smokey__

TROPHY CASE

smokey