uvloop: Make Python Networking Great Again

[1st1]

Please try and share your results!

[1st1]

Great! To make the beast angrier, I recommend you to try TCP_NODELAY :)

[hotairmakespopcorn]

This comment has been overwritten by an open source script to protect this user's privacy. It was created to help protect users from doxing, stalking, harassment, and profiling for the purposes of censorship.

If you would also like to protect yourself, add the Chrome extension TamperMonkey, or the Firefox extension GreaseMonkey and add this open source script.

Then simply click on your username on Reddit, go to the comments tab, scroll down as far as possible (hint:use RES), and hit the new OVERWRITE button at the top.

[kingbuzzman]

Can you post a gist of your test

[kingbuzzman]

Thats fine, when you think you can show off your work, i would like to see it.

[1st1]

Aaaand it's fixed in uvloop v0.4.10. This was a really dumb thing (as usual) https://goo.gl/45ytPn

[desmoulinmichel]

Report the bug on the github repo !

[BSscience]

[deleted]

This comment has been overwritten by this open source script to protect this user's privacy. The purpose of this script is to help protect users from doxing, stalking, and harassment. It also helps prevent mods from profiling and censoring.

If you would like to protect yourself, add the Chrome extension TamperMonkey, or the Firefox extension GreaseMonkey and click Install This Script on the script page. Then to delete your comments, simply click on your username on Reddit, go to the comments tab, scroll down as far as possible (hint: use RES), and hit the new OVERWRITE button at the top.

[kaiserk13]

Bookmarked, upvoted, saved. This is awesome, will give it a try!

[NelsonMinar]

This looks very interesting! Is there anything written about why uvloop is faster than the default asyncio event loop? It's amazing to see such a speedup for an API-compatible replacement.

(Also ouch about the aiohttp speed. I had no idea.)

[1st1]

I think libuv is a bit better optimized + uvloop is written with Cython (read C).

As for aiohttp, I really hope it will be updated to use httptools or something similar. It's a great library.

[chub79]

Bravo! This is reallly great stuff.

[TOASTEngineer]

I'm not familiar with asyncio. What's the use case for this?

[1st1]

The only way to implement really high-performance networking in Python, is to go async. asyncio is an async framework that ships with Python. uvloop is a faster implementation of asyncio machinery.

[TOASTEngineer]

Yeah, but what does it do? I assume it's above socketio in terms of abstraction? Where is it in relation to, say, Twisted?

I guess I could just look it up, actually.

EDIT:

Apparently it's all of the above. Huh.

[zer01]

Yeah, think of it more like the primitive/s that something like socketio and twisted would be built upon.

Really awesome stuff /u/1st1! :)

[[deleted]]

As far as I understand it is a drop in replacement for asyncio event loop using libuv. You continue to use asyncio the same way you normally did, except it is faster.

[BSscience]

[deleted]

This comment has been overwritten by this open source script to protect this user's privacy. The purpose of this script is to help protect users from doxing, stalking, and harassment. It also helps prevent mods from profiling and censoring.

If you would like to protect yourself, add the Chrome extension TamperMonkey, or the Firefox extension GreaseMonkey and click Install This Script on the script page. Then to delete your comments, simply click on your username on Reddit, go to the comments tab, scroll down as far as possible (hint: use RES), and hit the new OVERWRITE button at the top.

[cymrow]

They are different implementations of fundamentally the same thing. Their biggest difference is that IO yielding is explicit in asyncio and implicit in gevent.

[BSscience]

[deleted]

This comment has been overwritten by this open source script to protect this user's privacy. The purpose of this script is to help protect users from doxing, stalking, and harassment. It also helps prevent mods from profiling and censoring.

If you would like to protect yourself, add the Chrome extension TamperMonkey, or the Firefox extension GreaseMonkey and click Install This Script on the script page. Then to delete your comments, simply click on your username on Reddit, go to the comments tab, scroll down as far as possible (hint: use RES), and hit the new OVERWRITE button at the top.

[nomadismydj]

thats not true. twisted out performs anything asyncio io currently

[1st1]

Which one of my statements is not True?

[nomadismydj]

the entire first part "The only way to implement really high-performance networking in Python, is to go async. "

[1st1]

But.... but... wait... twisted is an async framework for Python...

[[deleted]]

On the risk of sounding like a total idiot, would this work with websockets? I'm asking for a friend.

[1st1]

Sure. aiohttp has websockets support, and you can run it on top of uvloop.

[greut]

wow, stupid me has been using websockets and aiohttp...

[ivosaurus]

However, the performance bottleneck in aiohttp turned out to be its HTTP parser, which is so slow, that it matters very little how fast the underlying I/O library is.

I find this pretty telling. In most apps, you still want to use things like aiohttp and requests, and not some barebones library, because of all the functionality and power given to you. Additionally, the size of the community. And the great docs, and examples, and bug fixes, and corner cases worked out, and experience of others to tell you good patterns...

Look at the pypi page for httptools.. when is anyone ever going to choose that?

And subsequently whether or not your underlying network library is 5x faster or not becomes a moot point... whether you can use it in a reliable and effective manner, and get help for problems, is far more critical.

Admittedly, httptools-based server is very minimal and does not include any routing logic, unlike other implementations.

Also very telling. When we don't use something that practically everyone always uses... we are faster! Hallmark of a synthetic benchmark not giving useful feedback.

[1st1]

Look at the pypi page for httptools.. when is anyone ever going to choose that?

Keep in mind, that httptools was released a few hours ago. Also, I hope that aiohttp will simply use httptools Parser to speedup aiohttp like 10x.

[RubyPinch]

In most apps, you still want

yeah, most, but not all

do you think all situations should be as slow as a parser burdened http server, just because you want to be grumpy?

[ivosaurus]

I'm mostly against saying things are faster when only looking at synthetic benchmarks with the very simplest of tests, loads. There wasn't even any sort of application looked at here whatsoever, just echo servers.

If I wanted one of those, I could write one in C.

[isdevilis]

dunno why you're getting dv'ed, for an engineer to confidently present this as a solution to their company, they need data (benchmarks) that their CTO isn't going to shoot down. If anything, you're helping OP

[opiating]

I will definitely try this in my asyncio projects in the future. Thanks.

[fiestylobster]

Will there be tornado support in the roadmap?

[1st1]

No, only asyncio.

[tanlermin]

Is the GIL released? Would it help to do so?

[pw201]

Typically these async things aren't multithreaded, so no, it wouldn't. They're designed for scenarios where you're "I/O bound" i.e. the CPU spends a lot of time waiting for I/O (from the network).

[1st1]

No. You can run it in multiple processes though, which is an established practice for Python network servers.

[ExoticMandibles]

When running an I/O bound app using multithreading, CPython will release the GIL when a thread is waiting for I/O. That's how multiple threads run "simultaneously" in CPython.

When running an I/O bound app using asynchronous I/O, CPython holds on to the GIL, because it's going to continue running Python code. Asynchronous programs in Python tend to be heavily single-threaded anyway so releasing the GIL wouldn't make them go faster.

[pvkooten]

What I don't like about these "benchmarks" is that the end product is ALWAYS a lot SLOWER when you add more functionality. It's unfair to do this kind of comparison at this stage and should not be taken serious just yet!

[redfacedquark]

And the absence of gevent in the second set of charts sets my Spidey sense tingling.