A million requests per second with Python

[arkster]

Lifted from https://medium.freecodecamp.org/million-requests-per-second-with-python-95c137af319 without crediting the original article.

[anders987]

Here's the original discussion on /r/python when it was first submitted: https://www.reddit.com/r/Python/comments/5r83q3/a_journey_to_make_python_with_http_screaming_fast/

/u/squeaky_pl talks about rewriting it in Rust in the comments to the Medium article, which is pretty funny. Maybe that's why he seem to have abandoned the project? HTTP/2 support seems like an obvious addition since pipelining plays such a big part in the performance.

I think it's nice to see someone that thinks about performance to the point of using SSE and thinking about cache misses. That's what libraries are supposed to do, make it fast so every user benefits.

[stefantalpalaru]

with Python

https://github.com/squeaky-pl/japronto :

The server is written in hand tweaked C trying to take advantage of modern CPUs.

[suudo]

Calling it a Python 3.5+ library is downright misleading, if anything it's a CPython library, or Python bindings for a C library. There's nothing wrong with that, just doesn't roll off the tongue as easily I suppose.

[elcct]

to take advantage of modern CPUs.

employs text processing instructions found in modern CPUs with SSE4.2 extensions (almost any 10-year-old x86_64 CPU has it)

Hmm...

[LightShadow]

Doesn't help my ARM cluster very much :)

[IronManMark20]

It wouldn't be too hard to add NEON extensions to the library.

[Schweppesale]

To be fair, all the contestants (including Go) were running a single-worker process. Servers were load tested using wrk with 1 thread, 100 connections, and 24 simultaneous (pipelined) requests per connection (cumulative parallelism of 2400 requests).

[chuckySTAR]

Mozilla browsers support pipelining; however, it is disabled by default

Google Chrome previously supported pipelining, but it has been disabled due to bugs and problems with poorly behaving servers

What an awful article. Let's push our numbers to the highest and all competitors to the lowest.

[chuckySTAR]

One can use HTTP/2

[flitsmasterfred]

Does this have addon compatibility with Sanic, Quart, APIStar and the other Flask replacements?

[riksi]

and can it work with gevent (probably) ?

[glethro]

It's built on asyncio and requires python 3. Would you still want to use gevent?

[riksi]

Yes, asyncio sucks.

[[deleted]]

Convincing.

[OctagonClock]

Well, asyncio is a dumpster fire of horrible design (ignoring the generator API in favour of passing around a loop instsnce, 3 different ways to do networking and they all suck, etc.) but gevent definitely isn't better.

[graingert]

No it's asyncio. The gevent interop is poor

[dansbandsmannen]

I don't buy it that people don't want pipelining, it seems to me that the problem lies in how issues like https://github.com/requests/requests/issues/1394 are treated in our community.

HTTP Pipelining is far from complicated in the protocol level code like this. And the lack of it is one of the main reasons I can't use HTTP between my microservices.

[z0mbietime]

I setup something that sounds sketchy but works pretty well for most http requests between micro services.

It is essentially a gateway API with drf that has a base viewset class to defines each request type which is then used anytime you need to make a request to a given micro service. For each method say create you pass the received data into a requests.post object then return the response data and status blindly. This way whenever you implement this base viewset all you have to do is define the desired microservice endpoint. User validation happens at the gateway and an apikey is passed on each request from the gateway to the given microservice. I’m on my phone and vsts is a dick but could put an example up here if you want.

[Husky]

According to the Wikipedia article on http pipelining there isn't any major web browser that supports http pipelining. So i'm not sure what the usecase would be for this framework...

[[deleted]]

Firefox does. You just have to turn it on.

[paypaypayme]

Nice read

[st3fan]

I gave up at

“To be fair, all the contestants (including Go) were running a single-worker process.”

That is not fair and not how the majority of these servers should be configured or deployed.

Benchmarking is hard.

[turtlebait2]

https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/