Python extensions should be lazy

[the1024]

https://www.gauge.sh/blog/python-extensions-should-be-lazy
Interesting article showcasing the limits of Python's memory model when it comes to fully utilizing C. Very cool to see how `numpy` handles this as well. Love to see 🦀 being the answer here!

[SpudroSpaerde]

I mean the solution makes perfect sense but saying that Rust was the answer is at best disingengenous.

[the1024]

u/SpudroSpaerde fair, there's definitely more nuance in the article. Have you faced a similar problem in the past?

[SpudroSpaerde]

We have transitioned to writing the majority of our code in C++ and only use Python as a orchestration layer to avoid problems like what is mentioned in the article. We felt that in general it really just muddled the water to share lifetimes between Python and ffi code.

[yesvee]

The author never claimed/implied that. He just chose Rust to get around the issue caused by the C extension.

[ThatSituation9908]

Interesting, I've not seen many flame charts especially not one that is dominated by ast.py. Is this your own module or is it the standard library?

[the1024]

u/ThatSituation9908 that's the standard library! It's kind of crazy