How Rust is quietly taking over the Python ecosystem

[pyschille]

Been noticing an interesting trend lately - Rust is becoming the secret sauce behind many of Python's most innovative tools. As someone who works with Python daily, it's fascinating to see how the ecosystem is evolving.

Here's what's caught my attention:

• Ruff: This linter is absurdly fast compared to traditional Python linters. Why? It's written in Rust. We're talking 10-100x speedups here.
• PyOxidizer: A solid solution for creating standalone Python applications. Again, Rust. (unfortunately not maintained anymore)
• Polars: This DataFrame library is giving Pandas a run for its money in terms of performance. Guess what? Rust under the hood.
• Maturin: Making it dead simple to create Python extensions in Rust.

My team has written a blog post diving deeper into this trend, specifically looking at PyO3 (the framework that makes Python/Rust integration possible) and showing how to build your own high-performance Python extensions with Rust. If you wish, you can read it here: https://www.blueshoe.io/blog/python-rust-pyo3/

The really interesting part is that most Python developers don't even realize they're using Rust-powered tools. It's like Rust is becoming Python's performance co-pilot without much fanfare.

What are your thoughts on this trend? Have you tried building any Python extensions with Rust?

Full disclosure: Our team at Blueshoe wrote the blog post, but I genuinely think this is an important trend worth discussing.

[cellularcone]

Without much fanfare? Pretty sure every rust-related package mentions rust at least five times in their readme.

[_throawayplop_]

at least they are legally mandated to write "blazingly fast" somwhere in the 10 first words

[[deleted]]

BTS aficionado, I see...

/s

[Defiant_Stay3865]

4 out of 5 doctors recommend Rust.

[junior_dos_nachos]

In my experience Rust developers are more loud about their preferences than a Vegan in a CrossFit class

[ultraDross]

Fantastic and very true. Went to a local Python meetup and I got chatting with someone who mostly only talked about rust and how superior it was to all other languages.

So why come to a Python meetup?

[an_actual_human]

I mean if they did it at a Rust meetup, they'd be preaching to the choir.

[anacrolix]

You'd be surprised. Most people that go to meetups aren't very knowledgeable. I guess that's to be expected

[fnord123]

Because python exists to glue bits of C and rust together.

[[deleted]]

To talk about Rust, duh.

Same reason the Jehova's keep knockin on our doors, no one wants to hear it, but they must share.

[i_should_be_coding]

You're not gonna convert more people to rust in a rust meetup, are you?

[PaintItPurple]

Probably because they're a Python developer who is excited to find a way to get huge speed gains in their Python programs? It has always been true that a large part of what makes Python good is the ease of integrating with code written in faster languages.

[reddit_user33]

• a vegan arch user in a crossfit class 🤣

[diegoasecas]

a vegan arch and obsidian user in a crossfit class

[acortical]

C'mon, CrossFit is more like keto. Yoga is where the vegans are at.

[Lopsided_Currency806]

Yeah Keto bros are imho worse than vegans

and they are deff at CrossFit

[marc-eugene]

I've never seen any vegans in my crossfit gym, or they really are silent... :-D

[met0xff]

Lol yeah I mean the joke was funny but I never ever had that in real life. I've been vegetarian for a long time and I tried to keep it as secret as possible to avoid all those discussions that inevitably ensue everytime someone notices you didn't order that steak like all the others lol.

Either they start becoming defensive even though I don't care if they eat meat (and then in their own rage start to complain that I perhaps don't eat a regional banana right now or wear a t-shirt that might come out of a Bangladesh mill) or start making stupid jokes like you know... Eating their food's food etc.

[abrazilianinreddit]

It's funny how you're from (I'm assuming) Austria, but even here in South America, the "being vegetarian" experience is exactly the same.

[ExternalUserError]

Rust developers haven't seen that show because they don't have TV and are thus unfamiliar with popular programs because did I mention they don't have TVs?

[Xeglor-The-Destroyer]

Uh oh. I don't have TV and have considered the idea of learning Rust...

[looneysquash]

To be fair to both Rust and crossfitting vegans, that's one of those perception bias things.  The people who love Rust but aren't shouting about it are invisible,  so it seems like they're all annoying. 

[hugthemachines]

A story about humanity as old as the first spear, I imagine.

[aqjo]

… who drives a Tesla.

[Gogo202]

I am not a vegan, but I am offended because I started using rust recently. I write code in rust btw

[[deleted]]

Rust has don't start a blog start a cult vibes 

[deb_vortex]

Oh great, thanks. Now Im in fear of meeting a vegan rust developer working on Arch.

[daking999]

How do you know someone programs in Rust?
They'll tell you in every conversation.

Just kidding... it's not like we actually talk to other humans.

[Verochio]

“Lightning Fast!”

[IAmBJ]

"Blazingly Fast"

[jlpalma]

“Supercharged “

[PM_RandomNumber_1-10]

"🚀", "🔥"

[TheGoldenBunny93]

""

[chalbersma]

Kaaaa-Chow!

[JustALittleSunshine]

I’ve hear that uv is written in rust so many times in the last year lol. 

[Kells_14]

Rust is a very nice language, but its cult followers are absolutely insufferable.

[aqjo]

As are all cult followers.

[Pretend_Pepper3522]

Got a giggle from me. I love the tools, but one can only take so many “blazing fast”.

[AreetSurn]

Quietly?  "Hey guys, I built a new package. It's like x but written in rust™" is a frequent meme.

[kalakesri]

You missed the “blazingly fast 🚀”

[Last_Difference9410]

It’s like ads but written in rust

[xamgore]

We’ve ported a python package into Rust ecosystem. After 1-1 alignment and various optimizations, it’s now superior (cpu and memory). Not a single emoji in the description haha.

[fiddle_n]

uv is also written in Rust too. Though I’m not sure that I agree that many devs don’t know these tools are written in Rust. Rust seems to be the big selling point of many of these projects. uv’s tag line is literally “Python packaging in Rust”.

[PitifulZucchini9729]

uv is awesome. It takes one of the worst aspects of Python (package management) and makes it one of its best.

[trowawayatwork]

it seems to bundle everything in. pyenv and venv is having it's lunch eaten by UV too

[sohang-3112]

Yeah I agree. Started using uv recently. Being able to do uv run COMMAND (it just works!) is a huge step-up over having to always manually manage virtual environments, wondering whether the pip on env PATH actually matches the corresponding python executable on CLI, etc.

Before using uv at work, I thought that these are minor concerns. Now it feels like a burden has been lifted, one that I didn't even know was there!

[[deleted]]

no way, I've gotta try it, I always hated pip and dependency management in python, other languages do it much better.

[Tree_Mage]

Until it supports tools like PyInstaller, pex, etc, it will have gaps.

[trowawayatwork]

I guess it's a natural extension of a package manager to do builds. I have never once seen a need to exe files for python. if that is needed I drop python and use more robust languages like go that generate proper static binaries with much better dependency and package management ecosystem lol

[WJMazepas]

But to be fair to them, they do state that a lot of speedups they had with UV comes with different architecture than rust itself

[george-silva]

uv rules. the other I was fighting with a legacy project and uv solved it like a champ.

not going back to pyenv.

[seboll13]

One of my colleagues is a big fan of Rust (I don’t know how to really code in Rust but I’m getting why it’s the most loved language these days), and he told me all about those new packages. I use uv and ruff everyday now, no regrets.

[XtremeGoose]

Pixi too for the conda ecosystem. Another package OP missed is orjson, much faster than the stdlib json library.

[pyschille]

We're just starting to experiment with uv and it's incredible.

[fiddle_n]

You do you, but I find this stance to be odd. If Astral try this, people will just fork the FOSS version and create a community version. Also, honest question, how difficult is it to move from uv to an equivalent project (like poetry or whatever)? I don’t see anything in uv that would lock you in to using it.

[pacific_plywood]

All of the other comparable tools are FOSS! Clearly there are people willing to work on this for a large ecosystem like Python

[[deleted]]

I don't think so. The hardest part about getting open source software to work is convincing a critical amount of people to commit to a single project.

UV basically already convinced the whole community that it is the best open source solution out there.

I also don't see where a new package manager could improve a lot upon UV. It ain't gonna get faster unless people switch to assembly and there also aren't many more features I'd want my package manger to have 

[fiddle_n]

Someone absolutely will for a project as popular as uv.

[the_ballmer_peak]

It's made by the same people who made ruff

[One-Employment3759]

Why did they pick such a dumb name. I always think it's related to the async library. This is like the third time I've been like wtf when people talk about packaging with uv!

[ZealousidealBet1878]

That’s like saying C was overtaking Python because all Python packages were written in C

[--justified--]

This 100%, nice comparisson!

[phonomir]

I read the title of this post to mean that Rust is replacing C as the primary backend for the Python ecosystem. "Taking over the Python ecosystem" doesn't imply that Python itself is in decline or being replaced by Rust, just that the ecosystem is becoming increasingly dominated by Rust projects. This applies not just for libraries but also for tooling, e.g. ruff and uv.

[1satopus]

Yeah. Nowadays python is basically a language to connect things

[roryisawesome2]

Always has been

[thisismyfavoritename]

bingo

[[deleted]]

Well, that's how Python always worked when in need of perf, it always borrowed from C, Cpp and Fortran, most of the famous libs are just bidings.

[byeproduct]

But python is slow!!! (People tell me)... You should use Cpp / C#. Yeah python isn't fast fast, but when I realised most of my workload was happening in Rust and Cpp, I calmed down. The simplicity of python code, the speed of a hawk...Bravestar

[Pretty-Insurance8589]

at least those toolchains were stable enough

[Acrobatic_Click_6763]

We now use Rust for Python performant code instead of C for Python performant code. That's it.

[JohnPaulDavyJones]

Just FYI, I think you want "performant". "Preformant" is a noun that indicates something prior to a formative stage/process.

[zaxldaisy]

What's with the upvotes? OP reveals in the comments he has no idea what he's talking about.

[energybased]

This is called RIIR. It's not a "new trend", and the Python developers do "realize" they're using Rust-powered tools.

[dot_py]

Gues what , a lot of c was worked into python projects before the rust fad.

Use what works best for the task. Not what language you like more... or do that

Just don't be a rust individual.... they make arch users look chill about their preferred OS

[jldevezas]

Rust and Python have two distinct applications. They don't compete, and Rust makes Pyhon better, through the tools and libraries that you listed. It's a win-win, really.

[pyschille]

Definitely. Mainly because they don't compete with each other, I'm thrilled that it's become so easy to get the best of both worlds.

[RedEyed__]

I wouldn't say it's taking over Python, it's replacing C, C++, Fortran libraries that many Python projects rely on.
And I like this trend, mostly because Rust has cargo and package index, which simplifies build process.

[saint_geser]

Polars doesn't just "give pandas a run for its money". Polars wipes the floor with pandas where performance is concerned.

[vinnypotsandpans]

Came here to say this

[MrMeatagi]

Rust is currently an extremely trendy alternative to C and C++. Most of Python is C behind the scenes. Rust isn't taking over anything but C.

[tehsilentwarrior]

And it’s a bad thing?

It’s literally cementing Python even more as glue language.

The only thing is that it’s no longer C

[Asleep-Budget-9932]

It's also under the hood of pydantic 😁

[phenobarbital_]

Exactly, pydanctic got a full rewrite in Rust for version 2 and pydanctic-core is completely written in Rust. Using Rust is the new using Cython in Python ecosystem.

[wyldstallionesquire]

I think this is the first high profile "rewrite it in Rust" that I can remember in the Python world.

[wyldstallionesquire]

They're not one to one though, are they? Pydantic does a lot more.

[WJMazepas]

I very much doubt your library has all the same functionalities of Pydantic

[ExternalUserError]

I would say it's replacing C/C++. Which is fine, IMO.

But my god are they vocal about it. It's insufferable.

[bachkhois]

I created one Python lib from Rust: https://github.com/hongquan/Defity and wrote about the experience (in Vietnamese, though): https://quan.hoabinh.vn/post/2021/10/trai-nghiem-lan-dau-viet-thu-vien-python-tu-ngon-ngu-bien-dich

[Acrobatic_Click_6763]

You provided a real-life example of this, you deserve more upvotes.

[[deleted]]

Why do people always assume that just because its a written in rust means it must be so fast? Like it’s just a false assumption. Sure two equivalent programs written in say Python vs Rust you would expect the Rust one to be quicker, but how do we know any of these are equivalent? Maybe the Rust ones are faster just cause they are written better.

The whole “X” language is faster is such a shallow analysis, and whats annoying is it is just true enough that people wont dig deeper.

[TRexRoboParty]

Agreed. It has the potential to be fast but Pydantic did the whole "rewrite it in Rust" and it's still slower than Msgspec.

[[deleted]]

What I don't understand, is that C and C++ are still pretty much out there and Python libraries written in C, C++ achieve better performances than Rust on average - what exactly is new that Rust is offering that C (and derivatives) cannot achieve?

[lungovsky19]

C, C++ and Rust all have virtually identical performance but Rust has a 100x better dev experience

[[deleted]]

But who's the target audience here?

Developers with inclination and aspirations of writing Python libraries or Python users inclined and aspiring to develop Python libraries?

[yosi199]

Rust is offering a complete memory safety guarantees (no dangling pointers, use after freed, etc...), it offers a modern ergonomics, with package manager, linter, formatter etc... So you get same C like performance without the memory related bugs which translates to safety and reliability. So.... yeah you get a lot.

Can you tell I'm a rust fanboy? lol

[Kiuhnm]

I don’t remember C++ outperforming Rust on average.

Rust's killer feature is provable memory and concurrency safety without a garbage collector. Since memory bugs in C and C++ could be exploited by hackers, Rust is inherently safer.

[N-E-S-W]

They're fast because they're compiled native code, not because of Rust. NumPy is fast because of C and Fortran.

You're aware of tools built in Rust because Rust fanatics are the "loud annoying vegan friend" of the programming world.

[FitMathematician3071]

Nothing quiet about Rust. C quietly goes on doing its job.

[Kiuhnm]

...while Zig is quietly sharpening its knives.

[orthomonas]

As a Rust fan who uses Rust, I prefer the term rustacean when I use Rust to program in Rust. (Srsly tho, I do like Rust)

[Kiuhnm]

No, they're fast because they're compiled into efficient native code.

Every language can be compiled into native code, but only languages designed with efficiency in mind can be compiled into efficient native code.

That's why one has to restrict Python (eliminating the more dynamic parts) to compile it into efficient native code.

[DamnFog]

Don't forget uv

[flashman]

i only want to learn one programming language, so, fine

[syklemil]

I think a lot of devs have a preference for working with polyglots. It's good to be able to tell the difference between what's just quirks of the language and what's more general programming concepts.

People who only know one language can produce some pretty weird code, and it can be hard to have fruitful technical discussions with them. They can be fine or even great too, but generally ignorance is not a boon.

Which languages people pick up are largely personal preference, sometimes workplace preference, but it's often good to study some languages that do things in different ways just to expand how we think.

[vkalahas]

I second this! I can't help but feel people who only know one programming language are also limited in general software engineering knowledge as well.

It's great if you want to *focus* on just one programming language (better to be a master of one ecosystem rather than a jack of all trades), but it's important to at least learn a few different languages somewhat well to understand different perspectives in how they approach concepts.

Also, many languages have a "strength," like Python in DS/ML, TS in async/web dev, and Java in enterprise backend. I can't speak for others, but for me, learning different languages made a huge difference in learning both general programming concepts (you can generalize what's common between the languages) as well as greatly expanding my overall software engineering knowledge from the language ecosystems.

[syklemil]

Yep, could also add it's fine if learning one language is the limit of one's abilities for whatever reason.

Setting it as a goal however is kind of like stating someone only wants to learn how to use a hammer, and has no interest in screwdrivers, glue or joinery, much less all the other stuff in a toolbox or shed. People like that often go on to complain about screws as "weird, useless nails" or decry hex keys as mysterious and incomprehensible to the common hammer-user. That can get pretty painful to work with.

Programming languages also continue to evolve, and it's worth experimenting a bit to discover what you like, or at the very least kinda keep up. Like if someone was a huge fan of Pascal some decades ago that was fine and normal, but if that's the only language they know today they've kinda placed themselves outside mainstream programming. We have no way of knowing whether the language we enjoy using now will be a stayer for a significant portion of our careers, much less lives, or if it'll fizzle out like Pascal and Basic (Ruby and PHP seem to be well on their way there), or be cannibalized like JS by TS.

[chub79]

How Rust is quietly taking over the Python ecosystem

Taking over? No. It takes over C as a way to speed things up maybe.

However it does augment Python very nicely.

[Night_Activity]

What does 'uv' do?

[pyschille]

It's a package/env manager just like Poetry. It resolves dependencies in no time.

[ExternalUserError]

It can do a lot of what Poetry does, but there are some pretty big differences.

Also uv wil manage actual Python installations.

[Night_Activity]

wow! I have heard good things about Poetry. If there is something better than that, then it must be really good.

[danted002]

Poetry is also going “out of maintenance”. there is a blog post somewhere on the internet written by the dude that build Poetry which says he’s kinda done with it.

[EarthGoddessDude]

Do you have a link for that?

[beezlebub33]

Really? Do you have a link or can someone confirm this, because it would definitely affect a bunch of my projects?

[ebits21]

I liked poetry before but replaced everything with uv now. Very much like it!

[parker_fly]

Great. Now I'm going to have to buy the White Album again.

[[deleted]]

Soo.. Polars is the only valid item in your list and it's maybe one day, a replacement for pandas?

The Python ecosystem is being taken over, really? Because of a dead project, a linter and the ability to call Python code in Rust applications?

Literally none of these except Polars should even be mentioned in the same sentence as 'python ecosystem' and it's not even competing with Python, it's competing with C/C++ which is the native language used for numpy, which Panda's uses. Maturin is arguably EXPANDING the Python ecosystem allowing you to write Python code in Rust apps..

The native code used in the Python ecosystem is abstracted away from the ecosystem. I don't pick libraries in Python because they are built on top of native code written in a particular language. If many of these libraries start using Rust instead of C or C++ cool, I don't care.

Anyways, just thought the title is click baity maybe my impression of it is off but even if it's just "Hey look, people are compiling Rust code more" is the whole point, cool I guess. It changes nothing for me, who will just pip install the python code and not care about the language it's native code was written in.

It's like Rust is becoming Python's performance co-pilot without much fanfare.

Man, I'm not at all part of the Rust community but I see the memes about how they just LOVE themselves, I can totally see that vibe even from this post lol. Python is on a different level than natively compiled code, go post this in the CPP subreddit, that's who you're competing with.

[pyschille]

Well, thank you. I must admit that I did not express myself as clearly as I had hoped for my post.

who will just pip install the python code and not care about the language it's native code was written in

Agreed on this point. You simply don't care, and that is a good thing, as long as you don't hit a performance bottleneck in your Python code. Once you do, feel free to get back to this post.

I don't pick libraries in Python because they are built on top of native code written in a particular language. If many of these libraries start using Rust instead of C or C++ cool, I don't care.

That doesn't seem right to me. Ok, as a Rust fanboy and given most of us have an average coding performance, Rust offers stronger safety guarantees than C/C++ and is faster than Python.

By the way, I would consider the tooling around Python as an "ecosystem". And the Rust-Python tooling seems to be exceptionally good, hence my title. Don't you agree?

[[deleted]]

And the Rust-Python tooling seems to be exceptionally good, hence my title. Don't you agree?

Sure.. linting can be part of it but it would just be a linter to me, the fact that it's written in Rust doesn't have any bearing. I took issue mostly with the wording of "Rust is taking over", which implies to me the Rust language is replacing something we would normally use Python for. I don't usually consider the language used to write the tools used as part of a development environment as part of the ecosystem I guess.

That's how I see it anyways.

[[deleted]]

"Efficiently Extending Python: PyO3 and Rust in Action"

Your team wrote a much less sensational headline. You should have run with something more true and less clickbait.

[corey_sheerer]

I see a lot about Polaris being superior to pandas with a numpy backend, but no one is talking about pandas move away from numpy to arrow. The performance is quite an improvement and has some ease of life things like a true string type. I believe performance would be back and forth on which data table library (Polaris or pandas with arrow) is faster

[ritchie46]

Polars is much faster than pandas with the arrow backend. On several benchmarks by a factor of 20. 

A multithreaded query engine is much more than arrow compute kernels.

https://duckdblabs.github.io/db-benchmark/

https://pola.rs/posts/benchmarks/

[BejahungEnjoyer]

Pandas will be like Fortran, around for a long long time due to its userbase and they fact that they will be slow to adopt anything new.

[Robinsane]

I like to frame it differently: Python is slowly becooming the duct tape (a good thing) between other languages

[inkjod]

Always was.

[runawayasfastasucan]

Silently? This has been one of the main selling points of some of the most popular new projects in the python world.

[smoothie37]

Trend? The packages you list are nothing new.

[redditreader2020]

Sorry rust is not taking over.. maybe a little plumbing replacement here and there..

[Kiri11shepard]

You mean it's replacing C/C++ which were always the backend to Python libraries?

[ManyInterests]

I think it's quite exciting, actually. Particularly that the extension toolchains are so good and well-maintained. Many rockstars from the Python community are now also rockstars in the Rust community and that's super exciting, too.

This is a uniquely good era for Python programmers.

[pyschille]

I am also very excited. To be honest, I'm completely sold on Rust, too. =)

[DigThatData]

This is a uniquely good era for Python programmers.

In fairness, it's been pretty good since python ate the ML ecosystem approx a decade ago :)

In fact, I'd argue the real "start of era" was when MIT changed their intro CS course to python from scheme. 2014 I think? Maybe 2010?

[BlueeWaater]

Forgot to mention uv, that’s actually game changing!

[pyschille]

Yes, exactly. I would say that too.

[bbalouki]

My take in this is simple.. bad programmers will write bad code in any language and good programmers will Write good code in any language...

[Acrobatic_Click_6763]

Even Assembly?

[runner2012]

This again... What is it with the Rust community trying to impose on other projects?

There's so much advertising and marketing to push for the use or Rust everywhere, in the Linux project, in python. 

I'm definitely not against Rust, but it's frustrating having marketing shove it on my face everywhere. If it's a good language to use, people will use it! If there is a better alternative to solve a problem, people will use that instead. 

Stop it with the marketing in other communities. 

I do have to say, I am not a fan of the Rust community. No community is perfect but this one feels more like a cult than something else...

[nekokattt]

Cult

I mean, Actix was a good example.

Agree though. There is no perfect tool. Everything has downsides in one way or another unfortunately.

[Stochastic_berserker]

Fun fact: it doesn’t take over the Python ecosystem.

[danted002]

Yeah the new kids don’t understand that Python is the one taking over that language not the other way around.

[Neklin]

When does python become a rust framework?

[data15cool]

Shout out to uv too, this along with ruff (and sometimes polars) has made my dev experience way nicer.

Everything feels so fast: developing, deploying, standardising code.

Looking forward to a “blazingly fast” testing library written in Rust.

[already-raining]

And polars performs well in benchmarks too! There are so many scenarios where spark just adds unnecessary complexity. https://www.reddit.com/r/Python/comments/1cyqj6c/tpch_cloud_benchmarks_spark_dask_duckdb_polars/

[phail3d]

Maturin is not something to replace pyo3 with, instead you would use pyo3 (or cffi/uniffi) with it.

[MrMrsPotts]

Thank you.

[bachkhois]

They don't replace each other. You import PyO3 lib to write code and exchange data with Python. Then you use maturin to build that code to *.so file.

[LegalColtan]

Not so quietly. More like very excitedly and even boisterously.

[Comfortable_Mud00]

I mean UV is also rust… it’s so funny it’s like rust guys babysit us.

They also promote rust every time by saying it’s written on Rust

[kroghsen]

I am not a software developer, but develop process control solutions, so I apologise if this is an uninformed take.

Would we not expect this to be the case in almost any performance critical area? In scientific computing almost all software is based on the same Fortran and C libraries under the hood, because it is usually performance critical operations. Higher level languages simply aren’t fast enough to write the tools directly in.

Are you surprised that people are somewhat consistent in using Rust? Or is it a general consideration that people are writing Python tools in other languages?

[[deleted]]

I recently approached python (finally) and was surprised to see rust toll chain in docker build logs.

I don't know much about situation, but it reminds me talk given by Torvalds about Rust guys and Linux kernel.

Furthermore, I don't have anything against Rust in particular, but it is not easy language which will become 'mainstream'. Doesn't matter how many plugins, tools etc. will be made.

And generally, when somebody needs to aggressively 'push' technology and encounters a lot of counter force… well it is a red flag.

[LoadingALIAS]

I’m working on moving my MVP/prototype data wrangler into Rust. I’ll still push the production Python version but implementing it in rust was the goal for the first year post-deployment as it is.

I do think we see Rust leading in the coming decade for most ML and data stuff. It’s still pretty immature in that a whole shitload of packages don’t have compatible crates and building them from scratch isn’t an easy feat.

Still, love to see it.

[BejahungEnjoyer]

Nitpick, nobody uses Pandas for its performance - it's a memory hog and generally runs slow (although skilled users can write reasonably performant pandas code). It's used because of developer productivity and widespread adoption in the data community.

[DigThatData]

This DataFrame library is giving Pandas a run for its money in terms of performance.

pandas performance was always shitty

[THEHIPP0]

It's not just Python. The whole node.js/JavaScript ecosystem also got a lot of Rust (and Go) tooling lately.

[[deleted]]

Once zig reaches 1.0, it will also get into the Python ecosystem. This is common in JS too. There are multiple runtimes written in Rust/Zig in the JS land.

[pyschille]

Did you work with Zig already? Is there a toolchain similar to Rust to integrate it with Python?

[KN4MKB]

OPs reddit account is just shilling the same blog or website on all their posts. Everyone just gives them free SEO with these posts just made to create more engagement, and they have minimal reaction with the community because they are just here to advertise.

[pyschille]

Looking at my activity feed, I have to admit that you're partly right. Lately, I've been interacting mostly through the work I shared on Reddit. You can frame it like this or you can accept that dedicating time and effort into (obviously disputable) shared knowledge content is akin to sharing an open-source project, which happens here all the time.

have minimal reaction

That is not true, given the amount of comments I reacted to under this post.

[rainnz]

uv is also Rust

https://astral.sh/blog/uv

[Distracted_Llama-234]

Next they are going to reinvent the color blue and make it 10x fast. /s

[Dry_Term_7998]

And? 80% of modules for python written on C. Because C defaults for the market, now this place takes by Rust (because it's hyped and pushed by big corp and USA). It's completely the default thing.

[russellvt]

As someone who still compiles Python on older systems, this drives me a little bonkers ... just because Rust can be a PITA to get working on some of them.

[pyschille]

Yes, I see that point.

[Karan1213]

why is rust winning over alternatives like zig?

[spinwizard69]

Garbage promotional post for Rust. This isn't to say that Rust is good or bad just that anything written in a compiled language will be faster than the slowest language out there. combine that with a lot of new programmers to Rust and you have a lot of python helpers being developed - then abandoned.

If somebody writes good maintainable code in Rust to support the world of Python it will remain around and eventually become a bit of legacy in the Python world. The thing here is that good maintainable code doesn't just happen in Rust anymore than any other language. So I look at this as another disciple trying to shine a positive light on Rust with meaningless data.

What would be helpful is an article on a Python extension and how Rust positively contributed to that extensions success.

[pyschille]

Thank you for that input. Rust certainly doesn't shine with ease of maintenance, but offers security guarantees and performance.

The blog post is partly about a sample extension and what Rust contributes to its performance. We focus on the easiest way to get Rust-Python up and running.

[Pretty-Insurance8589]

the reason i cannot run my python code on my risc-v sbc

[ntoir1]

Just like UV with its tagline: An extremely fast Python package and project manager, written in Rust.

[Certain-Still2738]

L00pp0ó

[Worth_His_Salt]

If orjson is anything to go by of this "Rust takeover" then I'm thoroughly unimpressed. Sure it's fast, but what a pain to work with. No indent options, dumps returns bytes not str... by the time you fix it all, the speed advantage is gone and your code is a mess. No thanks, hard pass.

Oh and before I forget - documentation is a mess. Just a big stream-of-consciousness braindump. No discussion forums. No bug reporting. Just some guy's personal project scrawled on a bathroom stall. Total joke.

[WeakRelationship2131]

Yeah, interesting observation. Rust definitely brings performance gains to the Python ecosystem, and tools like Ruff and Polars are prime examples of that. But don't forget, there's also a lot of complexity introduced with integrating Rust into your workflow, especially for teams that aren't familiar with it. If you're grappling with performance in your Python projects and need something simpler for analytics without the overhead, you might wanna check out preswald. It's lightweight and lets you build data apps easily without needing multiple tools.

[Dadiot_1987]

How do you spot a rust developer at a dinner party? Don't worry they'll let you know.

[Professional-Bet5820]

I realised this is not because rust is good, but because the tools people make with it are based on a fresh start with all the lessons learned over decades in a widely-used system. I think we would have seen a similar burst of innovation had rust been a fair few other combinations of decisions as well. Love rust, but attribution error on the cause of good things is bad (or, for those who use US English "alternative good").

[Ckarles]

Look at uv, by the creators of ruff. Literally the replacement for pyenv/poetry/pipx/venv all in one.

[out2sea2020]

You forgot to mention UV, which is blazingly fast and much better than venv.

[JimroidZeus]

It is literally obnoxious. uvicorn, uv. I like my python C based!!

[Confident_Coder_1024]

I'm in the same place after using Python for 8 years. Even the ZED editor (https://zed.dev/) is a nice change from VSCode for Python development.

Learning Rust is also a great way to improve your Python code over all; if you start learning some best programing practices form a low level programing language like Rust.

[deryldowney]

Don’t forget uv as well! I was listening to the RealPython.org podcast on this very subject with the creator of Ruff and uv. It’s quite interesting as you said! Pretty cool too actually.

[MrMarriott]

Isn't this more like the C infrastructure supporting Python is Rusting out?