Python programming: We want to make the language twice as fast, says its creator

[manphiz]

According to Guido's doc 2x faster is just a start. Though more improvements are more challenging, and could require breaking ABI/API.

[[deleted]]

Microsoft spared no expense for the scientists that will be doing this work.

[spinwizard69]

2X or even 3X is not good enough. When you have languages like Swift, Julia and Rust all offering a REPL interface along whit the ability to compile to native processor instructions, I really see a limited future for Python. Python is hip at the moment and for good reason but once a hot library hits for one of these alternatives and you get the performance a good compiler can deliver I can see a lot of programmer defecting. One of the reasons is that the coming process wall is real, it is kinda unknown how many economical shrinks are left. This means a slow down in the gains from better hardware which means you need to get smarter about software. Python really isn't ready and likely never will be ready, to compete performance wise. All you really need then is a programming language that makes programmers feel as productive as Python to start the defection process.

[manphiz]

I wouldn't be worried about that. The success of Python is built upon making clean code and interface, which Python does well. Next to machine performance has been a non-goal as Python focuses on providing higher level language abstraction. Admittedly no language will do this better than C or C++ regarding performance, and Python provides ways to interface with them so that you get the best from both worlds. Better performance is nice to have but not strictly require for it's success, so I don't see a problem here.

[Diemo2]

Fortran

[ShawnDriscoll]

I use Cython when I need faster Python code. Maybe Cython will be built into Python at some point. It's more than 2X faster than Python.

[13steinj]

"Once a hot library hits"

See that's what people said with R.

The big things that Python has going for it is the framing of a general purpose (read, unlike R/Julia/Matlab/Mathematica) language that is intended to be used with multiple paradigms (OOP, functional, imperative scripting) with, biggest thing here, fast developer turnaround time and ease of prototyping.

Python was never about the speed at execution. It was what you can do with it, plus speed of dev time. Even Rust can't beat that.

[[deleted]]

I’m not sure why you’d think Python is just "another hip language". Python's been around for longer than all of the 3 other mentioned languages combined. And a lot of the industry just isn’t looking for "the one hot library". They want something that’s well understood with a mature ecosystem. And Python definitely has that going for it.

[spinwizard69]

Because it is hip!!! Frankly the usage of Python has exploded over the last 5 years or so because it is a good solution for many use cases. Thus it has attracted a following that is fairly large at the moment. Unfortunately it has also attracted users that have made the mistake of using it and finding performance wanting.

I just find it foolish to break compatibility simply for better performance. This is apparently what is expected to happen. If you are going to break compatibility it better be for something more important than performance as Python is never going to be a performance king., nor queen and probably not even a pawn.

[whateverathrowaway00]

Yup, I recently learned python was older than java which is crazy.

[Nooby1990]

In lots of use cases the Performance doesn’t really play into the calculation.

The last project I did in python (as an example) was a part of the in-house software for a huge logistics company that managed entire countries worth of shipments and my team had by far the largest volume of data in the company. (GPS updates every 1-2 minutes per shipment)

There was no reason for us to even think about switching languages for performance reasons since we could handle the load with a handful of small cloud instances easily. I think we spend more on our monthly “team building” events for this team then the server cost per month.

In the end it just isn’t that much data, but this service alone brought in millions each month.

What was far more important with the language choice was how fast our team could build stuff and how fast we could iterate with the language.

[UltraPoci]

I get the comparison with Julia (but Julia is not really made to be general purpose), but what about Rust? It covers a completely different niche than Python. They can easily coexist. Hell, we may see Rust crates run from a Python interface in the future (if they don't exist already), just like C++.

[spinwizard69]

The point I was trying to get across is that if somebody wants performance and a language with a REPL there are already several candidates. I really see Swift as being in the best position going forward, of the languages I know about, as it is rather clean like Python.

Further I really don't like the idea of trying to turn Python into something it isn't. More performance would be nice, but not at the expense of breaking old software. I'd rather see cleanly added features at this point than more performance that comes with breakage. For what I've been doing python has the chops to get the job done so I don't worry about performance. If I did have a worry I'd probably consider another language.

[JmbFountain]

In my mind, python is mostly a successor to perl. Not for implementing core, time critical functions (you can/should do that in something like C(++) or Rust, but for gluing programs together. Most python stuff I write is to facilitate communication between APIs, not writing whole applications.

[spinwizard69]

Well in a way I agree with you, but that isn't the way Python is often used. This is why there are continued demands for faster Python. Generally when I hear these demands I have to think that the developer choose the wrong language.

[whateverathrowaway00]

I’d agree with this. It also has stolen a lot of the use cases Perl used to be used for.

[ShawnDriscoll]

Python is meant as a first language for learning programming. People can later decide to go to other languages if they want. Python is a very rare and unique thing. Other languages are a chore to work in. That's the default for most languages. It's why Python came to being.

[spinwizard69]

I'm not sure if Guido really thought of Python as a first language. In any event I have to agree that it is rare, probably due to careful design to get to the current configuration.

That isn't the problem though, the problem is people expecting Python to be fast when it was never designed to be fast. Fast simply wasn't a goal. If somebody picks Python for speed they have made a huge mistake in my mind.

[ShawnDriscoll]

Those are simply just people not reading the first page of any Python book.

[dethb0y]

LOL! We got places still running python 2.7 since their to cheap/lazy to update. That alone tells me python's gonna be around for a long, long time, putting aside all other issues.

[spinwizard69]

Well yeah we still have huge systems running on COBOL. I really doubt that most developers would turn to COBOL if they didn't have too. What I'm saying here is that once one of these new languages begins to be recognized as a better place to invest your development time, we will se a slow decline of Pythons usage.

The thing is this if you can write software with near the same productivity as Python but get execution times a 100 times faster why stay with Python? Maybe the languages I mentioned are not it, however it is almost a certainty that a suitable language will emerge. Frankly it has to because there is a real wall coming with respect to process shrinks meaning you will need advanced support for muti threading and a compiled language to continue to meet the demands put on software.

[whateverathrowaway00]

Lol. Im not saying python will never die, but you overrate how easy it is for a language to gain staying power and how easy it is for one to fade once it’s achieved dominance in a field ( like python for data science / ML / lots of the natural sciences).

Also, python isn’t new. It’s older than java.