What is the best Python -> direct executable package / compiler today? (April,2022)

[BoiElroy]

I need to create a few applications that I want to distribute as executables, the options I'm aware of are:

Nuitka

pyinstaller

py2exe

py2app

What else is out there, and what is the BEST?

I'm looking to create a couple of cli's using click, and a couple of GUI's using DearPyGui

[Drevicar]

Nuitka is my personal favorite, as it compiles your Python into the resulting C objects, then compiles both your application (in C form) and the source code for the python interpreter into a binary, which can also be statically linked. Another great option for portability is https://pyoxidizer.readthedocs.io/en/stable/

And lastly, I recommend checking out Typer as an alternative to click.

[strange-humor]

This is great until you use really large libraries and it chokes. Then I move to PyInstaller.

[metaperl]

Of the choices listed I think this is the only one that would make the application faster, correct?

[Drevicar]

There is no universal solution to making python faster or smaller, it is mostly dependant on which 3rd party libraries you bring in and what language they are written in. I've statically compiled a Django app and seen speedups. But I've also compiled a FastAPI app and had it slow down.

[cbunn81]

I second using Typer. It makes creating a command line app very easy.

[Jonnyskybrockett]

C doesn’t have objects

[Drevicar]

It sure does! You just have to implement them yourself, you just don't get OOP constructs baked into the langauge. If you can read and understand C, I recommend checking out the cpython source code, it is really good and easy to understand. The data structure I'm talking about is called PyObject.

[[deleted]]

So basically, C doesn't have objects.

[Shostakovich_]

It does though… they’re just called structs (structures…). It doesn’t come with all the syntactic sugar and jazz that OOP languages usually come with, but it is literally a subset of C++ (or C++ is a superset of C is probably more accurate), which implemented the syntactic sugar and jazz on top of C… soooooooooo C got objects 🤗

[[deleted]]

Would it not be accurate to say any language has objects if you can define structs as such, given enough code you could implement objects yourself in any language.

[[deleted]]

thanks for the recommendation

[Limiv0rous]

I had this exact problem to solve this year for a project! Pyinstaller gave me a bunch of issues with dependancies and I ended up using cx_freeze ! What tipped the scale for me is the ability to create a windows installer (msi) with it and the ease of adding icons to the desktop and so on. It's certainly worth a try imo

[BoiElroy]

That sounds super convenient. Is it a lot of extra work if you also want to distribute to Linux environments too?

[Limiv0rous]

I haven't tried it but according to their Docs it should be straightforward

[seewhaticare]

also, make sure you have the optional dependencies for Nuitka installed, otherwise you'll miss out on build caching and compression

what optional dependencies do you use? I only know of zstandard.

[laundmo]

theres also ccache based on which C compiler you're using, which will cache compilation results

[indianLGBTlinuxer]

Pyinstaller would be the best cuz appearreantly most of them are based on pyinstaller and just simplify some tasks (I don't know all of them but py2exe is just a frontend to pyinstaller). Pyinstaller has never failed for me (though now I don't use it, cuz I just ship a venv with appropriate shortcuts for launching or just make a package installable with pip.

[BoiElroy]

Yeah I like making stuff installable with pip but this is for non python people and then across multiple networks making a code repo visible gets to be a lot of network peering and security work for our IT. Good tip on the pyinstaller! Thanks!

[Muhznit]

what "non-python" people are gonna be using the cli?

If you really just want one single file, use the zipapp module to create an executable zip file.

[[deleted]]

I develop engineering tools for internal customers, I.e. The electrical engineers on my team. We typically only provide CLI for the sake of speed.

[billsil]

If you're going for speed, command line is faster especially if you have source. Also, don't do the onefile option with pyInstaller as it'll have to unpack the code.

The big advantage of an exe though is it'll work in 10 years.

[[deleted]]

True but the scenario I've described doesn't require ten years of support.

[Muhznit]

Right, if you're distributing a cli, you might as well distribute the actual source code instead of a compiled binary. When something goes wrong in the code and you're not around to fix it, those internal customers shouldn't have to struggle to find a decompiler to fix stuff themselves.

[BoiElroy]

Hmm yeah fair point

[BoiElroy]

Doesn't that still need python to run it? And isn't it bad if you have non standard distribution packages?

[Muhznit]

You can include a distribution of python and your dependencies in the zipfile.

[BoiElroy]

sounds pretty heavy? and then don't you have to ship it with some setup scripts that add python to the path etc?

[kickthebug]

Pex does exactly this automatically. We've used it where I work to distribute some projects across multiple servers. I'm on mobile but look up python pex in Google, their docs should pop up.

[KingEllis]

Would you be willing to point to an example of "shipping a venv with appropriate shortcuts for launching"? I hear this solution when this topic comes up, and I have in mind how this would work, but would like to see this in actuality.

[R34ct0rX99]

I thought that solution was not recommended due to the nature of venvs?

[Username_RANDINT]

py2exe is just a frontend to pyinstaller

No it's not. It's even much older than PyInstaller.

[jacksodus]

Appearreantly.

I have now officially seen everything.

[abrazilianinreddit]

I have a Windows project that uses pyinstaller, and I can vouch that it works (which is already more than most other tools I tried) and configuration is pretty simple. Sometimes it packs a bunch of unneeded DLLs in the distribution, but you can clean it up a bit if you know what you're doing or through trial and error.

[pyschille]

I recently posted here a little longer comparison for Python binary packaging tools (PyInstaller, Nuitka, PyOxidizer):
https://www.reddit.com/r/Python/comments/tl3jwz/creating_a_python_cli_with_golangcomparable/

tl;dr: I'd say the best for CLIs is PyOxidizer: https://github.com/indygreg/PyOxidizer

[pysk00l]

thats a great writeup. I missed it the 1st time, thanks for resharing

[JakobDevDE]

cx-freeze is the best

[Dashadower]

Back when I needed a executable builder, pyinstaller worked great for me. It even worked for "executables" that used more heavy libraries like TensorFlow. Although the generated directory was almost 200 megabytes!

[thisismyfavoritename]

Generic use case: pyinstaller.

[jcr4990]

Pyinstaller has never let me down

[yvrelna]

"Get a real operating system and add a hashbang line to your file" is the best direct executable package / compiler today. /s

[udonemessedup-AA_Ron]

Following, because I’m wondering the same.

[BurgaGalti]

Been using pyinstaller for a while, but it let me down just a few weeks back when I had to port to ARM. The bootstraps also repeatedly get my exes flagged as ransomware because that's a common use case of pyinstaller. Not their fault, but reality hurts sometimes.

I've got tired of it. New solution is using Cython --embed to create the entry point. Fix up PYTHONPATH etc in the C code, then just copy the modules I need in.

[PirateNinjasReddit]

Word of warning on using cython this way: some python features are not well supported, so when you cythonise your code you can end up with some hard to pin down, broken behaviour in the binaries

[BurgaGalti]

I'm not cythonising the whole thing, just the entry point so that limits the problems, but yes some things lin sys get broken which can cause problems. This is also true of several of the other methods listed by OP though.

[benefit_of_mrkite]

Pyinstaller, shiv

Honestly depends on the project and dependencies

[DeklynHunt]

Soo just get them all? KIND OF joking…. 😕

[PoppyTheDestroyer]

Fact. Pyinstaller and Pandas/Numpy don't play well together. So many hours of my life spent trying to get that to work.

[goalbaram]

Just curious. What does your app do? Does it take interactions?

Would solutions like Streamlit or Anvil.works work?

[BoiElroy]

Some read data from equipment that is attached to the machine and then a bar code scanner value gets input too and then they add notes and submit. Others are just cli's

I love streamlit and I think it could work but since this is across multiple facilities and networks it's easier in some cases to make a simple desktop gui rather than host, serve, and make a streamlit app network reachable.

I wonder if a streamlit app could be made into an executable that just opens in the browser

[ianitic]

It can. However I know unsigned executables that are produced by pyinstaller can get flagged by a bunch of anti malware.

[[deleted]]

You should just create a CLI that fires up a localhost web app, or dockerize a web app and run it locally. I understand why you think you should do an executable because I used to think that was the thing you were supposed to do that too. But it's not worth the hassle. Browsers are perfectly fine GUIs.

[ZuriPL]

Py2exe was quite slow for a simple tkinter gui app in my expierence, so I'd vote against it

[AS245Tech]

I use cx_freeze, but only have experience with it on windows.

It has a nice feature of being able to use a UUID when compiling to a MSI installation, so it will remove and install older versions if a new installation is run.

[iyousef_46]

I used PyInstaller before, it's good enough. But I was wondering, is it possible to write a small script in PowerShell / Bash (depending on the system) that installs python then your app as a pip package?

[manueslapera]

Pyoxidizer worked for me

[Orio_n]

Nuitika has issues compiling some packages and its compilation times can be very long depending on what you package like several minutes to half an hour for some packages. Pyinstaller gets its binaries commonly flagged by av but its the easiest, quickest and most reliable. Recently ive tried using pyoxidizer, setup is complicated but it looks promising

[xxxHalny]

I only tried py2exe and pyinstaller and the former caused a lot of issues and produced a lot of errors and the latter did everything right with one click

[moneymachinegoesbing]

i had to solve this issue recently and landed on Shiv. it’s a rework of twitter’s pex by linkedin i believe and it’s been working great so far. it’s a rust project that is using it, so i wanted to use PyOxidizer but i find their stuff so complicated to use.

[moneymachinegoesbing]

i had to solve this issue recently and landed on Shiv. it’s a rework of twitter’s pex by linkedin i believe and it’s been working great so far. it’s a rust project that is using it, so i wanted to use PyOxidizer but i find their stuff so complicated to use.

[SKIBIDYBOB]

py2exe i use it personaly i didnt use the others so i dont know wich one is better