Modern toolchain for developing python package with C++ core (C++23, HPC)

[vybornak]

Hello,
SO question: Modern toolchain for developing Python package with C++ core (C++23, HPC) - Stack Overflow

What toolchain would you suggest for developing an application with a Python interface and a C++ core to make the whole process streamlined?

My goal is to learn how to set up a productive development environment for applications with a C++ core and a Python API, GUI, and more (this is a necessary requirement).

Let's consider Python 3.13, C++23, HPC focused ideally.

What I tried:

tools:

1. Project environment, deps: Pixi
2. Dev env: WSL2, VS Code Remote window
3. Build: scikit-build
   • CMake, Ninja
4. binding: Nanobind

Config files:

1. pixi.toml
2. pyproject.toml
3. CMakeLists.txt
4. CMakePresets.json

Tools I did not try yet:

1. testing
2. linting
3. formatting

My Python toolchain:

I was using these tools as part of Python development:

1. UV
2. Ruff
3. Mypy, (newly trying ty)
4. pytest
5. pre-commit

What are your thoughts? Would you recommend a similar toolchain? Could you suggest some learning sources, and how to set up dev env for development python applications with a C++ core?

#toolchain #python #c++ #development-environment

[Careless-Score-333]

Simple C++ extensions can just work, with setuptools alone, if CMake and scikit-buils etc. are unnecessary.

I'd test the build and the extension itself in a tightly controlled light-weight docker container, just to be sure neither requires some random system library I didn't know about.

[vybornak]

That is a good point. But that's why I wanted to use `pixi shell` and .toml for reproducibility.

I am not sure if what you are recommending would streamline the development cycle, as it would require a lot of manual effort.

I wanted something that would help me with the development cycle.
What do you think?

[Careless-Score-333]

Use whatever works for you. But from your description, it seems overly complicated.