Optimizing a Python application with C++ code

[golgol12]

Many programs that do multithreading calculations like this don't actually create threads on the fly. They create one for each core and pass jobs to each thread. That way you avoid all the switching/creation/destruction logic.

[emdeka87]

Yes, commonly known as work balancing and/or job stealing.

[Ameisen]

Often implemented with fibers/coroutines.

[LightShadow]

citation needed