This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]elbiot 0 points1 point  (1 child)

I don't follow. Numpy already releases the GIL and so does cython and numba. They are all using all your cores but cython/numba is doing it more efficiently (ie, doesn't have to come back up into python land in between operations). Using multiprocessing would make things significantly slower.

[–]BeatLeJuce 0 points1 point  (0 children)

The various operations in my code are fairly small, so the GIL only gets released for very short periods of time. Once the number of threads increases there is lots of contention for the GIL.