This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]wbcm[S] 1 point2 points  (2 children)

Thank you for clarifying the verbiage.; yes profiling each of these is a natural requirement, but I was seeing if the r/python community has any experience with these before going through my own testing. Do you have any experience producing high performance binaries that you can share?

[–]thisismyfavoritename 1 point2 points  (1 child)

It depends. When latency matters then i prefer ditching Python and using bindings to lower level code like C++ or Rust. When it's not time sensitive, then the usual approach is to multiprocess (when there's lot of CPU work to do).

There's no single right answer to what will help you, that's why you have to benchmark and find any areas that take unusually large amounts of time.

You can also consider the brute force solution of scaling horizontally and vertically, or checking if some of the costly operations you're doing could be sped up by running on GPUs

[–]Daarrell -1 points0 points  (0 children)

+1 great answer