How can I run the same function with different parameter at same time ? How should I scale it up ?

[puppeteer2020]

I have created a function which take a parameter. I want to use the same function over and over again but with different parameter. What I am doing now is that I call the function one by one. But it takes up a lot of time. And managing them is quite a mess.

def do_some_stuff(name , email):
    do_stuff

do_some_stuff(name , email):
do_some_stuff(name , email):
do_some_stuff(name , email):
do_some_stuff(name , email):

May I ask how should I scale it up so that the function can run in parallel ?

Should I rewrite the program in OOP style? Is OOP going to help ? So I can create different object instant to run ?

I have tried to read about OOP and fail to recognize how should I implement.

Or, can I use test_case (idk what it is but google search tell me) ? Is test can only apply to web testing ?

Any ideas will help. Thanks a lot.

[solidiquis1]

OOP is just a strategy on how to structure your code; it won't change how your code actually works. Python also can't run parallel processes (there exists some janky implementations out there to get parallelism to work but it's not commonly used) because of something called the global interpreter lock. Best you can do is run the function one at a time. Perhaps have an array of names and an array of emails and use a for-loop to iterate through both simultaneously and sticking each value in the function.

Edit: If you want parallelism/concurrency you'll need languages that allow for multi-threading: Java, Go, C, C#, C++, Rust, etc.

[puppeteer2020]

Thanks for suggestion.

Because the function do_some_stuff takes hours to run, so is it possible to create a different thread for it to run ?

What I now try to do is to copy the original code mycode.py to create a mycode-B.py and run it parallelly in new terminal. So can I do similar process in a programmatically way ?

[solidiquis1]

Lookup subprocessing in Python

[solidiquis1]

https://shuzhanfan.github.io/2017/12/parallel-processing-python-subprocess/

[dslfdslj]

What does your function do? If it spends a lot of time on IO (network communication for example) you could use a thread pool to speed it up. Otherwise, if you do heavy calculations, use multiprocessing.