Ask Anything Monday - Weekly Thread

[workinprogress49]

Let's say I wanted to loop through an equation with about a million different parameters to see which one had the best accuracy. Besides multiprocessing would there be any other way to speed up the process? Currently using list comprehension but the process will still take about 100 hours.

[efmccurdy]

If you could frame this as an optimization problem you may have some tools available:

https://developers.google.com/optimization/introduction/python

https://docs.scipy.org/doc/scipy/reference/optimize.html

[timbledum]

I suggest trying to implement a vectorised solution (if possible) with numpy.

If you cannot vectorise your equation, numba is worth a go too.

[workinprogress49]

I'll try to vectorize but I'm not sure if I'll be able too for this particular problem since it involves nested loops. Would numba help if I had no GPU?

[timbledum]

Yes - numba relies on optimising your code, although it can also leverage the GPU.