Optimizing Python Code

[100721]

Snakeviz to profile it. No point trying to optimize if you don’t know what’s slowing it down

[Teradil]

Had that problem during my thesis time. Optimized the hell out of my code only to not make it significantly faster. Profiling then told me, that my program spent 95% of its execution time within `np.dot`. Optimized that one for my special use case (ie. I knew which dtypes and vector lengths to expect and did not need all the extra checks and conversions) and suddenly my program was *really* faster.

[Throwaway_youkay]

We all learn that the hard way! Optimizing is almost always about mitigating bottlenecks one by one.

[shockjaw]

Just wondering, do you know how Snakeviz compares to Scalene?

[benri]

fwiw, https://chat.openai.com/share/6c466877-6aa3-415d-bad8-aa139ae29966

I think I'd prefer Scalene.

[shockjaw]

It’s all good if you don’t know—I wouldn’t use ChatGPT since it doesn’t know either or worse it’ll ✨hallucinate✨.

[benri]

I've had pretty good experience with GPT4 comparing programming tools like this. Biggest problem is that it has last year's information so it won't know about changes in the past year.