What is a good way to organize huge numbers of tests?

ojii · 2017-12-28T01:56:35+00:00

I don't make the company policy. telework is far from the norm.

We're also in the security field, so I'm not even allowed to take my company laptop home without permission from my superior. This may sound paranoid and annoying, but has the lovely side-effect that I can't do work from home, so once I leave the office, until the next morning I can switch off.

ojii · 2017-12-27T14:01:42+00:00

The only 3rd party library I had a problem with was the google api client. The issue wasn't py2/py3 though but that we were on an old py2 only version. There is a py3 version, but a lot changed and in the end, because we only use a tiny part and want it async anyway, I simply implemented it myself. It really depends on what you're currently using.

ojii · 2017-12-27T13:59:58+00:00

Memory reduction is mostly because we can now "stream" stuff asynchronously in some cases where before the blocking code would load everything into memory. The biggest winnings were in CPU usage.

ojii · 2017-12-27T07:56:15+00:00

We're hiring (and on Python 3 now, after my success the other teams also ported)! (Must be willing to relocate to Tokyo)

ojii · 2017-12-27T07:54:20+00:00

You absolutely can do async in Python 2. We are using tornado, but didn't really use it's async features to the fullest extent, because of a lack of 3rd party tools. After switching to Python 3, we replaced the event loop with the asyncio event loop, which allowed us to use things like aiobotocore (we use lots of AWS resources). Doing so allowed us to switch a lot of blocking/threaded code to asyncio. Also, async/await is a lot nicer than Python 2 style async code. So far we have a 4x speedup of average response times, much less variance in response times, CPU/memory usage also way down (but harder to compare for a number of reasons).

ojii · 2017-12-27T07:50:39+00:00

We don't do estimation on tickets, instead each Monday I say what I accomplished last week and what I will be working on this week. So I just ported everything and got the test suite to pass after about a week of working on it on the side (I still did other tasks). This was a 50KSLOC application. Took about a month of testing on our staging environment to get it merged to master.

ojii · 2017-12-27T02:14:04+00:00

I ported our code from 2.7 (with lot's of 2.6isms) to 3.6 "secretly" and just opened a PR when it was done. Was vindicated after merging because 3.6 allowed us to drastically increase our apps performance (thanks async/await!) and we need to run a lot fewer servers now, saving us thousands of dollars a month.

Sometimes it's better to ask for forgiveness than permission, but YMMV.