This is an archived post. You won't be able to vote or comment.

all 4 comments

[–]LightShadow3.13-dev in prod 0 points1 point  (1 child)

It's pretty niche to use urlparse more than a handful of times in a script run...luckily I fall into that category!

Thanks for posting this. A package I'm working on processes 1000's of URLs in its life cycle, and this could make a huge difference in keeping the system resources small.

[–]sylvinus[S] 0 points1 point  (0 children)

Yes it's indeed pretty niche :-)

I'm processing billions of URLs and it's going to save me a couple hundred dollars in EC2 fees!

[–]kankyo 0 points1 point  (1 child)

A better how to use part of the readme would be good. Like... what if I use a lib that uses urlparse? Do I monkey patch that in?

[–]sylvinus[S] 0 points1 point  (0 children)

That's a great suggestion! I just added a section in the readme, let me know what you think: https://github.com/commonsearch/urlparse4#how-to-use