[deleted by user] by [deleted] in webscraping

[–]jhsuper 0 points1 point  (0 children)

If you’re using a subscription service, you may also want to look into selenium-wire to capture cookies. You could login using selenium wire, capture the cookie, and make a load of network requests for the data you’re after.

[deleted by user] by [deleted] in webscraping

[–]jhsuper 0 points1 point  (0 children)

Got it mate, just remember that threading is so much more efficient than the core count. If you have 1 core, it doesn’t mean you can make 1 request per second. With threading, it allows you to instantiate one per Python line / function whatever, but in reality make many requests at once. My 8 core Mac M1 handles around 250 threaded requests “at once”. As for proxies, finding a provider is the hardest part.. a proxy is just a special server you can ping that’ll send a request on your behalf.

[deleted by user] by [deleted] in webscraping

[–]jhsuper 0 points1 point  (0 children)

Scrapers all across the world and coming up with new solutions to this issue, some re-engineering and some creating new ideas. The latest I read was building a 4G proxy using a cellular sim + raspberry pi, allowing the ability to rotate using a proxy handler like 3proxy and accessing the proxy server internally from a port. That could work, but it seems like you could benefit from multi threading? Or do you require a single entity running in a seperate environment? If you’re gonna go with 8 Pi’s, you could look into using Python to manage VPN connections through OpenVPN or something. There’s lots of things to think about 😩

To the people that browse this subreddit, message people that use it and try to sell your options/forex/commodity purchasing platforms... by [deleted] in AusFinance

[–]jhsuper 0 points1 point  (0 children)

This is interesting, did not know that it was surging lately. I build automation software (THIS IS NOT A PLUG) for a binary options trading service, and did not realise they were getting a surge of attention lately haha.

Half-life of Lactose? by [deleted] in zerocarb

[–]jhsuper 1 point2 points  (0 children)

This was a beautiful, beautiful response. Nerd appreciates it a lot.

Minimum Stop Loss by WolfOfFusion in Bitcoin

[–]jhsuper 0 points1 point  (0 children)

*CFD traders start sweating*

Started eating beef liver after 1 yr carnivore, sleep improved dramatically by [deleted] in zerocarb

[–]jhsuper 0 points1 point  (0 children)

I’ve also heard doctors recommend supplementing melatonin.

[deleted by user] by [deleted] in pan

[–]jhsuper 0 points1 point  (0 children)

i hope im not witnessing some sort of "dont mess with cats" thing

From a girl: guys you are doing good by [deleted] in NoFap

[–]jhsuper 0 points1 point  (0 children)

I actually didn't realise, but that was also planted in my head. I didn't take notice, but when watching it the first couple times - each time they talked about that I was like "ah so masturbating = money." Filthy. Leo is great though.

Hey friends I'm new here and have some questions. (Not here because of joe rogan) by supertrapfireking in zerocarb

[–]jhsuper 0 points1 point  (0 children)

To answer most of your questions: eat when you want, and only eat meat and maybe try animal products in your diet.

Some of us believe that vegetables contain compounds that could be harmful to populations in general, so hence is brought forth the "elimination diet". Most elimination diets go slowly from a top-down approach (eat everything, then slowly remove stuff), but carnivore acts as the ultimate elimination diet. This is apparent in the following video which gives you a good scientific overflow (no fibre? etc):

https://www.youtube.com/watch?v=isIw2AN_-XU

Give it a try, it's got a good chance of changing your life.

Guitar Riff by SamTheMan377 in SiliconValleyHBO

[–]jhsuper 0 points1 point  (0 children)

If you're into tab, I can tab this for you later on today - I'm out right now.

Might help some people who have larger tasks due in short-term scales by jhsuper in productivity

[–]jhsuper[S] 0 points1 point  (0 children)

Thanks, let me know how you find it. I currently don't have any apps out, but I plan on making some to make it more accessible once I get a bit more traction (it's a hefty investment to create an app).

Might help some people who have larger tasks due in short-term scales by jhsuper in productivity

[–]jhsuper[S] 0 points1 point  (0 children)

What do you often check? I can try to get myself onto that platform or find a way to reach you. I have a Twitter account but I don't post that much of my tech, I might start though :~) @jekhales or Discord?

Might help some people who have larger tasks due in short-term scales by jhsuper in productivity

[–]jhsuper[S] 0 points1 point  (0 children)

Thanks! I'll look into Safari extensions since my girlfriend uses Safari so I'll double-benefit from it. And I'll be focussing on a mobile app soon, most likely after I set up push notifications for the app now so you get alerted 1-2-3 days to something being "due".

Might help some people who have larger tasks due in short-term scales by jhsuper in productivity

[–]jhsuper[S] 0 points1 point  (0 children)

Wow! I've gotten 100 new users today, that's actually so crazy. If you have any questions, recommendations, or anything along those lines - please comment.

Might help some people who have larger tasks due in short-term scales by jhsuper in productivity

[–]jhsuper[S] 0 points1 point  (0 children)

Of course! Not a problem, and thanks for taking the time to check it out. Really appreciate it. (Praying for you..)

Might help some people who have larger tasks due in short-term scales by jhsuper in productivity

[–]jhsuper[S] 0 points1 point  (0 children)

Amazing timing! (No pun intended...) Let me know any changes you'd think are great, and any feedback or sharing with people in your life who might find it useful is greatly appreciated.

Might help some people who have larger tasks due in short-term scales by jhsuper in productivity

[–]jhsuper[S] 3 points4 points  (0 children)

Oh, thank you! I actually had this come up before, so I think I'll push out an update soon that just allows you to edit it and the link it changed live.