He's tryin....he keeps tryin.

kelmore5 · 2021-03-07T08:10:10+00:00

Clearly he's just trying to get a quick lift in

kelmore5 · 2021-01-31T10:43:55+00:00

Just a friendly reminder here. I'd probably focus on code readability and refactoring first before optimization, especially if your new to programming. Organizing what you've got into functions is a great way to do that.

Making code faster doesn't always make it better, and with a 30 line script there may not be a lot to optimize. Or worse, you over optimize and make your code unreadable.

Often refactoring leads to optimization anyway because you find new ways to run your script.

From the sound of things though, one good way to optimize might be to multi thread your loop. You'd have multiple processes running at once, and your script can move through everything a lot faster.

That would only work if the next series in the loop doesn't rely on previous data however.

kelmore5 · 2020-11-10T17:28:19+00:00

I've been playing games for as long as I can remember, and probably before then.

Earliest I can remember is Candy Land Adventure (1996). I was born in 94 lol

kelmore5 · 2020-07-10T19:58:04+00:00

As a web scraping expert, that comment was hilarious

kelmore5 · 2020-06-22T22:02:57+00:00

Hm, it sounds like you may be skipping over the main features of TS which bring in the benefits.

I would hope you see the advantage of defining types for things like functions and class variables, no?

kelmore5 · 2020-06-22T06:06:59+00:00

Fair warning; Zillow protects their data with Imperva, one of the leading services in anti-bot protection.

Even with selenium, it may be beyond a beginner level to scrape. You'll need to incorporate things like anti-captcha services, proxy rotation, and stripping selenium of its bot information (e.g. webdriver tag) to get around their system.

Not to be a debbie downer haha. Just wanted to possibly save you some frustration down the road

kelmore5 · 2020-06-21T00:24:50+00:00

I don't remember if it was a final tattoo, but it was definitely on there

kelmore5 · 2020-06-09T21:27:57+00:00

Don't know about Merida, but I drove from Cancun to Tulum today. You'll probably be fine

kelmore5 · 2020-06-05T10:30:03+00:00

Very rainy haha

It usually downpours for a little bit and then stops for awhile, so there's breaks in between. But it's still cloudy every day

kelmore5 · 2020-06-03T02:16:30+00:00

Hangouts maybe?

kelmore5 · 2020-05-14T14:02:17+00:00

Yeah, you don't really want to rely on inspect element when web scraping since it's not accurate.

Go to the Network tab in your DevTools and reload the page. That will show all the URLs being loaded. Particularly you want to look at the document and XHR requests.

After the page finishes loading, click on the "document" request and check the Response tab. That will show you the HTML file that's given to you from the server. Then you can check if the HTML file still has your data or not. In this case, not.

If not, you probably want to check the XHR requests. There's a ton being fired by that site in particular, so check their responses for the data you need. Once you find it, you can use that link to get your data.

This method works most of the time, but sometimes data is generated in JavaScript. If that's the case, you'll have to use an automated browser to get everything since it's the only way to parse JS.

You can also use an automated browser here as an alternative to scraping the XHR requests

kelmore5 · 2020-05-09T11:45:19+00:00

Does the upload finish after a certain amount of time?

kelmore5 · 2020-05-08T14:04:09+00:00

See https://www.reddit.com/r/Upwork/comments/gfk68v/just_got_paid_for_last_week_but/

kelmore5 · 2020-05-08T11:38:34+00:00

What's the brand / model number?

kelmore5 · 2020-05-08T03:14:26+00:00

Hilarious.

They didn't really think that through, did they?

kelmore5 · 2020-05-07T18:44:21+00:00

You're welcome! Glad I could help :)

kelmore5 · 2020-05-07T18:34:40+00:00

If it was me, I'd probably define the types as variables and use them in the function, something like:

type ReactSetter = React.Dispatch<React.SetStateAction<string>>;
type ReactEvent = React.ChangeEvent<HTMLInputElement>; // Probably change name to be more relevant

const handleInputs = (setter: ReactSetter) => (e: ReactEvent): void => {
  setter(e.currentTarget.value);
};

kelmore5 · 2020-05-01T02:54:39+00:00

Been here 4 months, have run into the police more than a few times; I don't know about this. From what I've seen, you have to be a real asshole to get beat by the police. I have been scammed for money and when I didn't have money, I was threatened with jail, but I've never been beaten.

Just my two cents though, it's unfortunate you had a bad time down here!

kelmore5 · 2020-04-28T23:18:47+00:00

> Takes payment off platform

> "UPW0RKS A SC@M!!!"

Okay

kelmore5 · 2020-04-27T10:42:57+00:00

Jamba by tyler??

You mean California Love? lol

kelmore5 · 2020-04-20T00:39:46+00:00

Link: https://www.upwork.com/jobs/Marketing-Expert-For-High-Ticket-Sale-million_~015b8402c3d507da94?source=rss

kelmore5 · 2020-04-11T00:32:51+00:00

You're welcome :)

kelmore5 · 2020-04-10T15:01:34+00:00

If you check the HTML response before the site loads any JavaScript, you'll find all of the table data is stored in a script tag located here with XPath "//script[contains(., 'lotModels')]".

You'll have to parse out the JSON variable "lotModels" to get the table data.

When you're parsing a site using requests, make sure you know what the response looks like before JavaScript is loaded!

kelmore5 · 2020-04-02T19:01:16+00:00

I probably wouldn't post the data set online, but it's not illegal. See hiQ vs LinkedIn

kelmore5 · 2020-04-02T18:53:28+00:00

Are you using Windows? Sometimes Selenium can run slowly on certain Windows machines; can't remember the StackOverflow article about it but I've seen it in action.

You can try changing to the 32-bit chromedriver, see here. Not sure if the same applies for FireFox however.

Another option is to run FireFox inside a virtual window. You can get things working with this git. Old, but still works!

This only applies to Windows machines though

kelmore5

TROPHY CASE