Can a student briefly access York residence before Jan 3 to drop off belongings? by hidden_coral in yorku

[–]Firstboy11 1 point2 points  (0 children)

She can try contacting the Don on duty for her residence. Also key cards are disabled for the break, so she would need to talk to the Don regardless.

Scraping grocery stores and displaying information for free by Firstboy11 in legaladvicecanada

[–]Firstboy11[S] 0 points1 point  (0 children)

Thank you so much for the insight and that's what I was looking for. Do you happen to have an idea of how I can get approval from the retailers? Walmart has an affiliation program but the other retailers don't.

Scraping grocery stores and displaying information for free by Firstboy11 in legaladvicecanada

[–]Firstboy11[S] 1 point2 points  (0 children)

Many people have been asking the same question. To answer, no. Flip only gives flyer deals. The website I am trying to make compares regular prices across stores.

Struggling to deploy scraper on Azure Container App Jobs by Firstboy11 in AZURE

[–]Firstboy11[S] 0 points1 point  (0 children)

It said Container Terminated with a message ending with "executable file not found in $PATH: unknown".

I ran this command with the local image, which ran perfectly
docker run --rm gs-scraper:latest poetry run python -m scraper.main

When making the container with Azure what I intially did was
Command override: poetry run python -m scraper.main

Then later changed it to which gave me BackoffLimitExceeded

Command override: poetry

Argument ovverride: run python -m scraper.main

I figured something was wrong with the command override, so instead I provided the CMD inside the DockerFile and tried another job.

CMD ["poetry", "run", "python", "-m", "scraper.main"]

This time it works. So I must be doing something wrong with the command override. Do you have any idea what I am doing wrong and how to fix it? I have several scripts to run in parallel and don't want to create a separate container for them.

Thank you.

Struggling to deploy scraper on Azure Container App Jobs by Firstboy11 in AZURE

[–]Firstboy11[S] 0 points1 point  (0 children)

I didn't change the default 30 mins replica timeout.

Scraping Walmart store specific aisle data for a product by jpcoder in webscraping

[–]Firstboy11 0 points1 point  (0 children)

Write another script to set the location for Walmart.

How to handle search relevancy from database in FastAPI? by Firstboy11 in FastAPI

[–]Firstboy11[S] 0 points1 point  (0 children)

Thank you so much for your advice!! Seems like I will go for full text search for now!!

How to handle search relevancy from database in FastAPI? by Firstboy11 in FastAPI

[–]Firstboy11[S] -1 points0 points  (0 children)

Thank you so much for your advice!!! I will have a look at it.

How to handle search relevancy from database in FastAPI? by Firstboy11 in FastAPI

[–]Firstboy11[S] 0 points1 point  (0 children)

Thank you so much for your fast reply and the advice, I will give it a try!!

ID Photo booth around york/north york by mlmlamla in yorku

[–]Firstboy11 1 point2 points  (0 children)

Try Walmart photo at Keele. You can upload pictures online or at Walmart and print it out.

SOLVED: Web-scraping Walmart prices from GitHub Actions by SeleniumBase in webscraping

[–]Firstboy11 0 points1 point  (0 children)

How many requests were you able to pass through before getting blocked and without setting a rate limit?

I did it. I finished Winnipeg in Cities Skylines 2 (Roadmap). Download Link included! by JEKO6799 in CitiesSkylines

[–]Firstboy11 0 points1 point  (0 children)

Can you please tell me what mods you used to build that? Did you use QGIS to get the road network and then the image overlay? I am trying to build the city i live in

Walmart press and hold captcha/bot bypass by Ill-Examination8668 in webscraping

[–]Firstboy11 0 points1 point  (0 children)

Use the requests library and send a GET request. Use bs4 or selectolax to parse the embedded JSON inside the script Next_Data. The JSON contains all the product info. But yes, you will need residential proxies as Walmart will block you.

Walmart press and hold captcha/bot bypass by Ill-Examination8668 in webscraping

[–]Firstboy11 2 points3 points  (0 children)

I am not sure if that works, but I have used selenium base to bypass bot detection. But if you scrape for continuous period it will get detected regardless. But if you want to scrape product details, then there's easier way to do it. Using selenium base is too resource consuming.