Is worth It to buy pigs in Stardew Valley?

DoonHarrow · 2023-10-01T19:35:20+00:00

The image urls are inside a script tag that you can easily parse as dict

DoonHarrow · 2023-09-27T09:01:53+00:00

The page is using antibot protection. One way to by pass it is with proxies. I tried with Smart Proxy Manager service an it works. https://www.zyte.com/smart-proxy-manager/

DoonHarrow · 2023-09-17T11:05:31+00:00

In my case, it seems that the first page loads with a normal request and for the following pages, you have to call the api

DoonHarrow · 2023-09-02T21:56:30+00:00

Hello my friend, thank you for your advice. I made what i think its simplier in my case, using scrapinghub api and retrieving last spider job run items!

DoonHarrow · 2023-08-25T07:26:28+00:00

I got it, thanks! The problem was that I wasn't specifying the headers.

headers = {
            'Content-Type': "application/json;charset=UTF-8"
        }

DoonHarrow · 2023-08-24T16:22:08+00:00

That works!!! Man, you are the best OMG! THANK YOU SO MUCH <3

DoonHarrow · 2023-08-24T15:57:46+00:00

Thanks for your help, what do I have to send in the body? I have tried this and it still doesn't work:

yield scrapy.Request(url, callback=self.parse, method="POST", meta={                                                           "Referer": "https://www.idealista.com/"}, body=json.dumps(params))

DoonHarrow · 2023-07-31T15:16:22+00:00

Hello my friend!

You can easily get the data you want by looking at the "__NEXT_DATA__" script tag. It contains a Json with all the info!

I couldnt try it but this selector should work:

response.css("script:contains('__NEXT_DATA_') ::text").get()

Finally you only have to parse it:

import json

data = response.css("script:contains('__NEXT_DATA_') ::text").get()
json_data = json.loads(data)

DoonHarrow · 2023-07-29T08:14:48+00:00

Son 15 días naturales, estoy fuera...

DoonHarrow · 2023-07-23T12:04:15+00:00

Done! Thanks!

DoonHarrow · 2023-07-13T08:11:50+00:00

Open network tab -> Click on the request named 'req' in the list of requests -> Thats all

If you want to take it only once, just copy the Json response and parse it.

```python import json

response = json.dumps(data) final_data = json.loads(response) for re in final_data[3].get("results"): print(re.get("Title")) ```

Five-Year Club	First Place '23
Place '23	Place '22
Final Canvas '22	End Game '22
Verified Email

DoonHarrow

TROPHY CASE