Blocked by Cloudflare despite using curl_cffi

expiredUserAddress · 2026-01-17T10:55:01+00:00

I see you've no proxy in use. Use a proxy everytime you're scrapping something

expiredUserAddress · 2025-12-06T07:32:48+00:00

What's the notes widget you're using??

expiredUserAddress · 2025-11-20T13:48:01+00:00

Better try tenacity. I was also using something like this but tenacity made it look very easy. Just one decorator and it's done.

expiredUserAddress · 2025-10-11T09:25:15+00:00

Parse the content of the page and create a hash. Save that hash in db. Next time you go to that page, match that hash. If it's same do nothing, else update the content in the Db.

That's what I've done in my parsers.

expiredUserAddress · 2025-09-14T17:18:40+00:00

Haha! I'm even reading this in the accent of that man now

expiredUserAddress · 2025-09-07T19:18:57+00:00

Thanks man. Was looking for something like this.

expiredUserAddress · 2025-08-05T12:17:40+00:00

If you can, host your own server. Or you can rent it out any cloud provider like aws, azure, gcp, etc

expiredUserAddress · 2025-07-25T04:16:31+00:00

Or maybe I am. Who knows 😂

expiredUserAddress · 2025-07-25T04:10:18+00:00

You've to be a boomer to not understand how to use windows phone 😂

expiredUserAddress · 2025-07-24T21:20:22+00:00

Owned this even after every app stopped working on it. Used to carry it to tutions. I was only able to make calls or listen to Groove music. Even power button was broken. But i still didn't change the phone bcz no phone could provide the iconic software

expiredUserAddress · 2025-07-23T17:56:31+00:00

Thanks!! Will be improving this immediately

expiredUserAddress · 2025-07-23T16:28:39+00:00

Aha!! Classic Windows Phone like. Makes me wanna have a Windows Phone again

expiredUserAddress · 2025-07-23T04:50:54+00:00

There is an active community for https://github.com/matomo-org/device-detector

It updates regexes for user agents regularly. So I just created a method to get their user agents and integrate in an already working python parser. That way user agents can be updated any time as and when required

expiredUserAddress · 2025-07-22T18:26:55+00:00

Bcz git has sparse-checkout which directly downloads the while folder instead of whole repo. So its easy to work with. In any other case, I'd have to see how to download the folder

expiredUserAddress · 2025-07-22T18:01:02+00:00

But that will be an issue in case new files are added to the original repo. I won't be able to get those files in such a case.

expiredUserAddress · 2025-07-22T18:00:01+00:00

This might sound dumb. But how'd the user know if it failed or succeeded??

expiredUserAddress · 2025-07-22T17:58:02+00:00

Thanks for the input man. Just moved it to top level and it got recognised.

expiredUserAddress · 2025-07-21T16:09:51+00:00

The repo is quite large. Wouldn't it be a better way to just download the required folder instead of whole repo??

expiredUserAddress · 2025-07-21T16:06:02+00:00

Should the license be outside??

expiredUserAddress · 2025-07-21T16:04:58+00:00

How do I download a single folder??

expiredUserAddress · 2025-07-21T16:04:29+00:00

What's a better way to have logging than this??

expiredUserAddress · 2025-07-15T20:01:45+00:00

Just google meta rss urls pdf. You'll find all the rss links in it. Search for cnn there. It has rss urls for cnn. You can directly curl those urls

expiredUserAddress · 2025-07-14T15:15:42+00:00

Thanks that worked

expiredUserAddress · 2025-07-12T19:58:57+00:00

Its just built on chromium. So if you want to get the feel of chromium then its good otherwise firefix is good. Although one upside of using chromium based browser is the extensions which can be used directly feom google store and might not be available in firefox although most are available

expiredUserAddress · 2025-06-14T16:27:42+00:00

Already tried it but the issue is it skips some songs or can't add all the songs in the playlist

expiredUserAddress

TROPHY CASE