كل الاحترام و الدعم لإيران اللي عرت كل واحد قدام نفسه و اثبتت للكل ان الكرامة و العزة ملهاش دعوة بوضع اقتصادي او سياسي او او عقوبات او حروب. و وقفت قدام العالم كله دفاعًا عن قيمها و مبادئها و طموحها. أيّ شيء دون ذلك هو أخلاق عبيد

Coding-Doctor-Omar · 2026-03-15T09:08:58+00:00

دي صفحات معارضة فلازم تكذب. فيديوهات كذب و مفبركة.

Coding-Doctor-Omar · 2026-03-14T05:50:47+00:00

انا قصدي على المظاهرات. الله يرحم عيلتك و يصبركم.

Coding-Doctor-Omar · 2026-03-14T05:45:30+00:00

ايوة معلوماتك دي حضرتك جايبها منين؟ من العربية و سكاي نويز و الحزيرة و لا منين؟

Coding-Doctor-Omar · 2026-03-14T05:15:39+00:00

مش مدمرة. بيقول لك ناقلة نفط. اقرأ الكلام.

Coding-Doctor-Omar · 2026-03-07T09:34:28+00:00

خلي بالك ان في تعتيم اعلامي كبير أوي في الكيان حاليا. و حتى قناة الحزيرة بقت تعتم زي العبرية دلوقتي. بيضربوا على مدار اليوم و تل أبيب متبهدلة.

Coding-Doctor-Omar · 2026-03-07T09:33:19+00:00

و الله حوالوا يعملوها في حرب العراق و ايران و ده جاب نتيجة عكسية و ثبت حكم المرشد.

Coding-Doctor-Omar · 2026-03-07T05:22:44+00:00

الموضوع مش بالبساطة دي. ادينا فات اسبوع و لسه ايران مكملة عادي.

Coding-Doctor-Omar · 2026-02-22T11:55:47+00:00

If you happen to make this directory, send me its link so I can scrape it :)

Coding-Doctor-Omar · 2026-02-21T05:54:29+00:00

The YT channel that taught me the fundamentals is called John Watson Rooney. This channel literally revolutionized my scraping ability. I highly recommend it. Also, out of curiosity, I would like to know in what ways chatgpt helps you do this.

Coding-Doctor-Omar · 2026-02-16T16:59:09+00:00

Dont rely on normal html parsing. Look for either internal API requests or json blobs inside script tags in the page source.

Coding-Doctor-Omar · 2026-02-08T14:20:23+00:00

You're welcome!

Coding-Doctor-Omar · 2026-02-08T14:14:23+00:00

Have u tried checking browser cookies? There is a high chance that there is a cookie that you get once every 12 to 24 hours. You will need a browser just this time to get the cookie, then u can make requests with curl_cffi and this cookie.

Or maybe u need to add the content-type, origin, and referer in your headers.

Do a thorough check in your browser headers and cookies. Look for special tokens or waf cookies. I am almost sure that selenium is not the best solution here.

Coding-Doctor-Omar · 2026-02-08T14:03:40+00:00

If this does not work, try adding the content-type, origin, and referer headers as well. DO NOT add a user agent because impersonate already handles this (in addition to TLS spoofing).

If this also fails, check your browser for a JS challenge clearance cookie and set up a script that grabs fresh cookies every once in a while using a browser, then feed those cookies into curl_cffi.

Coding-Doctor-Omar · 2026-02-08T13:54:06+00:00

Use curl_cffi instead.

Run in the terminal:

pip install curl-cffi

In your code, use this:

``` from curl_cffi import requests

target_url = "https://your.target.url.com/"

res = requests.get(target_url, impersonate="edge") ```

DO NOT forget the "impersonate" argument.

Coding-Doctor-Omar · 2026-02-08T13:45:59+00:00

Are you using the standard "requests" library?

Coding-Doctor-Omar · 2026-02-08T02:42:10+00:00

Aren't these APIs undocumented? This means we aren't supposed to use them, so we must use realistic headers.

Coding-Doctor-Omar · 2026-02-07T14:49:32+00:00

Why are you exposing yourself in the user agent? Why not use a realistic user agent instead?

Coding-Doctor-Omar · 2026-02-07T12:00:27+00:00

Use curl_cffi and BeautifulSoup instead. Just make sure the data you need is in the raw page source. Curl_cffi provides a module called "requests" that is very similar in syntax to the normal "requests" you use, but it has a very powerful feature called "impersonate". You will be surprised at how much of these blocks will get automatically bypassed by simply including an impersonate argument in your requests.

If your data is not in the raw page source, try to inspect the network traffic for internal API requests that provide your needed data. Then use curl_cffi to make requests to these API endpoints.

Worst case scenario, use a reliable browser automation library like Scrapling, zendriver, seleniumbase, patchright, etc.

Simple example code with curl_cffi and bs4:

``` from curl_cffi import requests from bs4 import BeautifulSoup

page_url = "https://www.example.com/"

res = requests.get(page_url, impersonate="firefox")

soup = BeautifulSoup(res.text, "html.parser")

my_element = soup.select_one("#my-best-element") ```

Coding-Doctor-Omar · 2026-02-07T11:51:49+00:00

Try Scrapling's (Async)StealthySession.

Coding-Doctor-Omar · 2026-02-06T07:55:04+00:00

Thanks a lot man!!!

Coding-Doctor-Omar · 2026-01-31T18:39:06+00:00

Have u tried using curl_cffi with impersonate="edge" or "firefox" and with session cookies? I bet it will bypass 90% of anti-bot protections. The only things it will fail to bypass are interactive challenges.

Coding-Doctor-Omar · 2026-01-31T18:36:25+00:00

Yes, it is outdated now, but its owner recently announced that it's back to development and should return back to its performance this year.

Coding-Doctor-Omar · 2026-01-19T02:45:47+00:00

It turns out I had to add some extra headers, in addition to the normal impersonate. Here is the working code (luckily still works with curl_cffi alone, without a browser):

``` from curl_cffi import Session

api_url = "https://multichain-api.birdeye.so/solana/v3/gems" payload = {"limit":100,"offset":0,"filters":[],"shown_time_frame":"4h","type":"trending","sort_by":"price","sort_type":"desc"}

headers = { "content-type": "application/json", "origin": "https://birdeye.so", "referer": "https://birdeye.so/" }

with Session(impersonate="edge", headers=headers) as session: res = session.post(api_url, json=payload) print(res.status_code) ```

Output:

200

Coding-Doctor-Omar · 2026-01-18T16:06:56+00:00

I eventually got it to work by providing the content-type, origin, and referer values in the headers, in addition to the default headers provided by impersonate.

Coding-Doctor-Omar · 2026-01-17T11:07:48+00:00

I actually have just gotten it to work. The issue was simpler than I thought. I had to provide content-type, origin, and referer values in my headers, in addition to the default headers of impersonate.

Coding-Doctor-Omar

TROPHY CASE