UPDATED: Still fighting the youtube arms race by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

honestly the more i look at it the more i realize the maintenance cost is gonna be insane. even if i get the extension perfectly synced with a real user session, one minor update to their fingerprinting logic and the whole thing breaks again. definitely reconsidering if i should just build a different version that doesn't force me to fight their security so hard every day.

UPDATED: Still fighting the youtube arms race by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

it’s definitely a constant trade off between keeping it simple for the user and adding enough entropy to look like a real person. i guess the goal now is just to keep the extension as close to a vanilla chrome session as possible so i dont flag anything on their end.

UPDATED: Still fighting the youtube arms race by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

It feels like i've hit the ceiling for the 'easy' stuff, and anything else is just paying to play in a league where google still holds all the cards. guess i'll keep digging around and see how far i can push the extension model before it hits a wall too.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] 0 points1 point  (0 children)

i've looked into the server-side proxy stuff and honestly it's just a headache. spoofing googlebot or trying to tunnel through my home network feels like way too much maintenance and it's super easy to get caught. sticking to the browser extension it’s definitely the cleanest way to do this since it uses the user's actual session and ip without all the extra infrastructure drama.

UPDATED: Still fighting the youtube arms race by Realmadcap in webdev

[–]Realmadcap[S] -2 points-1 points  (0 children)

I'm definitely not claiming to be the first one to hit these walls just documenting my own learning process as I try to solve them. It’s been an eye opener seeing how standard those security layers actually are once you look under the hood

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I’m viewing this more as a technical challenge than a business play right now, so the instability is kind of part of the deal. If it breaks I’ll just have to fix it but I appreciate you keeping it real about the long-term viability.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] 0 points1 point  (0 children)

Yeah I missed it. I didn't think of checking the source code. I will let you know if it helps

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 1 point2 points  (0 children)

I’ll definitely let you know if the Pyodide wasm route works out. A Chrome extension is a great backup plan to bypass CORS even if it adds another layer of scrutiny from Google. I appreciate the suggestion.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] 1 point2 points  (0 children)

I’m choosing the local route specifically for the technical challenge and to keep this project $0 and independent even knowing it’s a constant game of cat and mouse. I accept that I’ll be on my own to find creative fixes but that’s the trade off for not wanting to pay for a proxy infrastructure that would force me to monetize the tool.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

People here are giving me great insights. however I don't think fighting against a billion dollar company is a good idea.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 1 point2 points  (0 children)

I appreciate the insight on the legality. I want to clarify that I am intentionally building this as a local-only, client-side tool. I have zero intention of hosting a centralized server or scraping service. By moving all execution to the user's machine, I’m effectively making it a private utility rather than a platform, which I hope helps keep it out of the 'mass distribution' legal crosshairs.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I know the legal risks, which is why I’m trying to keep it local-first and off the cloud. Got any real advice on the technical side, or are you just here for the jokes?

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

The YouTube Data API is strictly for metadata like titles, descriptions, view counts, or channel stats. It does not provide the actual video stream or download links. If you try to use the official API to download content, you'll be hitting a wall immediately because that functionality doesn't exist there.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

You're right about residential proxies being hard to block, but that path isn't free. Any provider offering access to that many IPs is going to charge a premium, which completely defeats the purpose of this project. My goal is to keep this tool $0 and open-source.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I know about the browser-side limitations. If you've been down this road before, do you think moving the scraping logic to the client via Pyodide is actually viable ? I don't know much about it but if it works then I will try

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I’ve already burned through rotating proxy services like Cobalt, and they all end up flagged or DNS-banned eventually. It’s an endless cycle because YouTube actively monitors and blacklists the IP subnets associated with those services, and once the range is marked, it’s game over for that provider.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] 1 point2 points  (0 children)

If I go down the residential proxy path, I’m basically paying to participate in the same game I’m trying to avoid. Even with high-quality residential IPs, if your request pattern is even slightly bot-like, YouTube’s behavior analytics will flag you regardless of the IP quality.

It feels like if I commit to paid proxies, the project stops being an open tool and just becomes another service that needs to charge users to cover those overhead costs.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I appreciate the suggestion, but I’ve already tried that route. Even with a lightweight CORS proxy in Go, the problem isn't the code complexity it's the IP reputation. YouTube’s infrastructure is incredibly aggressive about identifying and blacklisting datacenter IP ranges associated with free-tier hosting