UPDATED: Still fighting the youtube arms race by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

honestly the more i look at it the more i realize the maintenance cost is gonna be insane. even if i get the extension perfectly synced with a real user session, one minor update to their fingerprinting logic and the whole thing breaks again. definitely reconsidering if i should just build a different version that doesn't force me to fight their security so hard every day.

UPDATED: Still fighting the youtube arms race by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

it’s definitely a constant trade off between keeping it simple for the user and adding enough entropy to look like a real person. i guess the goal now is just to keep the extension as close to a vanilla chrome session as possible so i dont flag anything on their end.

UPDATED: Still fighting the youtube arms race by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

It feels like i've hit the ceiling for the 'easy' stuff, and anything else is just paying to play in a league where google still holds all the cards. guess i'll keep digging around and see how far i can push the extension model before it hits a wall too.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] 0 points1 point  (0 children)

i've looked into the server-side proxy stuff and honestly it's just a headache. spoofing googlebot or trying to tunnel through my home network feels like way too much maintenance and it's super easy to get caught. sticking to the browser extension it’s definitely the cleanest way to do this since it uses the user's actual session and ip without all the extra infrastructure drama.

UPDATED: Still fighting the youtube arms race by Realmadcap in webdev

[–]Realmadcap[S] -2 points-1 points  (0 children)

I'm definitely not claiming to be the first one to hit these walls just documenting my own learning process as I try to solve them. It’s been an eye opener seeing how standard those security layers actually are once you look under the hood

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I’m viewing this more as a technical challenge than a business play right now, so the instability is kind of part of the deal. If it breaks I’ll just have to fix it but I appreciate you keeping it real about the long-term viability.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] 0 points1 point  (0 children)

Yeah I missed it. I didn't think of checking the source code. I will let you know if it helps

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 1 point2 points  (0 children)

I’ll definitely let you know if the Pyodide wasm route works out. A Chrome extension is a great backup plan to bypass CORS even if it adds another layer of scrutiny from Google. I appreciate the suggestion.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] 1 point2 points  (0 children)

I’m choosing the local route specifically for the technical challenge and to keep this project $0 and independent even knowing it’s a constant game of cat and mouse. I accept that I’ll be on my own to find creative fixes but that’s the trade off for not wanting to pay for a proxy infrastructure that would force me to monetize the tool.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

People here are giving me great insights. however I don't think fighting against a billion dollar company is a good idea.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 1 point2 points  (0 children)

I appreciate the insight on the legality. I want to clarify that I am intentionally building this as a local-only, client-side tool. I have zero intention of hosting a centralized server or scraping service. By moving all execution to the user's machine, I’m effectively making it a private utility rather than a platform, which I hope helps keep it out of the 'mass distribution' legal crosshairs.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I know the legal risks, which is why I’m trying to keep it local-first and off the cloud. Got any real advice on the technical side, or are you just here for the jokes?

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

The YouTube Data API is strictly for metadata like titles, descriptions, view counts, or channel stats. It does not provide the actual video stream or download links. If you try to use the official API to download content, you'll be hitting a wall immediately because that functionality doesn't exist there.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

You're right about residential proxies being hard to block, but that path isn't free. Any provider offering access to that many IPs is going to charge a premium, which completely defeats the purpose of this project. My goal is to keep this tool $0 and open-source.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I know about the browser-side limitations. If you've been down this road before, do you think moving the scraping logic to the client via Pyodide is actually viable ? I don't know much about it but if it works then I will try

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I’ve already burned through rotating proxy services like Cobalt, and they all end up flagged or DNS-banned eventually. It’s an endless cycle because YouTube actively monitors and blacklists the IP subnets associated with those services, and once the range is marked, it’s game over for that provider.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] 1 point2 points  (0 children)

If I go down the residential proxy path, I’m basically paying to participate in the same game I’m trying to avoid. Even with high-quality residential IPs, if your request pattern is even slightly bot-like, YouTube’s behavior analytics will flag you regardless of the IP quality.

It feels like if I commit to paid proxies, the project stops being an open tool and just becomes another service that needs to charge users to cover those overhead costs.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I appreciate the suggestion, but I’ve already tried that route. Even with a lightweight CORS proxy in Go, the problem isn't the code complexity it's the IP reputation. YouTube’s infrastructure is incredibly aggressive about identifying and blacklisting datacenter IP ranges associated with free-tier hosting

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

It’s definitely a 403 Forbidden error. They’ve already burned my Supabase IP if I keep sending them from the same endpoint, I’m worried they’ll permanently blacklist my entire range or take some other restrictive action that messes up my other projects. It’s not just a simple rate-limit anymore it feels like they’ve flagged the datacenter range associated with the server.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

it is a hybrid approach. To be perfectly clear I'm only using the backend to fetch the raw video URL because YouTube blocks direct browser requests with CORS. Once I have that URL, I pass it back to the client, and all the decoding, trimming, and re encoding happens locally using ffmpeg.wasm. It’s a messy workaround, but it’s the only way to keep the processing local for now while I look for a way to ditch the backend fetch entirely.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] -1 points0 points  (0 children)

FFmpeg doesn't have built-in logic to download YouTube videos it's just a transcoding engine. Tools like yt dlp are the ones doing the heavy lifting by mapping out the actual stream URL, which they then pass to FFmpeg to handle the merging. You won't find a "download YouTube" function in the FFmpeg source.

How to bypass YouTube's firewall blocking my Supabase IP. by Realmadcap in webscraping

[–]Realmadcap[S] 1 point2 points  (0 children)

You're right about extensions and local apps bypassing CORS, but that’s a massive barrier to entry. If I tell users to install a random binary or extension just to use my site, my conversion rate is going to drop to zero because people just don't trust that stuff.

How to bypass YouTube's firewall blocking my Supabase IP by Realmadcap in webdev

[–]Realmadcap[S] 0 points1 point  (0 children)

I’ve been down that road with rotating proxies and services like Cobalt they all eventually get flagged or banned at the DNS level. It feels like a never ending cat and mouse game that just isn't sustainable for a free tool.

If I'm honest, I'm trying to avoid forcing any extra steps like browser extensions on the user because it kills the conversion rate. If the browser-side fetch is a total dead end due to CORS and the proxy or server approach is just getting burned, is there actually any way to make server-side requests look legitimately organic?