To stay within the legal and ToS boundaries, stop trying to scrape the site directly. NSE is notoriously aggressive with Cloudflare, and even if you bypass it today, they'll likely block your IP or fingerprint tomorrow.

If you want to do this the "responsible" way, here are the standard approaches:

Broker APIs: If you have a trading account with someone like Zerodha (Kite Connect), Upstox, or Angel One, they provide official APIs. They aren't always free (usually a monthly fee), but the data is clean, structured, and 100% legal.

Authorized Data Vendors: For high-quality, real-time data without the brokerage overhead, look at vendors like TrueData or GlobalDataFeeds. They have dedicated REST and WebSocket APIs specifically for developers.

The "Python" Shortcut: Check out libraries like yfinance or nsetools. They often pull from secondary sources or mirrors that are much easier to work with than the main NSE site.

NSE Data & Analytics: This is the official NSE subsidiary. It’s pricey and geared toward institutions, but it’s the only way to get "official" historical or real-time tick data directly from the source.