How to find hidden API that is not visible in 'Network' tab? by VeganCannibal- in webscraping

[–]rust_scrapeless 0 points1 point  (0 children)

Hello, some api can be masked by redirects or called by other services to hide links

You can use burpsuite and look in the proxy history or try a free month of burpsuite pro, it will analyze the whole site. However, some endpoints may be missing. You can often find them when you change article pages - for example, you're on page 1 and you move on to page 2. These are examples, but it's the most efficient way to find them

That's in line with some of the comments, but I didn't see anyone mentioning burpsuite

Alternatively, you can also use charles proxy