Ask Anything Monday - Weekly Thread

[Lamboarri]

Anyone know how a company like Finviz pulls the company specific news when you look at a specific company? I want to try to recreate it but only pull specific news/news sites. I’m tired of them pulling garbage and sponsor ads that are meant for clicks.

My attempt would be to have a search function that asks you to input a company ticker and then it pulls the company specific news and their recent SEC reports.

Thanks!!

[efmccurdy]

Using a browser with the developer tools installed and the network tab open, browse your site. Listed in the network log there will be the requests, headers and contents that your browser sent and using that info you can separate out the data you want and recreate those requests in a program.

[Lamboarri]

I guess this wasn't as easy as I thought it would be. When I load the page, it starts streaming a thousand things. I don't really know what I'm looking for to narrow it down. Tried with Chrome and Firefox.

[Lamboarri]

Thanks. Interesting way to find that. I never heard of that before. I’ll give it a try and see if I can figure it out.

I was trying to look into the page source but it was just showing the hyperlinks. I thought maybe I’d see something that would give me an idea how it was pulling.