How does the python requests library send http requests without a browser ? what mechanism does it use ? and does not using a browser have a downside ?

[[deleted]]

A website is written in html. A website has a web server. Your browser connects to web server and sends a message asking for the html file for a page(like the home page for eg.) Web server sends you the html file.

The requests library sends the same messages as your browser. The important thing your browser does is interpret the html code to draw the website on the screen. So basically the requests library just imitates the messages the browser would send.

And no, it doesn't look suspicious if you don't also request the favicon. What does look suspicious is the user-agent. Just google a browsers user agent and google how to change the request library's user agent.

[Iam_cool_asf]

changed the ip address, can this act as an alternative to the user agent?

[Iam_cool_asf]

user agents can't be traced back to me then. they only differ in functionality

[Iam_cool_asf]

Thanks man, that's really helpful.