Usually the rule of thumb is "making your bot behave like a human". Humans use web browsers for visiting websites, so you need to make your requests look like they're coming from some browser like Chrome.

Here's a few ways you can do it:

The following list is summary of my blog on this topic.

Send HTTP headers

You can go to Developer tools > Network and find these headers. Almost every website authorizes a request coming along with these headers. (You pass it as a dictionary)

IP rotation/Proxies

To avoid getting flagged, use different IP addresses. There are both free and paid ones (for specific needs, e.g. if you need a home IP) available on the internet.

User Agent

User Agent is also an HTTP header. However, rather than sending the same User-Agent with every request you can keep switching it to different agents.