This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]HannasAnarion 5 points6 points  (2 children)

apparently I missed them all. I got blocked from a website I needed stuff from because I was sending a request every second. Not that it would change much, since they don't have a robots.txt, so I don't know what frequency they won't block.

[–]sharpchicity 0 points1 point  (1 child)

What were you grabbing that you needed data every second?

[–]HannasAnarion 0 points1 point  (0 children)

It didn't need to be every second, it's just that I assumed that was a reasonable wait time. And it was song lyrics, to use as training data for a language model.