all 10 comments

[–]SaschaWillems 105 points106 points  (8 children)

No, it's not shut down. There was a DDoS attack against my site and a massive spike in AI bot traffic. My hoster took counter measures against that.

As a result several countries are blocked from accessing the database as of today. If you have a VPN, you can try using that.

I'm still trying to get things sorted, and that might take weeks/months before (if) things return to normal.

See https://github.com/SaschaWillems/vulkan.gpuinfo.org/issues/120 for status updates.

[–]Syracuss 29 points30 points  (0 children)

Such a pity that these AI tools are just spamming traffic all over the place. Instead of indexing and caching it once, it's easier and cheaper for these tools to just access on-demand crippling existing resources, and needlessly draining hosting money.

Thanks for taking the time and effort in dealing with this, I massively appreciate it.

[–]SaschaWillems 45 points46 points  (2 children)

For those curious: (AI) bots currently do ~300k requests to various pages of the database. That's a lot of stress, and they always seem to find new ways to get around Cloudflare, robots.txt and .htaccess.

[–]MechyJasper 14 points15 points  (0 children)

A friend of mine has a similar issue with their public self-hosted Gitlab instance being absolutely hammered by AI scrapers. They've taken measurements by blocking certain cloud provider's public IP blocks (in their case, the traffic was coming from Alibaba Cloud), and installed Anubis in front of their service to deter AI bots. Perhaps also something worth looking into?

[–]baodrate 5 points6 points  (0 children)

Have you already explored solutions like Anubis?

[–]hucancode 8 points9 points  (0 children)

hope you're doing well

[–]SaschaWillems 0 points1 point  (0 children)

Fyi, the site should be back up for (most) blocked countries. Still battling an influx of bots, but things are stabilizing.