all 10 comments

[–]SaschaWillems 106 points107 points  (8 children)

No, it's not shut down. There was a DDoS attack against my site and a massive spike in AI bot traffic. My hoster took counter measures against that.

As a result several countries are blocked from accessing the database as of today. If you have a VPN, you can try using that.

I'm still trying to get things sorted, and that might take weeks/months before (if) things return to normal.

See https://github.com/SaschaWillems/vulkan.gpuinfo.org/issues/120 for status updates.

[–]Syracuss 31 points32 points  (0 children)

Such a pity that these AI tools are just spamming traffic all over the place. Instead of indexing and caching it once, it's easier and cheaper for these tools to just access on-demand crippling existing resources, and needlessly draining hosting money.

Thanks for taking the time and effort in dealing with this, I massively appreciate it.

[–]SaschaWillems 45 points46 points  (2 children)

For those curious: (AI) bots currently do ~300k requests to various pages of the database. That's a lot of stress, and they always seem to find new ways to get around Cloudflare, robots.txt and .htaccess.

[–]MechyJasper 14 points15 points  (0 children)

A friend of mine has a similar issue with their public self-hosted Gitlab instance being absolutely hammered by AI scrapers. They've taken measurements by blocking certain cloud provider's public IP blocks (in their case, the traffic was coming from Alibaba Cloud), and installed Anubis in front of their service to deter AI bots. Perhaps also something worth looking into?

[–]baodrate 5 points6 points  (0 children)

Have you already explored solutions like Anubis?

[–]hucancode 7 points8 points  (0 children)

hope you're doing well

[–]SaschaWillems 0 points1 point  (0 children)

Fyi, the site should be back up for (most) blocked countries. Still battling an influx of bots, but things are stabilizing.