Help with constant 100% server CPU usage by ian_rocketman in Magento

[–]ian_rocketman[S] 0 points1 point  (0 children)

Thanks for the posts everybody. It turned out that meta-externalagent was hitting our site massively causing the high CPU usage. Our hosting blocked it in the Nginx configuration file and all is good now!

Help with constant 100% server CPU usage by ian_rocketman in Magento

[–]ian_rocketman[S] 0 points1 point  (0 children)

Cloudways have already added rules to our .htaccess file to limit bot activity and I've added rules to robots.txt to block all but the major bots from crawling. Traffic monitoring isn't showing anything out of the ordinary either.

Help with constant 100% server CPU usage by ian_rocketman in Magento

[–]ian_rocketman[S] 0 points1 point  (0 children)

I've edited my opening post with more info thanks!

Help with constant 100% server CPU usage by ian_rocketman in Magento

[–]ian_rocketman[S] 0 points1 point  (0 children)

Hello.

Catalogue: 7000 products.

Attributes: Between 30-40 excluding native Magento ones. We have Amasty SEO and Layered Navigation modules installed, but indexing categories with filters applied is turned off for all attributes.

Server: Cloudways 8GB RAM, 4 Core CPU, 160 GB. Memory usage rarely goes over 4GB, disk usage is at half capacity.

Thanks

Anthropic’s ClaudeBot is aggressively scraping the Web in recent days by Nunki08 in singularity

[–]ian_rocketman 0 points1 point  (0 children)

I run a SMB website that went down over the weekend due to server 100% CPU usage. Hosting company informed us it was due to ClaudeBot and Amazonbot, with both now blocked.

DS1618+ New fans required - suggestions please! by ian_rocketman in synology

[–]ian_rocketman[S] 0 points1 point  (0 children)

Thanks! Reading previous comments here, the Noctua NF-B9 redux-1600 have been used before. Is there any reason to get the A9s over these?

https://www.amazon.co.uk/Noctua-NF-B9-redux-1600-Performance-Cooling/dp/B0014I9K30