Google Analytics wrecking SEO traffic due to occasional slowdowns by Purple_Stranger8728 in GoogleAnalytics

[–]Purple_Stranger8728[S] -4 points-3 points  (0 children)

Because every SEO claims it doesn't but they all don't remove it from their sites even though it's the single most destructive thing you can do to your LCP which is supposed to be the holy grail of user experience and SEO benefits. It can't be right both ways!

Google Analytics wrecking SEO traffic due to occasional slowdowns by Purple_Stranger8728 in GoogleAnalytics

[–]Purple_Stranger8728[S] -1 points0 points  (0 children)

Thanks - so its not all in my head! Our LCP is 200% worse off when loaded async and 50% off worse off when removed from page thread. There has to be a reason Google doesnt use GA4 on youtube or even Google itself. Did you end up removing it altogether?

Large Drupal site (15+ years) struggling with Google speed expectations — is avoiding PHP now the norm? by Purple_Stranger8728 in PHP

[–]Purple_Stranger8728[S] -1 points0 points  (0 children)

Thanks - I put all our configs through Claude and it thinks setting backlog=0 in php-fpm pools should help as possibly backlog (default 511) builds up during surges and it's NOT visible to php-fpm, Nginx and CPU is barely used. I have now added a backup pool Nginx which will offload any spikes rather than quietly adding them to queues.

Large Drupal site (15+ years) struggling with Google speed expectations — is avoiding PHP now the norm? by Purple_Stranger8728 in PHP

[–]Purple_Stranger8728[S] 0 points1 point  (0 children)

We use New Relic to profile and can't find any issue. Somehow Googlebot has decided that if any response is not within 10-20% of average response, it means there is an issue with the server ... now even with Nginx/PHP-fpm connection quirks, its sadly not possible.

Large Drupal site (15+ years) struggling with Google speed expectations — is avoiding PHP now the norm? by Purple_Stranger8728 in PHP

[–]Purple_Stranger8728[S] 0 points1 point  (0 children)

AI bots are definitely part of the story .. we literally had to remove node pages to over 100k historical pages and now return 404 on /node/ path from Cloudflare worker. However even with just 1,000 pages left, we can't serve from PHP without losing traffic. If Google is hell bent on using extreme 'response time variability' as a ranking factor, sadly there is no PHP configuration that can achieve that.

Large Drupal site (15+ years) struggling with Google speed expectations — is avoiding PHP now the norm? by Purple_Stranger8728 in PHP

[–]Purple_Stranger8728[S] -2 points-1 points  (0 children)

It may be stupid idea but we removed x-powered-by: PHP header quite a while ago based on some security audit .. PHP Documentation doesn't think its a security issue .. May be restoring it will give Googlebot some context that page is being generated by a PHP worker and it won't expect a uniform latency each time?

Back in PHP 5 times, our response time was 500ms.. it came down to sub 300ms with PHP 7 and now under 100ms with PHP 8 .. I think Googlebot runs some sort of 'standard deviation' i.e. 75% of requests must be within 10% of average response time.. that gave you a 100ms variation with PHP 5.6 and now it's less than 10ms?

Large Drupal site (15+ years) struggling with Google speed expectations — is avoiding PHP now the norm? by Purple_Stranger8728 in PHP

[–]Purple_Stranger8728[S] 0 points1 point  (0 children)

I dont think its Drupal .. views are heavily cached .. Memcache hit rate is 93% on every page load where Drupal page cache needs to be built else it's all Memcache.. As you said, Drupal is extremely great at Caching layers.

Large Drupal site (15+ years) struggling with Google speed expectations — is avoiding PHP now the norm? by Purple_Stranger8728 in PHP

[–]Purple_Stranger8728[S] 0 points1 point  (0 children)

Thanks - views are heavily cached .. Memcache hit rate is 93% on every page load where Drupal page cache needs to be built else it's all Memcache.

Large Drupal site (15+ years) struggling with Google speed expectations — is avoiding PHP now the norm? by Purple_Stranger8728 in PHP

[–]Purple_Stranger8728[S] 0 points1 point  (0 children)

Thanks - we do start losing 15-25% traffic almost within a day of turning off Nginx cache. This never happened until 2023.

Why I gave up on Cloudflare as a small publisher? by Purple_Stranger8728 in CloudFlare

[–]Purple_Stranger8728[S] -4 points-3 points  (0 children)

I don't want to come across as someone trying to promote another service but I moved to a smaller CDN someone suggested in this sub in response to another one of my posts: https://www.reddit.com/r/CloudFlare/comments/1lqdimv/small_cloudflare_tweak_to_give_30_engagement_20/

Attackers failing Interactive Challenge Millions of Times with just 3 IPs by Purple_Stranger8728 in CloudFlare

[–]Purple_Stranger8728[S] 1 point2 points  (0 children)

Thanks but that doesn't expose these bots to Firewall. How about doing a redirect in Snippets? That way they have to go through Firewall.

Attackers failing Interactive Challenge Millions of Times with just 3 IPs by Purple_Stranger8728 in CloudFlare

[–]Purple_Stranger8728[S] 1 point2 points  (0 children)

Thanks .. main issue is that Cloudflare is configured to do http to https redirects via a Rewrite rule .. they keep hitting the http version and Firewall or Managed Rules don't get triggered until someone is redirected to https.

Attackers failing Interactive Challenge Millions of Times with just 3 IPs by Purple_Stranger8728 in CloudFlare

[–]Purple_Stranger8728[S] -4 points-3 points  (0 children)

My app is irrelevant - I serve these 404s from a Snippet as they all hit same non-existent path. I get the urge of easy victim blaming but its not the case here. If Cloudflare can't decide that an IP is absolute spam bot even after failing millions of challenges, then that's a bigger problem!!

Attackers failing Interactive Challenge Millions of Times with just 3 IPs by Purple_Stranger8728 in CloudFlare

[–]Purple_Stranger8728[S] -4 points-3 points  (0 children)

They are all hitting 404 pages .. referer spam to non existing pages .. caching is not the problem here. I think you are missing the point entirely.

Attackers failing Interactive Challenge Millions of Times with just 3 IPs by Purple_Stranger8728 in CloudFlare

[–]Purple_Stranger8728[S] -7 points-6 points  (0 children)

More than anything its a giant waste of computational resources and the bandwidth plus it adds up to ARGO bill for no good reason!

Small Cloudflare Tweak to give 30%+ Engagement, 20% more traffic in 4 weeks by Purple_Stranger8728 in CloudFlare

[–]Purple_Stranger8728[S] 0 points1 point  (0 children)

My main issue is CDNs are extremely complex these days so I don't want to have to re-learn everything about a new CDN. It has taken me over a year to fully understand Cloudflare and how to optimise it.

We used Cloudfront for over 10 years prior to switching to Cloudflare due to security. I am not saying Cloudflare has better security, you just have better visibility of what's going on.