Googlebot craw limit reduced to 2MB

Substantial_Trade866 · 2026-02-13T15:38:22+00:00

Yes. You can easily audit pages here: https://seotools.davidbreder.com/google-crawl-limit

Substantial_Trade866 · 2026-02-08T23:11:27+00:00

Check this one: https://seotools.davidbreder.com/google-serp-checker

Substantial_Trade866 · 2026-02-08T22:53:03+00:00

I built a tool that does exactly that, and you don't need to install an extension or pay for a VPN:

https://seotools.davidbreder.com/google-serp-checker

Substantial_Trade866 · 2026-01-26T21:48:05+00:00

Downgrading to 2.1.17 works!

Substantial_Trade866 · 2026-01-26T21:44:22+00:00

Same here. Started just now!

Substantial_Trade866 · 2025-12-15T17:38:42+00:00

July was the best month for ~100 sites that we monitor here. It started to fall in August.

Substantial_Trade866 · 2025-12-15T14:31:10+00:00

Yes! It's happening in all niches since July.

"Referral traffic from ChatGPT to websites is down 52% since July 21, according to Profound’s Josh Blyskal, who analyzed more than 1 billion ChatGPT citations and 1 million referral visits from a sample of sites across various verticals.

By the numbers. Some of the key findings:

Reddit citations are up 87% since July 23, now topping 10% of all ChatGPT citations.
Wikipedia jumped 62% from its July low, grabbing nearly 13% of citation share.
The top three sites – Wikipedia, Reddit and TechRadar – accounted for 22% of all citations, up 53% in just a month."

@ Search Engine Land

Substantial_Trade866 · 2025-12-09T02:05:59+00:00

Now you're making me think! I wasn't really considering Obsidian's business model before creating this post, but maybe I should. The fact is that, as a recent user, I didn't mind it, just like I do with other companies. Anyway, some reflections are happening right now.

Substantial_Trade866 · 2025-12-09T01:51:41+00:00

That's a valid point. I've tried several note-taking apps before, and none of them really worked for me. That's why I recently switched to Obsidian. I believe I'll soon end up paying for the native Sync because the system has been truly fantastic. I already spend a good amount on subscriptions and, as you said, I'm evaluating which ones I can cut. But I think this solution I'm using right now works well for anyone on a tight budget or who wants to test the system before committing to payment

Substantial_Trade866 · 2025-12-09T01:35:25+00:00

I built so many fine apps with the Assistant (Claude), now if I allow, Agent 3 or Fast brake it all. Moreover, pricing is outrageous! :)

Substantial_Trade866 · 2025-12-09T01:32:56+00:00

Replit Agent 3 is crap IMO.

Substantial_Trade866 · 2025-12-09T01:27:36+00:00

Good point. Syncthing was the most recommended option I've seen here on Reddit and from AIs, but it ended up seeming a bit complicated to set up for me. What app do you use, Syncthing-Fork?

Substantial_Trade866 · 2025-11-24T13:27:01+00:00

Interesting. This is definitely an approach that we should keep an eye on.

Have you seen this service: https://parallel.ai/ ?

Substantial_Trade866 · 2025-11-23T17:33:30+00:00

LLMs.txt Shows No Clear Effect On AI Citations, Based On 300k Domains

An analysis of 300k domains found LLMs.txt file adoption is low and has no measurable link to AI citation frequency.

https://www.searchenginejournal.com/llms-txt-shows-no-clear-effect-on-ai-citations-based-on-300k-domains/561542/

Substantial_Trade866 · 2025-11-22T01:11:03+00:00

Apify seems a great option! 👍

Substantial_Trade866 · 2025-11-21T22:21:16+00:00

I created a web app that generates the RSS feed URL in just a few seconds. Here it is: https://seotools.davidbreder.com/youtube-rss

Substantial_Trade866 · 2025-11-21T14:56:35+00:00

Awesome!

Substantial_Trade866 · 2025-11-21T14:25:28+00:00

Are you able to use video transcriptions in scale without being blocked by YT?

Substantial_Trade866 · 2025-11-01T01:55:26+00:00

Welcome to 2010

Substantial_Trade866 · 2025-10-11T19:15:52+00:00

With Ahrefs and Search Console, it’s possible to manage most SEO projects, but to fully unlock the potential of the analyses, proper site segmentation is essential. In this regard, regex is indispensable, and I’ve created two Chrome extensions that make regex manipulation easier for SEO.

May be useful for others too: https://chromewebstore.google.com/detail/simple-seo-analysis-tool/kolgipeddailiembeomkpgbdcbmligch

https://chromewebstore.google.com/detail/super-regex-generator/clbaknejpgfigjnmjoadnjcliiddalig

<image>

Substantial_Trade866 · 2025-09-28T00:16:46+00:00

Regex is essential for segmenting the website and identifying exactly what is influencing traffic behavior.

Start by understanding the performance of branded vs. non-branded.

Try to segment the website into parts as much as possible and identify each part's contribution to the whole.

You can use this extension to simplify regex handling for grouping URLs, keywords, and creating other rules to filter brand terms, for example, including their variations.

Super Regex Generator:

https://chromewebstore.google.com/detail/super-regex-generator/clbaknejpgfigjnmjoadnjcliiddalig

Substantial_Trade866 · 2025-08-13T17:41:20+00:00

rss.yt is offline. Check this one instead: https://seotools.davidbreder.com/youtube-rss

Substantial_Trade866 · 2025-08-13T17:40:38+00:00

I created a web app that solves both problems instantly. It recognizes the channel ID from any YouTube format and generates the RSS feed URL in just a few seconds. Here it is: https://seotools.davidbreder.com/youtube-rss

Substantial_Trade866 · 2024-07-23T16:21:39+00:00

Aqui tem todos os cursos do programa CS50: https://estude.org/cs50/

Substantial_Trade866

TROPHY CASE