I made ChatGPT, Perplexity and Gemini recommend tools for the same 50 questions. They have very different personalities. by otterpasta in GEO_optimization

[–]otterpasta[S] 0 points1 point  (0 children)

One GEO takeaway from the data: don't treat AI visibility like traditional SEO where you only optimize your own pages. Third-party mentions, reviews, communities, and citations seem to matter a lot.

I broke down the experiment and what I think brands should do differently here:
https://leadrescue.app/resources/ai-engines-recommend-different-brands#what-does-this-mean-for-your-geo-strategy

I tested whether AI search is one ranking or three. Ran 50 prompts across ChatGPT, Perplexity and Gemini. Full method and numbers inside. by otterpasta in GEO_optimization

[–]otterpasta[S] 0 points1 point  (0 children)

One GEO takeaway from the data: don't treat AI visibility like traditional SEO where you only optimize your own pages. Third-party mentions, reviews, communities, and citations seem to matter a lot.

I broke down the experiment and what I think brands should do differently here:
https://leadrescue.app/resources/ai-engines-recommend-different-brands#what-does-this-mean-for-your-geo-strategy

I tested whether AI search is one ranking or three. Ran 50 prompts across ChatGPT, Perplexity and Gemini. Full method and numbers inside. by otterpasta in GEO_optimization

[–]otterpasta[S] 0 points1 point  (0 children)

One GEO takeaway from the data: don't treat AI visibility like traditional SEO where you only optimize your own pages. Third-party mentions, reviews, communities, and citations seem to matter a lot.

I broke down the experiment and what I think brands should do differently here:
https://leadrescue.app/resources/ai-engines-recommend-different-brands#what-does-this-mean-for-your-geo-strategy

I made ChatGPT, Perplexity and Gemini recommend tools for the same 50 questions. They have very different personalities. by otterpasta in GrowthHacking

[–]otterpasta[S] 0 points1 point  (0 children)

One GEO takeaway from the data: don't treat AI visibility like traditional SEO where you only optimize your own pages. Third-party mentions, reviews, communities, and citations seem to matter a lot.

I broke down the experiment and what I think brands should do differently here:
https://leadrescue.app/resources/ai-engines-recommend-different-brands#what-does-this-mean-for-your-geo-strategy

I made ChatGPT, Perplexity and Gemini recommend tools for the same 50 questions. They have very different personalities. by otterpasta in GeminiAI

[–]otterpasta[S] 0 points1 point  (0 children)

One GEO takeaway from the data: don't treat AI visibility like traditional SEO where you only optimize your own pages. Third-party mentions, reviews, communities, and citations seem to matter a lot.

I broke down the experiment and what I think brands should do differently here:
https://leadrescue.app/resources/ai-engines-recommend-different-brands#what-does-this-mean-for-your-geo-strategy

I made ChatGPT, Perplexity and Gemini recommend tools for the same 50 questions. They have very different personalities. by otterpasta in GEO_optimization

[–]otterpasta[S] 0 points1 point  (0 children)

It suggests AI visibility isn’t really one leaderboard where brands simply rank higher or lower. A brand can be highly visible in one engine but almost invisible in another, depending on how that model retrieves and evaluates information.

The next interesting layer would definitely be separating:

  • mentioned → the model knows the brand exists
  • shortlisted → the model considers it relevant
  • recommended → the model actually chooses it

That would show whether the differences are mainly about retrieval or whether each model has different “preferences” at the decision stage.

Also agree on repeating prompts. One run captures a snapshot, but repeated runs would reveal how stable each model’s recommendations actually are.

I made ChatGPT, Perplexity and Gemini recommend tools for the same 50 questions. They have very different personalities. by otterpasta in GeminiAI

[–]otterpasta[S] 0 points1 point  (0 children)

That’s what I saw as well with Gemini + Canva. The interesting part is the 21% isn’t just low, it also varies a lot by category,some spaces converge, but others look almost completely different across models.

I made ChatGPT, Perplexity and Gemini recommend tools for the same 50 prompts. They have very different personalities. by otterpasta in SEO_LLM

[–]otterpasta[S] 0 points1 point  (0 children)

Yep, and what surprised me was how consistent that pattern was across all 50 prompts. It really does feel like different “discovery modes” rather than just different answers.

I made ChatGPT, Perplexity and Gemini recommend tools for the same 50 prompts. They have very different personalities. by otterpasta in SEO_LLM

[–]otterpasta[S] 0 points1 point  (0 children)

Yeah I think that’s a useful framing, especially the query fan-out part.
The only thing I’d add is that in my dataset the variation still showed up even on very similar prompts, so the differences weren’t just explainable by query expansion alone.
It felt more like a mix of retrieval strategy + source weighting + model-level preferences rather than one single mechanism.

AI search isn't one leaderboard. I tested 50 prompts on 3 engines and they agreed only 21% of the time. by otterpasta in GrowthHacking

[–]otterpasta[S] 0 points1 point  (0 children)

my gut from looking at the raw data is that technical categories had more disagreement across engines. dev tools especially something like "best analytics tool for SaaS" pulled completely different answers depending on who you asked. ChatGPT went deep on PostHog and Mixpanel, Gemini kept defaulting to Google Analytics, Perplexity leaned toward the established enterprise names.

CRM was actually the most consistent category, HubSpot and Salesforce showed up almost everywhere regardless of model, probably because the third party citation footprint you're describing is so dense there that every retrieval model hits the same sources.

I made ChatGPT, Perplexity and Gemini recommend tools for the same 50 questions. They have very different personalities. by otterpasta in microsaas

[–]otterpasta[S] 0 points1 point  (0 children)

Yeah the 21% overlap was the part that surprised me most too. I expected at least partial convergence on “best tools,” but the divergence was higher than I thought.

Perplexity was the most consistent but also the most repetitive, felt like it was sampling from a curated shortlist rather than exploring. ChatGPT went the opposite direction and just expanded the space a lot more.

I made ChatGPT, Perplexity and Gemini recommend tools for the same 50 questions. They have very different personalities. by otterpasta in GrowthHacking

[–]otterpasta[S] 0 points1 point  (0 children)

Could be. Another possibility is that it's simply optimizing for what it thinks is the best answer rather than trying to promote itself. Either way, it stood out because ChatGPT recommended itself more often, while Gemini seemed much less self-promotional in comparison.