# How Google’s AI Mode Compares to Traditional Search and Other LLMs [AI Mode Study]

Author: [Eugene Levin](/content/blog/user/145719985/index.html)

9 min read

July 21, 2025

Contributors: [Anna Yudina](/content/blog/user/148722465/index.html) and [Luke Harsel](/content/blog/user/145694017/index.html)

## Table of contents

Google [launched its AI Mode](/content/blog/google-ai-mode-could-reshape-search/index.html) in the US in May, and SEOs are now facing a new frontier.

In this study, we set out to understand how AI Mode compares to traditional Google search, AI Overviews, and two leading LLM-powered search engines: ChatGPT and Perplexity.

## Key Findings at a Glance

- **AI Mode prefers sidebar linking**: **92% of AI Mode responses** featured a sidebar showing ~7 unique domains. These links had a **51% domain overlap and 32% URL overlap** with Google’s top 10 search results.
- **Organic links still matter**: In the 7% of AI Mode queries where additional links appeared below the response, there was an **89% domain overlap and 80% URL overlap** with Google’s top 10 search results.
- **Reddit dominates**: It appeared as a leading citation source across all LLMs we studied.
- **Query intent affects response length**: Commercial queries triggered responses **~2x longer** than informational ones.
- **AI Mode looks more similar to ChatGPT** than AI Overviews, indicating this new mode is more than just an upgraded version of AIOs. It’s an AI-powered search engine meant to compete with ChatGPT and other LLMs.

## Methodology

### What We Analyzed

To ensure balanced representation, we selected keywords across four core intent types and two distinct search volume tiers. Then, we queried them each into the four AI search platforms (desktop format) and recorded the results.

- **5,000 randomly selected keywords** from the Semrush database (similar to the sample used in our previous comparison of [ChatGPT Search, Bing, and Google](/content/blog/searchgpt-vs-google-bing/index.html))
- **Over 150,000 unique citations** across the platforms
- **Four equal groups of search intent:** informational, transactional, commercial, navigational (evenly distributed)
- **Two equal tiers of search volume:** 0-1,000 and 1,001-10,000 monthly searches
- **Four platforms:** Google Search (top 10 organic rankings and AI Overviews), Google AI Mode, ChatGPT, Perplexity
- **Overlaps between citations and rankings:** When measuring overlap between Google and AI results, we compared AI citations in each platform’s response to the top 10 organic results on Google for the same query.

### What We Looked For

- Text and link overlap between platforms
- Response length variations
- Source citation patterns

## AI Citations Only Partially Overlap with Google Search

The first question we asked was about the overlap:

**How closely did AI Mode and other LLMs mirror Google’s traditional top 10 rankings?**

To measure this, we took each query and counted the number of overlapping domains and URLs between each platform and Google’s top 10 organic rankings.

While we saw a solid overlap between Google’s top 10 organic rankings and LLM citations, the overlap was far from absolute—and it varied by platform.

- **Perplexity** showed the strongest alignment with Google’s top 10 rankings, with **over 91% domain overlap** and **82% URL overlap**. This suggests Perplexity leaned heavily on Google’s top 10 when choosing what to cite.
- **Google AI Overviews** also showed significant overlap— **around 86% domain** and **67% URL**—signaling that they still relied heavily on Google’s traditional search index.
- **Google AI Mode** had a looser relationship: **~54% domain** and **~35% URL overlap**. This suggested more independent retrieval behavior, especially in sidebar results.
- **ChatGPT** had the weakest overlap with Google’s top 10 rankings, with the **lowest domain and URL overlap**. This echoed our [previous ChatGPT research](/content/blog/searchgpt-vs-google-bing/#:~:text=SearchGPT%20%26%20Bing%3A%203.5%20domains/index.html) that showed ChatGPT’s overlap was stronger with Bing than with Google.

## How AI Mode Compares to AI Overviews

In their [2024 announcements](https://blog.google/products/search/generative-ai-google-search-may-2024/), Google framed AI Overviews as a way to help users get quick, AI-powered answers—paving the way for the fully interactive AI Mode launched just one year later in May 2025.

While Google positioned AI Overviews as a bridge to its next-generation search experience, we saw a few specific ways AI Mode strayed from the AI Overview playbook.

### A Response + Sidebar with Links Is the Default Format

If you’re not familiar with AI Mode, here’s what it looks like:

The most common format we saw included an AI-generated response and a sidebar with links. In some cases, there was a local pack of results. And in others, we saw more additional links below the response.

**Here’s how often we saw each format:**

- **92% of queries in AI Mode** featured a sidebar with links
- **7% of queries in AI Mode** featured additional links below the AI-generated response
- **1.7% of queries in AI Mode** included no links at all
- **13.49% of queries in AI Mode** included local packs
- This sidebar averaged **seven unique domains** (vs. just three in AI Overviews)

Sidebar links show Google experimenting with new sources, while links placed below the response stick closely to its traditional organic rankings.

While the links below the response only appeared 7% of the time, they had a very strong overlap with traditional Google results.

This split implies a dual system: AI Mode drew broadly for exploratory queries, but leaned on rankings for precision when needed.

Specifically, we saw AI Mode add additional links most often on **navigational searches.**

## Navigational Queries Were Most Similar to Google Search Results

We noted that the additional links below the response had a high overlap with traditional search results. But mostly on navigational queries.

This makes sense. If you’re using Google to navigate somewhere specific, you’d probably like a list of links (and not just an AI-generated response).

This could indicate one difference in how Google sees AI Mode and traditional search differently: AI Mode helps people gather information, ask questions, and compare options while they’re still making up their mind.

Traditional search is there for when people know where they want to go.

## Your Brand in Google’s AI Mode? Now You Can Track It.

Track your brand's presence in AI search and compare it to your rivals—all inside the AI Visibility Toolkit.

## AI Mode Shows More Unique Domains Than Other LLMs

One early critique of AI Mode is Google’s lack of transparency in how it sends clicks and traffic to sites, much like with AI Overviews.

Google recently confirmed that [some AI Mode tracking](https://searchengineland.com/google-ai-mode-traffic-data-search-console-457076) will be available in Search Console, but those clicks will be lumped into overall totals, not separated from traditional search data.

In our study, we saw that AI Mode showed more unique domains than the other LLMs, on average, in its results.

AI Overviews linked to an average of three unique domains per query, while AI mode linked to 7.

Perplexity and ChatGPT fell in the middle.

## AI Mode Most Resembled ChatGPT Search in Response Length

When it comes to response length, we saw Google’s AI Overviews stand out among the LLMs as the briefest option.

AI Mode was closest to ChatGPT with response length, averaging around 300 words per response.

## How AI Mode and Other LLMs Handle Query Intent

Across all platforms, commercial and transactional queries triggered the **longest and most detailed responses**—often double the length of informational responses.

We can see how much shorter AI Overviews are, on average. But more interesting was the trend of commercial and transaction responses being longer on every platform.

For SEOs, this means aligning content depth with query intent is essential:

- **Informational?** Go for clarity and conciseness.
- **Commercial/Transactional?** Expand, compare, explain.
- For each type of intent, match your content depth to what AI tools expect for each intent type

**A Note on AI Search Intent:** While we used four classic search intents for analysis, AI-driven queries are increasingly fluid. With conversational prompts, follow-up questions, and personalized results, AI-driven search is expanding the boundaries of traditional search intent. These four categories serve as a useful reference point for Google search—but marketers should prepare for a more dynamic, multi-intent AI search landscape.

## Citation Patterns in AI Mode vs. Other LLMs

The first graph in this study showed the big-picture overlap between the LLMs and Google search.

To find more patterns, we looked at a few more correlations across the platforms—comparing what these AI systems cited with how content ranked and performed in classic organic search.

## User-Generated Content Platforms Are Everywhere

We looked at the most frequently appearing domains across the four LLMs (AI Mode, AI Overviews, ChatGPT, and Perplexity) and saw several UGC and social sites at the top of this list.

- **Reddit specifically dominated** across AI Mode, AIOs, ChatGPT, and Perplexity
- **In AI Mode,** Reddit, YouTube, and Facebook appeared in 68%+ of results with additional links—outpacing traditional brand websites
- **Mapbox.com and openstreetmap.org,** two platforms for building custom interactive maps, cracked the top 10 despite zero visibility on Google for the same queries

## Strong Rankings at the Domain Level Correlate with AI Visibility

One of the clearest signals in our study: domains that ranked well in Google’s organic top 10 results were far more likely to be cited in AI-generated answers.

The relationship was consistent across all LLMs we examined. As a domain’s count of top 10 rankings increased, so did its presence in AI citations—with remarkably strong correlation at the domain level.

What this tells us is that across every channel, if your domain gets a lot of top 10 Google rankings, it's very likely that you’ll get a lot of AI citations as well.
  
**The takeaway:** LLMs may trust the same sources, but they won’t always pull from the same page.
