# ChatGPT Reasoning Modes Share Only 25.6% of Cited Domains

> A 100-prompt Semrush test found ChatGPT’s minimal and high reasoning settings cite mostly different domains. What it shows and how to test your own prompts.

URL: https://llmagnet.com/blog/chatgpt-reasoning-mode-citations  
Author: Ben Cohen, Founder & CEO at LLMagnet  
Published: 2026-10-21  
Updated: 2026-11-10  
Category: Research

ChatGPT’s reasoning setting changes which websites it cites: in a 100-prompt test on GPT-5.2, only 25.6% of cited domains overlapped between minimal and high reasoning. A visibility report based on one setting can miss most of what the other cites. The test is small and vendor-run, so use it as a reason to check your own prompts, not as a rule.

## Contents

1. What the study measured
2. How reasoning changes the search
3. Where the citations shift
4. What the study can’t tell you
5. Which prompts this matters for
6. What to change on your site
7. Model changes move citations too
8. How to test your own prompts
9. A worked example
10. Common mistakes
11. FAQ

## What the study measured

[Semrush](https://www.semrush.com/blog/chatgpt-reasoning-ai-visibility/) and [Kevin Indig of Growth Memo](https://www.growth-memo.com/p/reasoning-lift-what-happens-to-ai) ran 100 prompts through GPT-5.2 twice, once at minimal reasoning and once at high, for 200 responses. Semrush maps those settings to ChatGPT’s Instant and Thinking modes. The prompts followed 20 buyer journeys in four categories. This is vendor data, collected with Semrush’s own AI Visibility toolkit.

| Measure | Minimal reasoning | High reasoning |
| --- | --- | --- |
| Responses citing at least one source | 50% | 68% |
| Average citations per cited response | 2.6 | 4.5 |
| Web searches, all 100 prompts | 245 | 1,130 |
| Unique domains cited | 127 | 173 |

Overlap of cited domains for the same prompt was 25.6%. Of the 173 domains cited at high reasoning, 99 never appeared at minimal reasoning. The net gain in unique domains is 46, so the bigger finding is the swap, not the growth.

Keep two readings of that overlap apart. By our arithmetic, 74 of the 173 high-reasoning domains (43%) also appeared somewhere at minimal reasoning. The 25.6% is described as overlap for the same prompts, which may be why it’s lower, though Semrush doesn’t publish the formula. A domain can drop out of one prompt and still show up on another.

## How reasoning changes the search

The gap opens before any answer is written. ChatGPT turns your question into its own searches (called fan-out), retrieves pages, then picks which ones to cite. High reasoning ran 4.6 times as many searches, while responses grew only slightly, so the extra citations aren’t just a product of longer text.

![Fan-out queries per response on GPT-5.2: Comparison prompts 24 at high reasoning against 5.5 at minimal, and Selection prompts 15.4 at high against 2.6 at minimal.](https://llmagnet.com/images/blog/charts/reasoning-fanout.png)

*Source: Semrush and Kevin Indig, 2026. Vendor data.*

Citations followed the searches. They peaked at Comparison, with 9.8 per response at high reasoning against 5.8 at minimal, and at Selection they were 4.7 against 2.6. Selection was the most erratic stage: Indig reports 0 to 40 queries per response, with tightly bounded prompts running none and open-ended product builds running 28 to 40.

A separate [October 2026 preprint](https://arxiv.org/abs/2610.15382) that recorded live ChatGPT web sessions found the same shape: GPT-5.4 Thinking often ran several retrieval rounds, while Instant settings mostly ran one. It isn’t peer reviewed, and it used different prompts.

More searching doesn’t always mean more variety. The same domain appeared more than once in 51 of 100 high-reasoning responses, against 26 of 100 at minimal. A site with deep coverage of a topic can take several citations in one careful answer.

## Where the citations shift

The mix of sources moved toward official and institutional material. These are shares of citations by source type in [the Semrush write-up](https://www.semrush.com/blog/chatgpt-reasoning-ai-visibility/). The minimal column adds to more than 100%, so the categories appear to overlap:

| Source type | Minimal | High |
| --- | --- | --- |
| Reddit | 15% | 7% |
| User-generated and review sites | 14.3% | 6% |
| Government and academic | 1.9% | 8.8% |
| Official documentation and support | 12.4% | 17.5% |
| Brands | 62.4% | 60.6% |

![Rise in citation rate from minimal to high reasoning: Finance 28 percentage points, Health and Lifestyle 24, B2B SaaS 16, Consumer Tech 4.](https://llmagnet.com/images/blog/charts/reasoning-category-lift.png)

*Source: Semrush and Kevin Indig, 2026. Vendor data. Each category is a handful of journeys.*

The citation rate rose most in Finance and Health and Lifestyle, less in B2B SaaS and barely in Consumer Tech. The gap also varied by buying stage: +35 points on Problem prompts and +5 on Validation prompts. Semrush doesn’t give the other stages.

A brand cited at the Problem stage was still cited at Selection in 4 of 20 journeys at high reasoning, and in none at minimal. Indig reports that all four were in Finance, and that brand mentions (rather than citations) persisted in 3 journeys at high and 2 at minimal. Treat persistence as a thin result that may be specific to Finance.

## What the study can’t tell you

- **How many people use each mode.** [Indig says](https://www.growth-memo.com/p/reasoning-lift-what-happens-to-ai) he doesn’t know how many users turn reasoning on, so the real-world weight of each mode is unknown.
- **Whether the settings match the app.** The test used minimal and high reasoning settings. Semrush maps them to Instant and Thinking without saying how closely they correspond.
- **How much is just variation.** Each prompt ran once per setting, so the test can’t separate the effect of reasoning from ordinary run-to-run differences. In the preprint above, 40.8% to 44.5% of the pages ChatGPT retrieved for a question appeared in only one of 20 runs on the same Instant setting, so some of the gap between modes may be ordinary churn.
- **Whether it holds on other models.** It covers one model, and the prompt run dates aren’t given.
- **Why a category moved.** The numbers show that Finance rose more than Consumer Tech. They don’t explain why, and the 20 journeys are spread across just four categories.

## Which prompts this matters for

Indig says ChatGPT routes hard prompts to reasoning automatically, and that free users can also use reasoning with limits. So the type of question predicts the mode better than the user’s plan does. He lists multi-criteria comparisons, evaluation frameworks, compliance questions and complex shopping builds as the likeliest triggers. Semrush puts definitions and single-factor questions in the simple group.

| Your situation | What the test suggests | What to do |
| --- | --- | --- |
| Finance or health | Largest lifts. Across all categories, government and academic sources gained | Track both modes. Link primary sources. |
| B2B software | +16 points, and buyers ask multi-criteria questions | Track both modes for comparison and compliance prompts. |
| Consumer tech | +4 points, despite 13.4 fan-out queries per prompt, the most of any category | Start with one mode. Keep review and community coverage current. |
| Definitions and one-factor questions | In Semrush’s simple group | Track on Instant first. |

Semrush explains Consumer Tech’s small lift by saying the model already knows these topics. The test didn’t check that. Ecommerce isn’t covered as a category, so if you sell products, run the test below before changing anything.

## What to change on your site

This is our reading of the data, not something the study tested. If high reasoning moves toward official and institutional sources, the pages to check first are the ones a careful researcher would want:

- **Documentation and support pages.** Make sure they are public and crawlable, and that they answer specific questions such as limits, integrations and security.
- **Comparison and selection content.** These stages drew the most fan-out, so publish plain pages on how you differ, who you’re wrong for, and what you cost where you can.
- **Primary sources.** Link the regulation, standard or study behind each claim, especially in finance and health.

Semrush proposes a two-track plan. For minimal reasoning: comparison content, review sites, Reddit and product pages. For high reasoning: early-stage education, official documentation and reference material at URLs that can be cited. Indig adds that the brand that wins is the one whose documentation surfaces for each sub-query. We read that as a reason to write for the narrow questions behind the main prompt.

## Model changes move citations too

Reasoning settings aren’t the only switch. [SE Ranking compared AI Overviews](https://seranking.com/blog/gemini-3-impact-on-ai-overviews/) on 100,000 US keywords before and after Gemini 3 became the default on January 27, 2026. About 42.4% of previously cited domains (37,870 of 89,262) no longer appeared, almost all of them in the long tail. Among the 500 most cited domains, only one disappeared.

That is vendor data from a before-and-after comparison with no control group, so it can’t isolate the model as the cause. It does show why one baseline goes stale: re-measure after a major model change.

## How to test your own prompts

1. Pick 10 prompts your buyers ask, with at least two each from early research, comparison and final selection.
2. Run each three times on Instant, in fresh chats, and record the cited domains.
3. Run each three times on the highest thinking level your plan offers, and record them separately.
4. Count your domain and your top three competitors in each set.
5. Compare the two sets. A gap that shows up across all three runs is worth acting on; a gap in one run is probably noise.
6. Repeat monthly, and after any major model release.

## A worked example

The company and figures below are made up for illustration. Ledgerly, an accounting app, runs one prompt per buying stage three times in each mode and records how many runs cite ledgerly.example.

| Stage | Instant | Thinking | Reading |
| --- | --- | --- | --- |
| Problem | 0 of 3 | 3 of 3 | Consistent gap. See what Instant cites instead. |
| Comparison | 3 of 3 | 1 of 3 | Unclear. Run again before acting. |
| Selection | 2 of 3 | 0 of 3 | Possible gap. Check docs and pricing pages are crawlable. |
| Validation | 1 of 3 | 1 of 3 | No gap. |

Three runs can only expose large gaps. [SparkToro’s authors](https://sparktoro.com/blog/new-research-ais-are-highly-inconsistent-when-recommending-brands-or-products-marketers-should-take-care-when-tracking-ai-visibility/), who studied repeat runs, suggest at least 60 to 100 runs per prompt, averaged. By hand, act only on all-or-nothing splits like the Problem row, and use a tool if you need finer readings.

## Common mistakes

- **Blending modes in one report.** Indig advises against aggregate views, because the two modes search differently.
- **Testing only Thinking because it cites more.** Semrush calls Instant the default experience, and it behaves differently.
- **Reading a shift as a win or a loss.** You need repeat runs in the same mode first.

You can run this test by hand. For an ongoing baseline, LLMagnet measures AI visibility across seven engines, and its [free audit](https://ai-visibility.llmagnet.com) is one place to start.

## FAQ

### How different are ChatGPT’s citations across reasoning modes?

In a Semrush and Kevin Indig test of 100 prompts on GPT-5.2, 25.6% of cited domains overlapped between minimal and high reasoning for the same prompt. Semrush maps those settings to Instant and Thinking.

### What changes when reasoning is turned up?

In that test the share of responses citing a source rose from 50% to 68%, average citations per cited response from 2.6 to 4.5, and total web searches from 245 to 1,130.

### How many domains appeared only at high reasoning?

99 of the 173 domains cited at high reasoning never appeared at minimal reasoning. Unique domains overall rose from 127 to 173.

### Which sources gain under high reasoning?

Government and academic sources rose from 1.9% to 8.8% of citations and official documentation from 12.4% to 17.5%. Reddit fell from 15% to 7%.

### Does this prove reasoning mode causes the difference?

No. Each prompt ran once per setting on one model, so normal run-to-run variation can’t be ruled out. The study also doesn’t show how many people use each mode.

### How do I measure the gap for my brand?

Run about 10 buyer prompts three times each on Instant and on the highest thinking level you have, record cited domains separately, and act only on gaps that repeat.

### Which prompts are most affected by reasoning?

Kevin Indig lists multi-criteria comparisons, evaluation frameworks, compliance questions and complex shopping builds as the likeliest to trigger reasoning. ChatGPT can route hard prompts to reasoning automatically, so question type is a better guide than the user’s plan.