Guide · Ai search

How Ai engines choose which sources to cite

Most Ai answers that cite sources come from a retrieval step. The engine searches an index, pulls a short list of candidate pages, then keeps the passages that answer each part of the question from sources it judges reliable. Pages get chosen when the engine can reach them, they match the underlying searches, they answer clearly, and other sources back them up.

Key takeaways
  • Each engine searches an index first: its own, Bing’s or Google’s.
  • Blocking an engine’s search crawler can remove you from its answers.
  • Clear, self-contained passages are easier to select than long, vague copy.
  • Corroboration matters: brand mentions, reviews and backlinks make a source easier to trust.

The pipeline behind a cited answer

  1. Query understanding. The engine rewrites the question into searches, often several (Google calls this query fan-out).
  2. Retrieval. It pulls candidate pages from a search index.
  3. Selection. It reads the candidates and keeps passages that directly answer a part of the question, preferring sources that look reliable and current.
  4. Synthesis. It writes the answer, combining what several sources agree on.
  5. Citation. It links to some of the sources it used. Not every source used is shown, and not every page shown is equally weighted.

Which index each engine searches

Which index each Ai engine searches and which crawler to allow
Engine Main index it searches Search crawler to allow
ChatGPT Its own crawl plus third-party search providers, including Microsoft OAI-SearchBot
Microsoft Copilot Bing bingbot
Google Ai Overviews and Ai Mode Google Search Googlebot
Gemini Google Search Googlebot
Perplexity Its own index PerplexityBot
Claude Web search plus its own crawler Claude-SearchBot

Crawler access: search vs training

Ai companies typically run separate crawlers for training models, for building search indexes and for fetching pages when a user asks. They can be allowed or blocked independently in robots.txt. For example, ChatGPT’s documentation separates GPTBot (training) from OAI-SearchBot (search), and says sites that block OAI-SearchBot won’t appear in ChatGPT search answers. Google’s Google-Extended token governs some Gemini uses, but Ai Overviews in Search follow Googlebot.

The practical rule: whatever you decide about training, keep the search crawlers of the engines your buyers use allowed, at the robots.txt, firewall and CDN level.

What makes a source get selected

  • Relevance to the sub-question. The passage answers one specific part of the question, using the same terms the searcher used.
  • Extractability. A clear heading followed by a direct answer, a list or a table is easy to lift. Answers buried in long paragraphs, images or PDFs are not.
  • Specificity and evidence. Numbers, named sources, dates and first-hand detail beat general statements.
  • Corroboration. Claims that other trusted sites also make are safer to repeat. This is why brand mentions, reviews and listings matter so much.
  • Authority. Sites with strong backlink profiles, real reviews and a history of being cited are more likely to be chosen again.
  • Freshness. For time-sensitive questions, recently updated pages have an edge.

The types of sources engines lean on

Look at the citations in answers for your own buyer questions and you will usually see a mix of: review platforms and directories, “best of” and comparison articles, forums and community threads, reference sites, news and trade publications, and brand websites. Each industry has its own favorites. Finding out which ones the engines cite for your questions tells you where to earn reviews, listings and mentions.

A worked example

Imagine a buyer asks: “Which accountant in Austin is best for a small restaurant?” A generative engine might fan that out into searches like “restaurant accountant Austin”, “best small business CPA Austin reviews” and “what to look for in a restaurant accountant”. It then reads the top results for each.

The accountant who gets named is usually the one who appears in several of those result sets at once: a service page that says “accounting for Austin restaurants” in plain words, a strong profile on the review sites that rank for the second search, and a mention in a local business publication or association directory. A firm with a better website but no reviews or mentions often isn’t in enough of the candidate pages to be chosen.

How to become a cited source

  1. Open the door. Allow the search crawlers you care about and make sure key content renders as plain text.
  2. Map the questions. List the questions buyers ask at each stage, then the sub-questions an engine would fan out to.
  3. Write extractable answers. One question per heading, the answer in the first two or three sentences, details after.
  4. Add evidence. Prices, timelines, data, named sources and real examples.
  5. Earn corroboration. Reviews on the platforms engines cite, brand mentions in lists and publications, and backlinks from relevant sites.
  6. Measure and iterate. Track which sources get cited for your questions and close the gaps.
Keep reading

Related guides

How ChatGPT recommends businesses

Where ChatGPT’s recommendations come from, why it names competitors, and how to become the pick.

Read the guide

Getting into Google Ai Overviews

What Google actually requires, how query fan-out works and the steps that get pages cited.

Read the guide

What is GEO?

Generative engine optimization explained: where it came from, how it works and how to measure it.

Read the guide

Look up a term in the AEO & GEO glossary

Want this done for you?Our AEO & GEO and SEO programs put these steps to work, with every result tracked in your dashboard.

Explore AEO & GEO

Free Ai visibility audit

See how Ai sees your business

Find out whether ChatGPT, Gemini, Perplexity and Google recommend you, who they recommend instead, and what it would take to change that.

  • Engine-by-engine checkMentions and citations across every major Ai engine
  • Competitor comparisonWho gets named for your buyer questions
  • Trusted-source mapReview sites, directories and publications Ai leans on
  • Prioritized quick winsSite, schema, reviews and mention fixes, ranked