---
title: "LLM SEO starts with getting your pages indexed"
description: "ChatGPT, Google AI Overviews, Copilot and Perplexity cite pages their search systems have crawled and indexed. See what each one needs and get your pages in."
canonical: "https://indexmysite.app/ai-search-indexing"
language: "en"
---

# AI answers can only cite pages that are indexed

ChatGPT, Google AI Overviews, Copilot and Perplexity search before they answer, and they cite what their search finds. To be cited, a page has to be open to their crawler and in the index they search. Index My Site gets your pages into Google and Bing, the two indexes most of these answers draw on.

[Start indexing](https://app.indexmysite.app/signup)[See what each AI answer needs](#needs)

## What each AI answer needs before it can cite a page

Pick an assistant to see the steps its maker documents. Some are changes on your site. Getting the page into Google and Bing is what Index My Site does.

**Google AI Overviews and AI Mode.** Google says a page must be indexed and eligible to show a snippet, and the site must not be opted out of generative AI features in Search Console. Sites are included by default. Source: https://developers.google.com/search/docs/appearance/ai-features

1.  Allow Googlebot. AI Overviews and AI Mode follow your Googlebot rules. There is no separate AI crawler to allow.
2.  Get the page into Google. Index My Site sends it to Google for 1 credit, then searches for it to confirm it is indexed.
3.  Allow a snippet. nosnippet, data-nosnippet and a short max-snippet limit what Google can quote from the page.

**ChatGPT search.** OpenAI says a site is eligible when it allows OAI-SearchBot. ChatGPT also queries partner search providers, and its help page names Microsoft. Source: https://help.openai.com/articles/9237897-chatgpt-search

1.  Allow OAI-SearchBot. In robots.txt, and at your firewall or CDN for OpenAI’s published IP ranges. GPTBot is the separate training crawler.
2.  Get the page into Bing. Index My Site sends it to Bing with the Bing option, 2 credits per URL including Google.

**Microsoft Copilot.** Microsoft describes Copilot experiences that rely on Bing’s index, so a page has to be in Bing first. Source: https://www.bing.com/webmasters/help/how-to-permanently-remove-a-url-or-page-from-bing-or-copilot-37c07477

1.  Allow Bingbot. And leave out noindex, which removes a page from Bing and from Copilot answers.
2.  Get the page into Bing. Index My Site sends it to Bing with the Bing option, 2 credits per URL including Google.

**Gemini.** Gemini apps ground answers with content from the Google Search index. Source: https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers

1.  Allow Googlebot and Google-Extended. Blocking Google-Extended opts the site out of Gemini grounding, and Google Search keeps following your Googlebot rules.
2.  Get the page into Google. Index My Site sends it to Google for 1 credit, then searches for it to confirm it is indexed.

**Perplexity.** PerplexityBot surfaces and links pages in Perplexity’s answers. There is no submission form. Source: https://docs.perplexity.ai/guides/bots

1.  Allow PerplexityBot. In robots.txt, and at your firewall or CDN for Perplexity’s published IP ranges.
2.  Link to new pages. Its crawler finds pages through links, so link new pages from pages that are already well known.

**Claude.** Anthropic says blocking Claude-SearchBot or Claude-User may reduce a site’s visibility in Claude’s answers. Source: https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler

1.  Allow Claude-SearchBot and Claude-User. ClaudeBot is the training crawler. Claude’s search uses Claude-SearchBot.
2.  Link to new pages. Claude has no submission form, so its crawler has to find the page through links.

## Why indexing comes first in LLM SEO

An AI answer is written from search results. Google says AI Overviews and AI Mode may run several related searches for one question and link to the pages they find. ChatGPT can rewrite a question into searches it sends to partner providers. Better writing helps a page get chosen from those results, but a page that is not in them is never considered.

### Crawled

The search crawler is allowed in and has visited the page. Robots.txt, firewalls and bot protection can stop this without you noticing.

### Indexed

The search engine has stored the page and can return it for a search. New pages can wait days or weeks for this. Submitting them shortens the wait.

### Cited

The assistant picks the page from its results and links to it. This is where content quality decides, and only an indexed page gets this far.

## Check AI search crawlers can reach your page

Paste a page address to see whether Googlebot, Bingbot, OAI-SearchBot, PerplexityBot, Claude-SearchBot and Applebot may visit it, and which rule decides each one.

Use the [AI crawler checker](https://indexmysite.app/tools/ai-crawler-checker) to see which search, AI and training crawlers a site's robots.txt allows for a page.

## Get the pages that mention you indexed too

An answer about your product can cite any page that mentions you: a review, a roundup of tools, press coverage, a comparison, or your own LinkedIn and Reddit posts. Each one has to be indexed before it can be cited. Index My Site has no ownership check, so you can submit them all in one job.

### Pages worth submitting

-   Reviews and roundups that list your product
-   Press coverage, interviews and podcast pages
-   Guest posts and partner pages
-   Directory and marketplace listings
-   Your own LinkedIn and Reddit posts

### What it costs and what comes back

Each URL is checked before it is sent, and pages that cannot be indexed are skipped without charge. A URL costs 1 credit for Google, or 2 with Bing. If Google has not indexed it after the final check, the standard credit comes back.

[Index the pages that mention you](https://indexmysite.app/index-pages-that-mention-you)

## Tools and guides for AI search

Check crawler access, see which index each assistant uses, and send new pages automatically.

[

### AI crawler checker

Every search, AI and training crawler your robots.txt lets in, with the rule that decides each one.

](https://indexmysite.app/tools/ai-crawler-checker)[

### Submit to search engines

Which index each search engine and AI assistant draws on, and what one job to Google and Bing covers.

](https://indexmysite.app/submit-website-to-search-engines)[

### Google index checker

Check whether a page is in Google before you expect an AI Overview to cite it.

](https://indexmysite.app/tools/google-index-checker)[

### Automatic indexing

Send new pages to Google and Bing on every deploy, so they are ready to be cited sooner.

](https://indexmysite.app/automatic-indexing)[

### Where ChatGPT gets its information

Training data, OpenAI’s own index, Bing and Google results, and which mode uses which.

](https://indexmysite.app/where-does-chatgpt-get-its-information)[

### How to get cited by ChatGPT

Seven steps to get your pages, and the pages that mention you, into ChatGPT’s sources.

](https://indexmysite.app/how-to-get-cited-by-chatgpt)[

### Perplexity SEO

How Perplexity builds its index, what it checks in a source, and how to get cited.

](https://indexmysite.app/perplexity-seo)[

### Unlinked brand mentions

Why mentions matter more than links to AI answers, and how to get them indexed.

](https://indexmysite.app/unlinked-brand-mentions)

## Frequently asked questions

### What is LLM SEO?

Making your pages findable and citable in answers from ChatGPT, Google AI Overviews, Copilot, Perplexity and other assistants. It is also called AEO or GEO. Most of these answers search first and then write, so the first step is that the search system behind them has crawled and indexed your page.

### How do I rank in ChatGPT?

Allow OAI-SearchBot in robots.txt and at your firewall, and get the page into Bing, because ChatGPT queries partner search providers and OpenAI names Microsoft among them. After that, OpenAI says it ranks results by relevance and reliability, and placement is never guaranteed.

### How do I get cited in Google AI Overviews?

Google says a page must be indexed and eligible to show a snippet, and the site must be included in generative AI features in Search Console, which is the default. So allow Googlebot, get the page into Google’s index, and do not block snippets on the text you want quoted.

### How do I rank on Perplexity?

Allow PerplexityBot in robots.txt and its IP ranges at your firewall. Perplexity has no submission form, so link to new pages from pages its crawler already knows.

### Does blocking GPTBot stop ChatGPT citing my site?

No. GPTBot collects content for training. ChatGPT search uses OAI-SearchBot, and OpenAI treats the two separately.

### Do I need an llms.txt file to appear in AI answers?

Google says AI Overviews and AI Mode need no special optimizations, and its requirements do not include llms.txt. The crawler documentation from OpenAI, Perplexity and Anthropic linked on this page asks for robots.txt access.

### Can I get pages on other sites cited?

Only the site owner can change those pages, but you can get them indexed. Index My Site accepts any public URL, so you can submit reviews, roundups, press coverage and your own social posts that mention you.

## Get your pages into the indexes AI answers use

Create an account, buy credits from $25, and send any public URL to Google and Bing. Each one reports whether it was indexed.

[Start indexing](https://app.indexmysite.app/signup)

[See pricing](https://indexmysite.app/pricing)
