---
title: "OAI-SearchBot: the crawler behind ChatGPT search"
description: "OAI-SearchBot surfaces websites in ChatGPT search. What blocking it does, how it differs from GPTBot, its user agent, IP list and robots.txt rules."
canonical: "https://indexmysite.app/tools/ai-crawler-checker/oai-searchbot"
language: "en"
---

# OAI-SearchBot: the crawler behind ChatGPT search

OAI-SearchBot is the crawler OpenAI uses to surface websites in ChatGPT search. If robots.txt or your firewall blocks it, ChatGPT search answers will not show your pages, apart from navigational links.

## What OAI-SearchBot does

OpenAI says OAI-SearchBot is used to surface websites in search results in ChatGPT’s search features, and that sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers, though they can still appear as navigational links.

OpenAI’s help page for ChatGPT search says that to make a website eligible, you allow OAI-SearchBot to crawl it and make sure your host or CDN allows traffic from OpenAI’s published search bot IP addresses. Placement is not guaranteed.

OpenAI says a robots.txt change can take about 24 hours to reach ChatGPT search results.

<table><tbody><tr><th scope="row">Operator</th><td>OpenAI</td></tr><tr><th scope="row">robots.txt token</th><td><code>OAI-SearchBot</code></td></tr><tr><th scope="row">User agent</th><td><code class="block break-all">Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot</code></td></tr><tr><th scope="row">Used for</th><td>ChatGPT search</td></tr><tr><th scope="row">If you block it</th><td>The page is not shown in ChatGPT search answers, apart from navigational links.</td></tr><tr><th scope="row">Check a visit is real</th><td>Match the request’s IP address against openai.com/searchbot.json, and allow those addresses at your firewall or CDN. When it fetches robots.txt, the user agent adds a robots.txt marker.</td></tr></tbody></table>

Source: [OpenAI: overview of OpenAI crawlers](https://platform.openai.com/docs/bots)

## Check whether your robots.txt allows OAI-SearchBot

Use the [AI crawler checker](https://indexmysite.app/tools/ai-crawler-checker) to read a site's robots.txt and see whether OAI-SearchBot and the other search, AI and training crawlers may visit a page.

## How to block or allow OAI-SearchBot in robots.txt

Use the OAI-SearchBot token. Bot protection on your CDN can block it even when robots.txt allows it, so check your firewall rules too.

To block OAI-SearchBot from the whole site:

```
User-agent: OAI-SearchBot
Disallow: /
```

To allow it everywhere, even when another group blocks all crawlers:

```
User-agent: OAI-SearchBot
Allow: /
```

A crawler named in a group follows only that group, so repeat any shared Disallow lines in its group. See [how robots.txt blocks work](https://indexmysite.app/blocked-by-robots-txt) for the details.

## OpenAI's other crawlers

| Crawler | Used for | If you block it |
| --- | --- | --- |
| [`GPTBot`](https://indexmysite.app/tools/ai-crawler-checker/gptbot) | OpenAI model training | Content is not used to train OpenAI models. ChatGPT search is unaffected. |
| `ChatGPT-User` | ChatGPT, when a person asks it to visit a page | OpenAI says robots.txt rules may not apply to these visits. |

## Allowed OAI-SearchBot? Get the page indexed

OAI-SearchBot only lets OpenAI crawl. ChatGPT search also sends rewritten searches to partner search providers, and OpenAI’s ChatGPT Enterprise help page names Bing. A page in Bing’s index, and in Google’s, gives ChatGPT more ways to find it.

[Submit your pages](https://app.indexmysite.app/signup) to send them to Google, and add Bing to send them to Bing as well. It works for any public URL, including reviews and posts on other sites that mention you. See [what each AI answer needs](https://indexmysite.app/ai-search-indexing) before it can cite a page.

Read next: [How to get cited by ChatGPT](https://indexmysite.app/how-to-get-cited-by-chatgpt).

## Frequently asked questions

### How do I get my site into ChatGPT search?

Allow OAI-SearchBot in robots.txt and allow OpenAI’s published search bot IP addresses at your host or CDN. OpenAI has no submission form, and it says placement is not guaranteed.

Source: [OpenAI: ChatGPT search](https://help.openai.com/en/articles/9237897-chatgpt-search)

### How long does a robots.txt change take to apply?

OpenAI says it can take about 24 hours from a robots.txt update for ChatGPT search results to adjust.

### Can I block GPTBot and still allow OAI-SearchBot?

Yes. OpenAI says each setting is independent, and gives allowing OAI-SearchBot while disallowing GPTBot as an example.

### Does ChatGPT-User follow my OAI-SearchBot rules?

No. ChatGPT-User visits a page when a person asks ChatGPT to, and OpenAI says robots.txt rules may not apply to those visits. It is not used to decide what appears in ChatGPT search.
