---
title: "PerplexityBot: how Perplexity crawls and cites pages"
description: "PerplexityBot surfaces and links websites in Perplexity answers. What blocking it does, its user agent and IP list, and how it differs from Perplexity-User."
canonical: "https://indexmysite.app/tools/ai-crawler-checker/perplexitybot"
language: "en"
---

# PerplexityBot: how Perplexity crawls and cites pages

PerplexityBot is the crawler Perplexity uses to surface and link websites in its search results. Perplexity says it is not used to train AI models, and recommends allowing it if you want your site to appear.

## What PerplexityBot does

Perplexity says PerplexityBot is designed to surface and link websites in search results on Perplexity, and is not used to crawl content for AI foundation models.

Perplexity-User is a separate fetcher that visits a page when a person asks Perplexity a question that needs it. Perplexity says it generally ignores robots.txt, because a person requested the fetch.

Perplexity says changes to its crawler settings can take up to 24 hours to apply.

<table><tbody><tr><th scope="row">Operator</th><td>Perplexity</td></tr><tr><th scope="row">robots.txt token</th><td><code>PerplexityBot</code></td></tr><tr><th scope="row">User agent</th><td><code class="block break-all">Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)</code></td></tr><tr><th scope="row">Used for</th><td>Perplexity search</td></tr><tr><th scope="row">If you block it</th><td>Perplexity does not surface and link the page in its search results.</td></tr><tr><th scope="row">Check a visit is real</th><td>Perplexity publishes PerplexityBot’s IP addresses at perplexity.ai/perplexitybot.json and recommends firewall rules that match both the user agent and the IP address.</td></tr></tbody></table>

Source: [Perplexity: Perplexity crawlers](https://docs.perplexity.ai/guides/bots)

## Check whether your robots.txt allows PerplexityBot

Use the [AI crawler checker](https://indexmysite.app/tools/ai-crawler-checker) to read a site's robots.txt and see whether PerplexityBot and the other search, AI and training crawlers may visit a page.

## How to block or allow PerplexityBot in robots.txt

Use the PerplexityBot token. Perplexity’s docs include allow rules for common firewalls, and note that some bot protection modes cannot be skipped with custom rules.

To block PerplexityBot from the whole site:

```
User-agent: PerplexityBot
Disallow: /
```

To allow it everywhere, even when another group blocks all crawlers:

```
User-agent: PerplexityBot
Allow: /
```

A crawler named in a group follows only that group, so repeat any shared Disallow lines in its group. See [how robots.txt blocks work](https://indexmysite.app/blocked-by-robots-txt) for the details.

## Perplexity's other crawler

| Crawler | Used for | If you block it |
| --- | --- | --- |
| `Perplexity-User` | Perplexity, when a person asks it to visit a page | Perplexity says these visits generally ignore robots.txt. |

## Allowed PerplexityBot? Get the page indexed

Perplexity has no submission form. Its help center says it also works with third-party crawlers to build its index, so a page that is linked from known pages and indexed in the big search engines is easier for it to find.

[Submit your pages](https://app.indexmysite.app/signup) to send them to Google, and add Bing to send them to Bing as well. It works for any public URL, including reviews and posts on other sites that mention you. See [what each AI answer needs](https://indexmysite.app/ai-search-indexing) before it can cite a page.

Read next: [How Perplexity finds and cites pages](https://indexmysite.app/perplexity-seo).

## Frequently asked questions

### How do I get my site into Perplexity?

Allow PerplexityBot in robots.txt and its published IP addresses at your firewall. Perplexity has no submission form, so link new pages from pages its crawler already knows.

### Does PerplexityBot train AI models?

No. Perplexity says PerplexityBot is not used to crawl content for AI foundation models.

### Why does Perplexity still visit my page after I block PerplexityBot?

Those visits are probably Perplexity-User, which fetches a page when a person asks for it. Perplexity says that fetcher generally ignores robots.txt.

### How long does a robots.txt change take for Perplexity?

Perplexity says it may take up to 24 hours for its systems to reflect a change.
