---
title: "Bingbot: Bing's crawler, user agents and robots.txt rules"
description: "Bingbot crawls pages for the Bing index behind Bing search and Copilot. Its user agents, how to verify it, and the robots.txt rules that block or allow it."
canonical: "https://indexmysite.app/tools/ai-crawler-checker/bingbot"
language: "en"
---

# Bingbot: Bing's crawler, user agents and robots.txt rules

Bingbot is Microsoft’s standard crawler. It fetches pages for the Bing index, which Bing search and Copilot draw on, so a page Bingbot cannot crawl cannot be indexed in Bing.

## What Bingbot does

Microsoft says Bingbot is its standard crawler and handles most of Bing’s crawling each day. It renders pages with a recent version of Microsoft Edge, which is why its user agents include the Edge version.

Bing’s robots.txt guide says a page that is not crawled will not be indexed. Bing also supports Crawl-delay, and Bing Webmaster Tools has a crawl control setting.

When Bingbot finds a group in robots.txt that names it, it ignores the generic group, so rules under User-agent: \* have to be repeated in a Bingbot group.

<table><tbody><tr><th scope="row">Operator</th><td>Microsoft</td></tr><tr><th scope="row">robots.txt token</th><td><code>Bingbot</code></td></tr><tr><th scope="row">User agent</th><td><code class="block break-all">Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36</code><code class="block break-all">Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)</code></td></tr><tr><th scope="row">Used for</th><td>Bing and Copilot</td></tr><tr><th scope="row">If you block it</th><td>Bing cannot crawl the page for its index.</td></tr><tr><th scope="row">Check a visit is real</th><td>Run a reverse DNS lookup on the IP address and check the name ends in search.msn.com, then a forward lookup to confirm it resolves back to the same address. Bing also publishes its IP ranges at bing.com/toolbox/bingbot.json and a Verify Bingbot tool.</td></tr></tbody></table>

Source: [Bing: which crawlers Bing uses](https://www.bing.com/webmasters/help/which-crawlers-does-bing-use-8c184ec0)

## Check whether your robots.txt allows Bingbot

Use the [AI crawler checker](https://indexmysite.app/tools/ai-crawler-checker) to read a site's robots.txt and see whether Bingbot and the other search, AI and training crawlers may visit a page.

## How to block or allow Bingbot in robots.txt

Use the Bingbot token. Bing says it caches robots.txt for at least a few hours, so changes can take a few hours to apply.

To block Bingbot from the whole site:

```
User-agent: Bingbot
Disallow: /
```

To allow it everywhere, even when another group blocks all crawlers:

```
User-agent: Bingbot
Allow: /
```

A crawler named in a group follows only that group, so repeat any shared Disallow lines in its group. See [how robots.txt blocks work](https://indexmysite.app/blocked-by-robots-txt) for the details.

## Allowed Bingbot? Get the page indexed

Bing’s index reaches further than Bing search. Microsoft describes Copilot answers that rely on it, and OpenAI’s ChatGPT Enterprise help page says ChatGPT may send searches to Bing. New pages can wait days or weeks for Bingbot, and submitting them brings it sooner.

[Submit your pages](https://app.indexmysite.app/signup) to send them to Google, and add Bing to send them to Bing as well. It works for any public URL, including reviews and posts on other sites that mention you. See [what each AI answer needs](https://indexmysite.app/ai-search-indexing) before it can cite a page.

## Frequently asked questions

### How do I know a visit is really Bingbot?

Run a reverse DNS lookup on the IP address. A real Bingbot resolves to a name ending in search.msn.com, and a forward lookup of that name returns the same IP. Bing also publishes its IP ranges and a Verify Bingbot tool.

Source: [Bing: verifying Bingbot](https://www.bing.com/webmasters/help/how-to-verify-bingbot-3905dc26)

### Does blocking Bingbot remove me from Copilot?

A page Bingbot cannot crawl cannot be indexed in Bing, and Copilot draws on Bing’s index. To keep a page out of Bing and Copilot while letting Bing crawl it, Bing recommends noindex.

### Does Bingbot follow Crawl-delay?

Yes. Bing supports Crawl-delay in robots.txt, and Bing Webmaster Tools has a crawl control setting for the same job.

### Why does Bingbot ignore my User-agent: \* rules?

When robots.txt has a group that names Bingbot, Bingbot follows only that group. Repeat any shared rules inside the Bingbot group.
