| Google Search | Results from: Google | Allow: Googlebot | Includes AI Overviews and AI Mode. Google says a page must be indexed to appear as a link in them, and the site must not be opted out in Search Console. Source |
| Gemini | Results from: Google | Allow: Googlebot | Grounds answers with content from the Google Search index. Blocking Google-Extended opts your site out of that. Source |
| Bing | Results from: Bing | Allow: Bingbot | Bing runs its own index and accepts URLs through Webmaster Tools and IndexNow. Source |
| Microsoft Copilot | Results from: Bing | Allow: Bingbot | Microsoft describes Copilot experiences that rely on Bing’s index. Source |
| Yahoo Search | Results from: Bing | Allow: Bingbot | Yahoo says all of its algorithmic results are provided by Bing. Source |
| DuckDuckGo | Results from: Mostly Bing | Allow: Bingbot | DuckDuckGo says most of its organic links are sourced from Bing. Source |
| Ecosia | Results from: Bing, Google or a European index | Allow: Googlebot and Bingbot | The provider depends on your country, browser and settings. Source |
| ChatGPT search | Results from: Its own crawler and partner providers | Allow: OAI-SearchBot | OpenAI says to allow OAI-SearchBot to be eligible. Its help page names Microsoft among the search providers it queries. Source |
| Perplexity | Results from: Its own crawler | Allow: PerplexityBot | PerplexityBot surfaces and links pages in Perplexity’s answers. Source |
| Claude | Results from: Its own crawler | Allow: Claude-SearchBot | Blocking Claude-SearchBot may reduce your visibility in Claude’s search results. Source |
| Apple (Siri, Spotlight, Safari) | Results from: Apple’s own crawler | Allow: Applebot | Applebot follows your Googlebot rules when nothing in robots.txt names it. Source |
| Brave Search | Results from: Its own index | Allow: Googlebot rules | Brave’s crawler has no separate name and skips any page Googlebot is not allowed to crawl. Source |
| IndexNow engines (Yandex, Seznam, Naver) | Results from: Their own indexes | Allow: Their own | They take part in IndexNow, and each participant shares the URLs it receives with the others, including Bing. Source |