Elementera
ProductsCase StudiesBlogFree ToolsAbout UsStart Growing
Start Growing
  1. Home
  2. AI crawlers
  3. Bingbot

Bingbot: what it is, and how to allow or block it in robots.txt

Key point. Bingbot is Microsoft's search engine crawler for Bing search. Blocking it removes your pages from that search engine, including AI answers built on its index. It follows robots.txt.

Bingbot at a glance

These are the facts our registry holds for Bingbot, checked against Microsoft's documentation on October 14, 2026.

VendorMicrosoft
Used byBing search
PurposeWeb search
TypeUser agent
Follows robots.txtYes; source: vendor's documentation, as recorded in our AI crawler check
Vendor documentationMicrosoft crawler page, checked October 14, 2026
Published IP rangeswww.bing.com/toolbox/bingbot.json

What is Bingbot?

Bingbot is Microsoft's search engine crawler for Bing search. Blocking it removes your pages from that search engine, including AI answers built on its index. Our registry notes: Microsoft Copilot retrieves from the Bing search service.

Does Bingbot follow robots.txt?

Yes, Bingbot follows robots.txt: our registry records this from the vendor's documentation, as recorded in our AI crawler check.

A robots.txt rule records your request. It does not prove a crawler honours it, and firewall or CDN bot settings can refuse a crawler that robots.txt allows, so check those too.

How do I block Bingbot in robots.txt?

Add a group that names Bingbot and disallows the whole site:

User-agent: Bingbot
Disallow: /

To keep it out of one folder only, disallow that path instead, for example Disallow: /private/.

How do I allow Bingbot?

Bingbot is allowed by default: if no group names it and no User-agent: * rule blocks it, it may read every page. A crawler obeys the most specific group that names it and falls back to User-agent: * only when no group names it (RFC 9309), so if a catch-all rule blocks crawlers, add a group for it:

User-agent: Bingbot
Allow: /

Want the exact block for every AI crawler at once? Our robots.txt generator for AI crawlers writes it for each choice.

How can I tell if a request really comes from Bingbot?

Match the request's IP address against Microsoft's published list, because user agents can be faked: https://www.bing.com/toolbox/bingbot.json.

How often do startup websites block Bingbot?

Our AI Crawler Access Report read the robots.txt files of 600 sampled startup websites on October 7, 2026. This is its row for Bingbot, across the 569 sites whose answer it could read:

CrawlerTypeBlocked on at least one pathBlocked on all six pathsNamed in the file
BingbotWeb search (reference)3 of 569 sites (0.5%; 95% interval 0.2% to 1.5%)0 of 569 sites (0%; 95% interval 0% to 0.7%)50 of 569 sites (8.8%; 95% interval 6.7% to 11%)

“Blocked” means the file disallows the crawler on at least one of six common paths (/, /pricing, /blog/, /docs/, /about, /product).

The report's headline figure, for the three AI search crawlers it tracked: “3 of 569 startup websites (0.5%; 95% interval 0.2% to 1.5%) block at least one AI search crawler (Elementera AI Crawler Access Report, October 2026).”

The figures describe that sample of Y Combinator-backed software companies on the day we fetched it. The method, the intervals and the full table are in the AI Crawler Access Report.

What the AI Crawler Access Report adds about Bingbot:

0 of 569 sites (0%; 95% interval 0% to 0.7%) close the whole site to crawlers, Googlebot and Bingbot included.
Microsoft Copilot and Google's AI features draw on the Bing and Google indexes, so for them Bingbot and Googlebot are the crawlers that matter.

How do I check whether my robots.txt blocks Bingbot?

Paste your robots.txt into our free checker and it shows, crawler by crawler, whether Bingbot may read the path you choose. Nothing you paste leaves the page.

Free tool · runs in your browser

AI crawler check: which AI engines can read your site?

Paste a site's robots.txt below to see which AI search crawlers, user-triggered fetchers and AI training crawlers it allows or blocks, engine by engine.

Browsers cannot fetch another site's robots.txt directly (cross-origin rules block it), so this page works on pasted text. Open https://your-site/robots.txt in a new tab and copy its contents. Nothing you paste leaves this page.

Try an example:
Keep in mind
  • robots.txt is a request. Well-behaved crawlers follow it; it does not technically stop anyone.
  • This page reads robots.txt only. Firewalls, CDN bot settings and rate limits can block crawlers too, and they are not checked here.
  • Being allowed does not mean being cited. It only means the crawler is not asked to stay away.
  • The deliberate-block check in our research tool also reads llms.txt, the sitemap and the page itself. This page cannot, so it only looks for a comment in robots.txt and otherwise says it could not tell.

Crawler list last verified . Rules follow RFC 9309.

Built by Elementera. Same rules as our crawler-access research.

The full version is at /tools/ai-crawler-check.

Where can I see every AI crawler?

Our list of AI crawlers shows all 26 names in our registry, filtered by purpose. The same data is a free JSON download in our AI crawler registry.

Frequently asked questions

Three questions site owners ask about this name, each answered in one paragraph.

Should I block Bingbot?

Almost never. Blocking it removes your pages from that search engine, including AI answers built on its index.

Does blocking Bingbot affect other crawlers?

No. robots.txt groups are matched by name, so a group for Bingbot applies only to Bingbot.

How do I see whether Bingbot visits my site?

Search your server or CDN logs for Bingbot in the user agent. User agents can be faked, so check the request's IP address against Microsoft's published list: https://www.bing.com/toolbox/bingbot.json

Work with us

There are two ways to work with us. Teams that want the work done for them can use our managed AEO services: Book a call. Teams that want to see where they stand first can start with Lenz, our free analysis of how ChatGPT and Gemini answer their buyers' questions: Get your free AI visibility report.

How this page was made

A script builds this page from our AI crawler registry, the vendor crawler pages we read on October 14, 2026, and, for the blocking figures, the AI Crawler Access Report. Every sentence in quotation marks was checked against the vendor's page that day. Soroush Mehri reviewed the page, and Mojtaba Ebadi approved it for publication.

Sources

  • Microsoft, crawler documentation: www.bing.com (read October 14, 2026)
  • Microsoft, published IP ranges for Bingbot: www.bing.com/toolbox/bingbot.json
  • ai.robots.txt, community list of AI agents: github.com/ai-robots-txt/ai.robots.txt
  • Koster, Illyes, Zeller and Sassman, “Robots Exclusion Protocol”, RFC 9309, IETF, 2022: rfc-editor.org
  • Elementera, AI Crawler Access Report, October 2026: /resources/ai-crawler-access-report
Elementera
Be the brand AI recommends
Product
Managed AEO ServicesLenzBook a Call
Learn
BlogCase StudiesFree ToolsResourcesResearchEvents
Company
About UsContact
hello@elementera.comTrustPrivacy PolicyTerms of Service

Supported by

Google
Microsoft
NVIDIA
Cloudflare
Anthropic

AI assistants: read our llms.txt and our facts page.