Elementera
Products
OriginumLenzThe Supervised plan, our managed AEO service
Case StudiesBlogFree ToolsResearchAbout UsBook a call
Book a call
  1. Home
  2. AI crawlers
  3. GoogleOther

GoogleOther: what it is, and how to allow or block it in robots.txt

Key point. GoogleOther is a Google crawler with a narrow purpose. It does not decide whether AI search engines can find or cite you. It follows robots.txt.

GoogleOther at a glance

These are the facts our registry holds for GoogleOther, checked against Google's documentation on October 16, 2026.

VendorGoogle
PurposeOther
TypeUser agent
Follows robots.txtYes; source: community ai.robots.txt list (commit 9ad8a47e)
Vendor documentationGoogle crawler page, checked October 16, 2026
Published IP rangesdevelopers.google.com/static/crawling/ipranges/common-crawlers.json
Seen on elementera.com, October 22 to 31, 2026248 verified requests (4.6% of verified AI crawler requests)

What is GoogleOther?

GoogleOther is a Google crawler with a narrow purpose. It does not decide whether AI search engines can find or cite you.

In Google's own words (Google's crawler documentation, read October 16, 2026):

  • “GoogleOther is the generic crawler that may be used by various product teams for fetching publicly accessible content from sites.”

Google uses other names for other jobs: Googlebot (web search); Google-Extended (AI training); Google-CloudVertexBot (other). Each takes its own robots.txt group.

What does GoogleOther fetch on our own site?

GoogleOther fetched 112 different pages of our own site from October 22 to 31, 2026, in 248 verified requests. We log every request through Cloudflare (10 days, sampled counts, so each figure is an estimate):

GoogleOther on elementera.comOctober 22 to 31, 2026
Requests naming GoogleOther248
Verified as Google's own248: 214 by Cloudflare's verified-bot flag, 34 by Google's published IP list
Name only, not verified0
GoogleOther's share of verified AI crawler requests4.6% of 5,447
Verified GoogleOther requests per day2, 43, 5, 22, 115, 24, 7, 20, 7, 3
First verified GoogleOther request we loggedOctober 21, 2026, 23:10 UTC
Cloudflare files GoogleOther under“AI Crawler”
GoogleOther came fromGoogle LLC (AS15169), 248
User agent GoogleOther sent most (230 of 248)Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.8010.52 Mobile Safari/537.36 (compatible; GoogleOther)
GoogleOther read our robots.txt2 times
What our site answered GoogleOther2xx 218, 3xx 24, 4xx 6

GoogleOther's daily count fell: 187 verified requests in the first five days, 61 in the last five.

Out of 112 different pages of ours, GoogleOther fetched these most: /product/lenz (17), /blog (12), /aeo-booking (11), /contact (7), /ai (4).

By section, GoogleOther's page requests went to other pages 30%, blog posts 27%, AI crawler pages 17%, product pages 8.3%, free tools 6.5%.

It re-read robots.txt about once per 123.0 other requests, so a rule change reaches GoogleOther quickly.

Our own robots.txt names GoogleOther in its AI group, which closes 3 old blog posts; none of GoogleOther's 248 verified requests asked for one.

Does GoogleOther follow robots.txt?

Yes, GoogleOther follows robots.txt: our registry records this from the community ai.robots.txt list (commit 9ad8a47e).

What Google says about its common crawlers (Google's crawler documentation, read October 16, 2026):

  • “They always obey robots.txt rules when crawling automatically.”

A robots.txt rule records your request. It does not prove a crawler honours it, and firewall or CDN bot settings can refuse a crawler that robots.txt allows, so check those too.

How do I block GoogleOther in robots.txt?

Add a group that names GoogleOther and disallows the whole site:

User-agent: GoogleOther
Disallow: /

To keep it out of one folder only, disallow that path instead, for example Disallow: /private/.

How do I allow GoogleOther?

GoogleOther is allowed by default: if no group names it and no User-agent: * rule blocks it, it may read every page. A crawler obeys the most specific group that names it and falls back to User-agent: * only when no group names it (RFC 9309), so if a catch-all rule blocks crawlers, add a group for it:

User-agent: GoogleOther
Allow: /

How can I tell if a request really comes from GoogleOther?

Match the request's IP address against Google's published list, because user agents can be faked: https://developers.google.com/static/crawling/ipranges/common-crawlers.json.

How do I block requests that only pretend to be GoogleOther?

To block requests that only pretend to be GoogleOther, use Cloudflare's verified-bot flag: on our site it flagged 214 of 248 verified requests. Add a custom rule with this expression and the action Block:

(http.user_agent contains "GoogleOther" and not cf.client.bot)

On our October 22 to 31, 2026 logs it would have stopped the 0 unverified requests, and also 34 real ones that only Google's IP list confirmed; add and not ip.src in $googleother_ips (a list filled from https://developers.google.com/static/crawling/ipranges/common-crawlers.json) to keep those.

Google's list for GoogleOther held 317 address ranges when our daily job read it on November 1, 2026.

How often do startup websites block GoogleOther?

We have no figure for GoogleOther: it was not one of the crawlers our AI Crawler Access Report tracked. For the crawlers it did track, the headline figure is: “3 of 569 startup websites (0.5%; 95% interval 0.2% to 1.5%) block at least one AI search crawler (Elementera AI Crawler Access Report, October 2026).”

The method and the per-crawler table are in the AI Crawler Access Report.

How do I check whether my robots.txt blocks GoogleOther?

Read the group by hand: our free crawler checker covers 16 crawlers, and GoogleOther is not one of them yet.

  1. Open yoursite.com/robots.txt.
  2. Look for a User-agent: GoogleOther line. If there is one, only that group applies to GoogleOther.
  3. If there is none, the User-agent: * group applies.
  4. Within the group, the longest matching Allow or Disallow rule for a path wins.

Where can I see every AI crawler?

Our list of AI crawlers shows all 29 names in our registry, filtered by purpose. The same data is a free JSON download in our AI crawler registry.

Frequently asked questions

Three questions site owners ask about this name, each answered in one paragraph.

Should I block GoogleOther?

Usually there is no need. It does not decide whether AI search engines can find or cite you. Blocking it does not decide whether AI search engines can cite you.

Does blocking GoogleOther affect other crawlers?

No. robots.txt groups are matched by name, so a group for GoogleOther applies only to GoogleOther. Google's other names (Googlebot, Google-Extended, Google-CloudVertexBot) need their own groups.

How do I see whether GoogleOther visits my site?

Search your server or CDN logs for GoogleOther in the user agent. User agents can be faked, so check the request's IP address against Google's published list: https://developers.google.com/static/crawling/ipranges/common-crawlers.json

Work with us

There are two ways to work with us. Teams that want the work done for them can use our managed AEO services: Book a call. Teams that want to see where they stand first can start with Lenz, our free analysis of how ChatGPT and Gemini answer their buyers' questions: Get your free AI visibility report.

How this page was made

Written by Mojtaba Ebadi. Reviewed by Soroush Mehri.

Sources

  • Google, crawler documentation: developers.google.com (read October 16, 2026)
  • Google, published IP ranges for GoogleOther: developers.google.com/static/crawling/ipranges/common-crawlers.json
  • Elementera, Cloudflare request logs for elementera.com, October 22 to 31, 2026 (sampled counts)
  • ai.robots.txt, community list of AI agents: github.com/ai-robots-txt/ai.robots.txt
  • Koster, Illyes, Zeller and Sassman, “Robots Exclusion Protocol”, RFC 9309, IETF, 2022: rfc-editor.org
  • Elementera, AI Crawler Access Report, October 2026: /resources/ai-crawler-access-report
Elementera
Expertise in. Original content out.

Elementera turns what a business knows into original content for AI search, and measures how AI engines describe and recommend it.

Product
OriginumManaged AEO ServicesLenzBook a Call
Learn
BlogCase StudiesFree ToolsResourcesResearchEvents
Guides
What is AEOAEO vs SEOAI visibility funnelllms.txt guide
Company
About UsContactSite map
hello@elementera.comTrustPrivacy PolicyTerms of Service

Supported by

Google
Microsoft
NVIDIA
Cloudflare
Anthropic

Machine-readable summary: llms.txt · Company facts