Key point. Perplexity-User is Perplexity's AI user fetcher. It fetches a page when a person asks the assistant to look at it; it is not an automatic crawler. robots.txt may not apply to it, because a person triggers the request.
Perplexity-User at a glance
These are the facts our registry holds for Perplexity-User, checked against Perplexity's documentation on October 14, 2026.
| Vendor | Perplexity |
| Used by | Perplexity search |
| Purpose | AI user fetch |
| Type | User agent |
| Follows robots.txt | Not always; source: vendor's documentation, as recorded in our AI crawler check |
| Vendor documentation | Perplexity crawler page, checked October 14, 2026 |
| Published IP ranges | www.perplexity.com/perplexity-user.json |
What is Perplexity-User?
Perplexity-User is Perplexity's AI user fetcher. It fetches a page when a person asks the assistant to look at it; it is not an automatic crawler. Our registry notes: Perplexity says Perplexity-User is triggered by a user and generally ignores robots.txt.
In Perplexity's own words (Perplexity's crawler documentation, read October 14, 2026):
- “When users ask Perplexity a question, it might visit a web page to help provide an accurate answer and include a link to the page in its response.”
Perplexity uses other names for other jobs: PerplexityBot (AI search). Each takes its own robots.txt group.
Does Perplexity-User follow robots.txt?
Not always, because a person triggers each request: Our registry notes: Perplexity says Perplexity-User is triggered by a user and generally ignores robots.txt.
What Perplexity says (Perplexity's crawler documentation, read October 14, 2026):
- “Since a user requested the fetch, this fetcher generally ignores robots.txt rules.”
A robots.txt rule records your request. It does not prove a crawler honours it, and firewall or CDN bot settings can refuse a crawler that robots.txt allows, so check those too.
How do I block Perplexity-User in robots.txt?
Add a group that names Perplexity-User and disallows the whole site:
User-agent: Perplexity-User
Disallow: /To keep it out of one folder only, disallow that path instead, for example Disallow: /private/.
robots.txt may not stop it. robots.txt may not apply to it, because a person triggers the request. If you must keep it out, the block has to happen in your firewall or CDN, not only in robots.txt.
How do I allow Perplexity-User?
Perplexity-User is allowed by default: if no group names it and no User-agent: * rule blocks it, it may read every page. A crawler obeys the most specific group that names it and falls back to User-agent: * only when no group names it (RFC 9309), so if a catch-all rule blocks crawlers, add a group for it:
User-agent: Perplexity-User
Allow: /How can I tell if a request really comes from Perplexity-User?
Match the request's IP address against Perplexity's published list, because user agents can be faked: https://www.perplexity.com/perplexity-user.json.
How often do startup websites block Perplexity-User?
Our AI Crawler Access Report read the robots.txt files of 600 sampled startup websites on October 7, 2026. This is its row for Perplexity-User, across the 569 sites whose answer it could read:
| Crawler | Type | Blocked on at least one path | Blocked on all six paths | Named in the file |
|---|---|---|---|---|
| Perplexity-User | AI user fetch | 3 of 569 sites (0.5%; 95% interval 0.2% to 1.5%) | 0 of 569 sites (0%; 95% interval 0% to 0.7%) | 43 of 569 sites (7.6%; 95% interval 5.7% to 10%) |
“Blocked” means the file disallows the crawler on at least one of six common paths (/, /pricing, /blog/, /docs/, /about, /product).
The report's headline figure, for the three AI search crawlers it tracked: “3 of 569 startup websites (0.5%; 95% interval 0.2% to 1.5%) block at least one AI search crawler (Elementera AI Crawler Access Report, October 2026).”
The figures describe that sample of Y Combinator-backed software companies on the day we fetched it. The method, the intervals and the full table are in the AI Crawler Access Report.
What the AI Crawler Access Report adds about Perplexity-User:
5 of 569 sites (0.9%; 95% interval 0.4% to 2.0%) block at least one of the fetchers that visit a page when a person asks an assistant to read it (ChatGPT-User, Claude-User, Perplexity-User, Meta-ExternalFetcher).
How do I check whether my robots.txt blocks Perplexity-User?
Paste your robots.txt into our free checker and it shows, crawler by crawler, whether Perplexity-User may read the path you choose. Nothing you paste leaves the page.