AI crawlers
PerplexityBot
Also called: Perplexity-User
PerplexityBot is Perplexity’s crawler that surfaces and links websites in Perplexity’s search results.
In plain words
Perplexity says PerplexityBot is not used to crawl content for AI foundation models.
Perplexity also runs Perplexity-User, which visits a page when a user asks a question. Because a user requested it, Perplexity says this fetcher generally ignores robots.txt.
Example
To appear in its search results, Perplexity recommends allowing PerplexityBot in robots.txt and allowing requests from its published IP ranges.
User-agent: PerplexityBot
Allow: /Why it matters for AI search
PerplexityBot is the switch for showing up in Perplexity’s search results.
Perplexity-User generally ignores robots.txt, so a rule for it there does little.
What you can do
- Allow PerplexityBot in robots.txt if you want to be found in Perplexity.
- If you use a web application firewall, allow Perplexity’s published IP ranges. Perplexity’s docs explain how for Cloudflare and AWS.
- Keep private content behind a login, not just behind a robots.txt rule.
Try it: Free robots.txt generator
Often confused with
- Perplexity-User
- Perplexity-User fetches a page for a user’s question. Perplexity says it is not used for web crawling.
- GPTBot
- GPTBot is about training. Perplexity says PerplexityBot is not.
Quick facts
- Run by
- Perplexity
- robots.txt name
- PerplexityBot, Perplexity-User
- Official IP list
- perplexitybot.json
Sources
Facts and sources last checked on 19 October 2026.
Related terms
How does your page do in AI search?
GEO-Score checks one page on 22 signals, from AI crawler access to structured data, and shows what to fix first.
Analyze a page