What is Sitemap & Discoverability?
Sitemap & Discoverability measures how easily AI crawlers can find and access your content. Unlike traditional search engines that have crawled the web for decades, AI crawlers like GPTBot, ClaudeBot, and PerplexityBot are newer and have distinct crawl strategies. GPTBot sweeps breadth-first at 4,200 hits per day, while ClaudeBot goes deeper at an average depth of 5.2 levels. If your content is not in their path — through your sitemap, internal links, or navigation structure — it simply does not exist for AI.
The analyzer checks for XML sitemaps referenced in robots.txt, evaluates internal link density, measures navigation depth, and assesses freshness signals like lastmod timestamps. Poor discoverability means even the highest-quality content gets overlooked by AI crawlers, directly impacting your GEO-Score.
Why Discoverability Matters for AI Visibility
Content quality is irrelevant if AI crawlers never find your pages. Unlike Google, which has indexed most of the web over 25 years, AI crawlers are building their knowledge base from scratch — and each one does it differently. Three research findings explain why discoverability is the prerequisite for everything else:
Discoverability Is the Prerequisite for All Other Metrics
Your content can score 100/100 on readability, E-E-A-T, and citations — but if no AI crawler finds the page, none of it matters. An XML sitemap referenced in robots.txt is the single most reliable way to ensure all AI crawlers know your pages exist. Without it, discovery depends entirely on following internal links, which is slower and incomplete.
Each AI Crawler Discovers Content Differently
A 30-day study across 12 production sites found that GPTBot crawls breadth-first (average depth 3.8 levels), ClaudeBot crawls depth-first (average depth 5.2 levels), and PerplexityBot only fetches pages when a user query references the domain. This means your site architecture must work for three fundamentally different discovery strategies simultaneously.
Accurate Lastmod = 47% Faster Revisits
The same study found that GPTBot revisits pages with accurate last-modified headers 47% faster than pages without freshness signals. Your sitemap's lastmod timestamps directly influence how quickly AI crawlers pick up content changes — stale or missing timestamps mean your updates go unnoticed for days or weeks.