robots.txt Generator voor AI-bots
Genereer geoptimaliseerde robots.txt-bestanden met ondersteuning voor meer dan 40 AI-bots, waaronder ChatGPT, Claude, Perplexity en Gemini. Bepaal welke bots toegang hebben tot je content.
Kies een starttemplate
Bottoegang configureren
OpenAI ChatGPT web crawler
ChatGPT Browse with Bing
Google Gemini AI crawler
Perplexity AI search engine
Anthropic Claude web crawler
Claude web search feature
Aggressive content scraper
Spam indexer bot
Aggressive crawler
Deprecated link crawler
Aggressive Huawei crawler
Beschermde paden
/admin//api//dashboard//auth//login/Usually at https://yoursite.com/sitemap.xml — check by visiting that URL. This tells bots where to find all your pages.
1# ==========================================================================2# robots.txt3# Generated by Bloffee robots.txt Generator4# https://geo-score.online/tools/robots-generator5# Generated: 2026-02-226# ==========================================================================78# Blocked bots9User-agent: BLEXBot10User-agent: MegaIndex11User-agent: SeznamBot12User-agent: linkdexbot13User-agent: PetalBot14Disallow: /1516# Default rules for all other bots17User-agent: *18Disallow: /admin/19Disallow: /api/20Disallow: /dashboard/21Disallow: /auth/22Disallow: /login/23
No sitemap URL declared
Add your sitemap URL (e.g. https://yoursite.com/sitemap.xml) above. This is the bridge between robots.txt and your sitemap — it helps all bots discover your pages.