Gratis tool

robots.txt Generator voor AI-bots

Genereer geoptimaliseerde robots.txt-bestanden met ondersteuning voor 40+ AI-bots, waaronder ChatGPT, Claude, Perplexity en Gemini. Bepaal welke bots toegang tot je content krijgen.

40+
Bots ondersteund
6
Talen
100%
Voor altijd gratis

Kies een starttemplate

Configureer bottoegang

critical
GPTBot

OpenAI ChatGPT web crawler

critical
ChatGPT-User

ChatGPT Browse with Bing

critical
Google-Extended

Google Gemini AI crawler

critical
PerplexityBot

Perplexity AI search engine

high
ClaudeBot

Anthropic Claude web crawler

high
Claude-Web

Claude web search feature

medium
BLEXBot

Aggressive content scraper

medium
MegaIndex

Spam indexer bot

medium
SeznamBot

Aggressive crawler

medium
linkdexbot

Deprecated link crawler

medium
PetalBot

Aggressive Huawei crawler

Beschermde paden

disallow/admin/
disallow/api/
disallow/dashboard/
disallow/auth/
disallow/login/

Usually at https://yoursite.com/sitemap.xml — check by visiting that URL. This tells bots where to find all your pages.

robots.txt23 lines
1# ==========================================================================
2# robots.txt
3# Generated by Bloffee robots.txt Generator
4# https://geo-score.online/tools/robots-generator
5# Generated: 2026-05-23
6# ==========================================================================
7 
8# Blocked bots
9User-agent: BLEXBot
10User-agent: MegaIndex
11User-agent: SeznamBot
12User-agent: linkdexbot
13User-agent: PetalBot
14Disallow: /
15 
16# Default rules for all other bots
17User-agent: *
18Disallow: /admin/
19Disallow: /api/
20Disallow: /dashboard/
21Disallow: /auth/
22Disallow: /login/
23 

No sitemap URL declared

Add your sitemap URL (e.g. https://yoursite.com/sitemap.xml) above. This is the bridge between robots.txt and your sitemap — it helps all bots discover your pages.

Veelgestelde vragen

Gratis robots.txt Generator | ChatGPT, Claude & 40+ AI-bots