Gratis verktyg

robots.txt-generator för AI-bottar

Generera optimerade robots.txt-filer med stöd för 40+ AI-bottar inklusive ChatGPT, Claude, Perplexity och Gemini. Kontrollera vilka bottar som fÄr tillgÄng till ditt innehÄll.

40+
Bottar som stöds
6
SprÄk
100%
Gratis för alltid

VĂ€lj en startmall

Konfigurera bottillgÄng

critical
GPTBot

OpenAI ChatGPT web crawler

critical
ChatGPT-User

ChatGPT Browse with Bing

critical
Google-Extended

Google Gemini AI crawler

critical
PerplexityBot

Perplexity AI search engine

high
ClaudeBot

Anthropic Claude web crawler

high
Claude-Web

Claude web search feature

medium
BLEXBot

Aggressive content scraper

medium
MegaIndex

Spam indexer bot

medium
SeznamBot

Aggressive crawler

medium
linkdexbot

Deprecated link crawler

medium
PetalBot

Aggressive Huawei crawler

Skyddade sökvÀgar

disallow/admin/
disallow/api/
disallow/dashboard/
disallow/auth/
disallow/login/

Usually at https://yoursite.com/sitemap.xml — check by visiting that URL. This tells bots where to find all your pages.

robots.txt23 lines
1# ==========================================================================
2# robots.txt
3# Generated by Bloffee robots.txt Generator
4# https://geo-score.online/tools/robots-generator
5# Generated: 2026-03-24
6# ==========================================================================
7 
8# Blocked bots
9User-agent: BLEXBot
10User-agent: MegaIndex
11User-agent: SeznamBot
12User-agent: linkdexbot
13User-agent: PetalBot
14Disallow: /
15 
16# Default rules for all other bots
17User-agent: *
18Disallow: /admin/
19Disallow: /api/
20Disallow: /dashboard/
21Disallow: /auth/
22Disallow: /login/
23 

No sitemap URL declared

Add your sitemap URL (e.g. https://yoursite.com/sitemap.xml) above. This is the bridge between robots.txt and your sitemap — it helps all bots discover your pages.

Vanliga frÄgor

Gratis robots.txt-generator | ChatGPT, Claude & 40+ AI-bottar