Robots.txt
Generator
Control how search engines crawl your site. Generate a valid robots.txt file.
CRAWLERS
All Bots (*)
Googlebot
Bingbot
GPTBot (OpenAI)
ChatGPT-User
CCBot (Common Crawl)
Anthropic AI
BLOCKED PATHS
+ Add Path
OPTIONS
Include Sitemap
Crawl-delay
Block all AI crawlers
COPY ROBOTS.TXT