AI Robots.txt Checker

Check what your robots.txt says to AI crawlers like GPTBot (OpenAI training), OAI-SearchBot (ChatGPT search discovery), ClaudeBot and PerplexityBot — the same 14 AI user-agents the full scan checks, plus 4 common crawlers outside that set (Googlebot, GoogleOther, Applebot, meta-externalagent) — each with its documented purpose.