Free tool
Can AI engines even read your site?
Before ChatGPT, Claude, Gemini or Perplexity can recommend you, their crawlers have to be allowed in. Many sites silently block them in robots.txt. Check yours in one click.
How it works
- 1
Enter your domain. Type your domain (e.g. yourdomain.com) into the checker above.
- 2
Run the check. Click "Check access" — PingMyBrand reads your live robots.txt and tests it against all 9 AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, Claude-User, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended and bingbot).
- 3
Read your results. See a 0-100 AI-crawlability score, an Allowed/Blocked verdict for each bot, and whether you have an llms.txt file.
- 4
Fix what's blocking you. Update robots.txt to unblock any disallowed bot, and if llms.txt shows Missing, generate one with the free llms.txt generator.
Why it matters
AI answer engines build their knowledge by crawling the web with 9 named bots — GPTBot and OAI-SearchBot (ChatGPT), ClaudeBot, Claude-User and Claude-SearchBot (Claude), PerplexityBot (Perplexity), Google-Extended (Gemini / AI Overviews), Applebot-Extended (Apple Intelligence), and bingbot (Bing / Copilot). If your robots.txt disallows any of them, your pages are invisible to that engine — no matter how good your content is.
An llms.txt file goes further: it points AI engines to the pages you most want cited. Sites that publish one give engines a cleaner path to the right answer about you.
Looking for a different check? See every free tool in one place →
FAQ
Common questions
It checks whether your site's robots.txt allows all 9 AI crawlers that feed the major answer engines — GPTBot and OAI-SearchBot (ChatGPT), ClaudeBot, Claude-User and Claude-SearchBot (Claude), PerplexityBot (Perplexity), Google-Extended (Gemini / AI Overviews), Applebot-Extended (Apple Intelligence), and bingbot (Bing / Copilot) — to fetch your pages. If any of them is disallowed, that engine can never learn your content from your own site, no matter how good the content is.
Many robots.txt files were written years before these bots existed and use a blanket `Disallow: /` or a broad bot-blocking rule that was aimed at scrapers, not answer engines — the named AI bots get caught in the same net by accident.
Yes — enter a domain and get an instant per-bot allow/disallow result, no signup or card required. It's the same free-tool pattern as the llms.txt generator.
No, crawlability is necessary but not sufficient. It only confirms an engine CAN read your pages; whether it actually mentions and recommends you depends on your content and citations, which is what PingMyBrand's full AI-visibility report measures.