AI Crawler Access
The technical prerequisite of GEO: can AI engines read your site?
Open the page in the appWhy it's the absolute prerequisite
If GPTBot or PerplexityBot is blocked in your robots.txt, your content CANNOT be cited by those engines — whatever its quality. Security plugins and CDNs often add these blocks silently.
The checks
- Bot-by-bot verdict: GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended, Bingbot, CCBot — with each bot's role and criticality.
- Content readable without JavaScript (most AI crawlers don't execute JS).
- XML sitemap and llms.txt (with Google's caution against parallel versions).
Score /100
A blocked critical bot costs 25 points; a JS-only site costs 30. Free, re-checkable in one click (24h cache).
Tip :Aim for 100. If a crawler is blocked, remove the matching Disallow rule, then re-run the check.