Free checker

Is your site ready for AI crawlers?

Check whether a site's llms.txt is published — and whether robots.txt actually lets the major AI crawlers in. Per-bot, across every major vendor.

What this checks

llms.txt — is a published file at /llms.txt that AI assistants read to understand the business.
robots.txt access — whether each major AI crawler is allowed or blocked from the site root: OpenAI (GPTBot, OAI-SearchBot, ChatGPT-User), Anthropic (ClaudeBot, Claude-SearchBot, Claude-User), Google-Extended, Perplexity (PerplexityBot, Perplexity-User), Applebot-Extended, and CCBot.

A blocked robots.txt means AI can't read the site at all — no llms.txt will help until that's fixed. Enter a domain above to run the check.