Free tools for search and AI crawlers
Six free checks, about ten seconds each. See which AI crawlers your robots.txt lets in, whether ChatGPT search can reach you, whether Google may index a page, how your title and link card look, and whether your llms.txt follows the format. No sign-up.
All tools
- AI crawler checkerWhich AI crawlers your robots.txt lets in, and what each one gets when it asks for your page.Open the tool
- ChatGPT search checkerWhether OAI-SearchBot and Bingbot can reach your page, and whether the page lets them show it.Open the tool
- llms.txt validatorChecks your /llms.txt against the llmstxt.org format, or drafts one from your homepage and sitemap.Open the tool
- Indexability checkerStatus, redirects, canonical, robots meta, X-Robots-Tag and robots.txt for one URL, as Googlebot reads it.Open the tool
- Meta tag checkerYour title and meta description as a results page prints them, with the lengths that get cut.Open the tool
- Open Graph previewYour og: and twitter: tags, the image they point at, and how the link card looks in five apps.Open the tool
What they measure
What any crawler can read: robots.txt, the response your server sends to each user agent, the tags in your HTML and the files at your root. Each tool runs the same checks our free scan runs for that part of a site.
What they do not
They do not ask an AI assistant about your brand, and they cannot see whether a page is in Google's, Bing's or ChatGPT's index. They tell you whether the crawlers can get in, and what stops them.
All of it, and the rest, in one scan.
The free scan runs 156 checks on your site, each with its fix. No account, just the address.