crawlercheck Verified
Check which AI crawlers your robots.txt allows or blocks
Screenshot of crawlercheck.sebastiaan-ba3.workers.devOpen website ↗
About this tool
crawlercheck is a free tool that analyzes your site's robots.txt to show which of roughly 20 named AI crawlers, including GPTBot, ClaudeBot, PerplexityBot, and CCBot, are allowed or blocked. A paid option adds plain-English recommendations and a ready-to-paste robots.txt snippet. It is built by Doormat Capital.
Related tools
FlexQueries
SEO and AI visibility research, pay-as-you-go
Rank Ahead
A SaaS for faster, autopilot website indexing on Google
arobase
Domain Names Availability Reports to find your next domain fast
Datawave
Startup Marketing Platform
VStat
VStat - AI-Powered Marketing Analysis, any site or domain visito
Linktopia
Give Links to Receive Links
Submit your Tool
Publish your website on Twelve.Tools and get a DR 83 dofollow backlink to boost your SEO
Submit NowFrogDR
Monitor your Domain Rating