AI Crawler Checker API
Overview
Check which of 29 AI crawlers (GPTBot, ClaudeBot, PerplexityBot...) a site's robots.txt allows. Free JSON API, no key, plus a ready-to-paste fix.
AI Crawler Checker is a machine learning API. It needs no API key. It is served over HTTPS.
At a glance
- Authentication
- No auth
- HTTPS
- Yes
- CORS
- Unknown
- Category
- Machine Learning
Questions
Does the AI Crawler Checker API need an API key?
No. The AI Crawler Checker API can be called without an API key or sign-up, which makes it handy for prototypes and front-end demos.
Does the AI Crawler Checker API support HTTPS?
Yes, the AI Crawler Checker API is served over HTTPS.
What are alternatives to the AI Crawler Checker API?
Other Machine Learning APIs include Dialogflow, OpenAI, Hugging Face, WolframAlpha, OpenRouter.
Similar machine learning APIs
Compare alternatives →Dialogflow
Machine LearningNatural Language Processing
OpenAI
Machine LearningUse AI models such as ChatGPT or DALL-E to experience the capabilities of AI
Hugging Face
Machine LearningAI model hub with inference API for NLP, computer vision, and audio
WolframAlpha
Machine LearningProvides specific answers to questions using data and algorithms
OpenRouter
Machine LearningUnified API for 300+ LLMs from OpenAI, Anthropic, Meta, Mistral and more, with a free tier
Laya Decision Gateway
Machine LearningSub-35ms AI gateway for prompt injection defense, support ticket triage & content moderation
Listed from Free Public APIs.