Fetch your URL as Googlebot, AdsBot, GPTBot and other AI crawlers — see who’s allowed, who’s blocked in robots.txt, and whether the page is actually reachable. No signup.
Googlebot and AdsBot-Google — blocked here means lost rankings or a disapproved ad.
GPTBot, Google-Extended, PerplexityBot, ClaudeBot — blocked means you won't be cited by AI.
What each rule actually allows, plus live HTTP status — no firewall challenge in the way.
withConflux clients watch these checks over time and get alerted the moment a search, ads or AI bot is blocked.
No signup, no access to your server needed.
Real requests with each crawler's user-agent, plus your robots.txt.
Grouped by search, ads and AI assistants — with the exact rule.
Search, ads and AI crawlers side by side — allowed or blocked, at a glance.
The robots.txt line responsible for each block, so you know precisely what to change.
The HTTP status each crawler actually gets — catch a firewall challenge quietly blocking Google.
If GPTBot, Google-Extended or PerplexityBot are disallowed, those assistants can't read your site — so they can't recommend or cite you. That's an AI-visibility decision, not just an SEO one.
No — we fetch your public URL and robots.txt the way any crawler would. No signup, no code on your site.
Either your robots.txt disallows that crawler, or the page didn't return 200 for it (a firewall or Cloudflare challenge in the way). The check is homepage-scoped.
Yes. It runs on our own crawler — no third-party vendor and no cost.
Block Googlebot and you fall out of Search — no crawl, no index, no ranking.
AdsBot blocked means Google can't review your landing page, so the ad gets disapproved.
Block GPTBot / Google-Extended / PerplexityBot and AI assistants can't quote or recommend you.
withConflux clients monitor crawler & robots access in-app — alerts when a bot gets blocked, plus the full Gateway Toolkit behind one key.