Insights/AI crawlers

See which AI crawlers read your site.

Before an assistant can name you, its crawler has to read you. Echo shows which AI crawlers and assistants visit your website, which pages they read, and which important pages they never reach.

Every AI crawler, by name

GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Applebot, Meta's and Amazon's crawlers and more: how often each one came, when it was last seen, and whether it trains a model, builds a search index or fetches a page for someone who just asked.

  • Visits per crawler over time
  • Live fetches show which pages people ask about
  • Crawlers your robots.txt turns away

The pages nobody reads

Echo compares the pages in your sitemap with the pages AI crawlers opened. An important page that no crawler has read in 30 days becomes an action: usually it's a missing link, a blocked path or a page that only loads with JavaScript.

  • Your most read pages, and by whom
  • Pages never read, from your sitemap
  • Actions close by themselves once the page is read

Connected in minutes

A few lines for your Cloudflare Worker, your Next.js middleware, Vercel, Netlify, Node or PHP, or an upload of your server's log file. Only visits from AI crawlers are reported. Your visitors are never recorded.

  • Never slows your site: the report is sent after the page
  • “Send test visit” checks the connection
  • Raw visits are kept for 90 days
  • Cloudflare WorkersReport visits from AI crawlers with a few lines.
  • Next.jsReport visits from AI crawlers from your middleware.
  • VercelReport visits from AI crawlers from an edge function.
  • NetlifyReport visits from AI crawlers from an edge function.

Questions, answered.

Does this track my visitors?

No. The snippet looks at the visitor's user agent and reports only known AI crawlers and assistants: the crawler's name, the page, the status and the time. Everything else is dropped before it's stored.

My site runs on Framer or Webflow. Does it work?

It works wherever you can run code in front of your site or get at its logs. For hosted builders without either, put Cloudflare in front of your domain and use the Worker snippet.

What's the difference to the AI score?

The AI score checks whether crawlers could read your page. AI crawlers shows whether they actually do.

Why aren't Googlebot and Google-Extended in the list?

Googlebot is Google's search crawler, and Search Console already shows its visits. Google-Extended and Applebot-Extended never visit: they're only names in robots.txt that say whether Google and Apple may train their models on your pages. Echo shows when your robots.txt turns them away.

Goes well with

  • AI score

    How ready your website is for AI, out of 100.

    More
  • AI visibility

    How often AI names you, and who it names instead.

    More
  • Actions

    What to change, build or fix this week, with proof.

    More

See it with your own brand. Setup takes about two minutes.