Help center
Audit & track

AI crawler visits: is AI actually reading the site?

Check that AI crawlers really visit the pages — the precondition for any citation.

3 min read

Allowing AI crawlers in robots.txt doesn’t mean they’ll come. Google Analytics can’t tell you: crawlers don’t run JavaScript. This screen measures it.

Three ways to measure

1
The beacon (recommended)

One line to paste into the head of the client’s site. It only reacts to AI crawlers, with no cookies or personal data.

2
Cloudflare

If the site runs through Cloudflare, connect a read-only token: it’s the most complete source, since it sees requests before they reach the site.

3
A server log

Upload an Apache/Nginx (“combined”) log or a CDN JSON export for a one-off analysis.

What you’ll see

Which crawlers came, how often, to which pages — and above all, the ones that are allowed but never came. The door is open and they don’t come in: without visits, no citation is possible.