Using the dashboard
Bots and crawlers
AI crawler tracking shows which crawlers fetch your pages without JavaScript. Stickybeak reports them separately from script-running bot traffic.
Bots that run the tracker
User agents, browser signals, network type and Cloudflare's verified-bot list identify them. They never count in visitors, sessions, goals, revenue or live numbers.
| View | Shows |
|---|---|
| Wall | 🤖 bots from the last 30 minutes |
| Site page | Bots filtered total and a labelled bot list |
Track AI bots and crawlers
This Cloudflare request data includes crawlers that never run JavaScript. Read the AI crawler guide for the wider context. The panel appears only for domains on Stickybeak's Cloudflare account.
| Category | Includes |
|---|---|
| AI answers / training / other AI | User-triggered fetchers, model crawlers and other AI bots |
| Search / SEO | Search indexes and SEO tools |
| Social / monitoring | Link previews and uptime or performance checks |
| Automation / scripts / other | Headless browsers, HTTP clients and remaining bots |
The table shows requests and top four paths per bot. Assets are excluded, while robots.txt, sitemaps and llms.txt remain.
Data updates hourly through the latest settled full hour and backfills 30 days when first connected.