Agent Traffic
AI crawler and agent visits to a client's website, classified by identity and purpose. Also an upcoming GeoScript capability.
Definition
Agent traffic refers to the HTTP requests made to a website by AI crawlers, bots, and agents on behalf of AI companies — including OpenAI's GPTBot, Anthropic's ClaudeBot, Perplexity's bot, and other systems. These requests can serve different purposes: training data collection, real-time content retrieval for answer grounding, or autonomous agent tasks. The category also includes self-identified agents that declare they are acting on behalf of a user to complete a task (as opposed to passive crawlers).
In the GeoScript platform, Agent Traffic is a planned capability that will provide server- or CDN-level visibility into which AI agents and crawlers are reaching a client's site, with verified identity checks and purpose classification.
Why it matters
Knowing which AI agents visit a site — and why — is foundational to understanding AI visibility. A business can only be cited by an AI engine that has recently read its content. If AI crawlers are blocked, rate-limited, or unable to read key pages, the business is invisible regardless of content quality. Agent Traffic data also reveals new patterns: autonomous agents completing tasks on behalf of users, not just passive crawlers building indexes.
Example
A client's site receives 2,000 daily visits from traditional browsers but only 12 from verified AI crawlers. Of those 12, all are training crawlers — no retrieval crawlers. This suggests the business is likely not being read for live AI answers, which is consistent with their low recommendation rate. Installing infrastructure to observe and verify these signals is what the Agent Traffic capability aims to provide.
How it differs from related terms
Agent Traffic is the observation layer — what visits a site. AI citation is an output of the AI engine process, not directly observable from the site side. An AI crawler visit (agent traffic signal) does not guarantee a citation; AI engines select what to cite from what they read. AI crawler is the specific type of bot; Agent Traffic is the broader category including autonomous task-completing agents.
Further reading
- DocsGeoScript Docs
Agent Traffic is a planned GeoScript capability (status: PLANNED, not yet built). It depends on the Advanced Edge adapter, which is also planned and not yet available. No Agent Traffic feature page exists yet.
Related terms
A bot operated by an AI company to fetch, index, or retrieve web content for use in training or live answer generation.
AI CitationA named reference to a specific business, brand, or source within an AI engine's generated response.
AI VisibilityWhether and how prominently a business appears in AI engine responses to relevant queries.