Website Intelligence
GeoScript crawls a client's public website, extracts a structured content evidence base, and builds the Content Genome that powers every recommendation.
Why the website is the foundation
AI engines do not recommend businesses at random. They recommend businesses whose content they can understand, verify, and trust. The quality of a client's website — its structured data, its service descriptions, its geographic specificity, its FAQ coverage — determines whether AI engines can confidently cite it. GeoScript's website intelligence layer exists to make that quality measurable and improvable.
The crawl: how GeoScript reads a site
GeoScript's static HTTP crawler fetches and snapshots a client's public website. Every crawl is governed by SSRF hardening and politeness rules — GeoScript does not hammer servers, does not follow robots.txt-excluded paths, and does not access non-public content. Each snapshot is content-hash deterministic: if a page hasn't changed, the snapshot doesn't change either. This makes it possible to track exactly when site content changes and what effect those changes have on downstream recommendations.
The Content Genome: structured evidence from every page
The Content Genome is GeoScript's structured representation of a client's site. It extracts typed content blocks — service descriptions, location signals, schema markup, FAQ items, headings, and meta content — from every crawled page into a stable, typed data structure. This extraction is deterministic: the same page produces the same genome representation on each run. The genome is what the Optimization Engine reasons over to produce recommendations.
How this connects to what comes before and after
Website Intelligence activates once a client seat is established. The crawl feeds the Content Genome, which feeds the Optimization Engine. Improvements recommended by the engine, approved by the agency, and deployed via Standard Script come back through this layer — after deployment, GeoScript re-crawls the site to verify changes landed as intended. The loop is: crawl → understand → recommend → deploy → verify → re-crawl.
What Website Intelligence is not
Explicit limitations (§127)
- ✕GeoScript does not crawl non-public content — only pages accessible to any visitor without authentication.
- ✕GeoScript does not claim to know how search engines or AI systems internally index or weight a client's site.
- ✕GeoScript does not provide real-time website monitoring — crawls run on a schedule determined by seat configuration.
- ✕GeoScript does not modify a client's site directly through this layer — all changes go through the approval-gated deployment system.
Related
Continue through the loop
Website Intelligence is pillar 3 of 7.
Other pillars
Monitor how AI engines respond to the queries that matter for your clients — capturing mentions, recommendations, and citations across a prompt universe built around each business.
Find businesses with measurable AI visibility gaps, score each opportunity, track your pipeline, and deliver evidence-backed pitches — before a competitor does.
Understand which AI crawlers and agents are reaching a client's site, what they're doing, and why — with verified identity and declared purpose.
Turn Content Genome findings into specific, typed recommendations — then deploy them through an approval-gated, verifiable system that leaves an immutable record.
Immutable, period-scoped reports that capture AI visibility change, deployments made, and measured outcomes — shareable with clients and presentable under agency branding.
Every observation, recommendation, and outcome lives in a structured, tenant-isolated, immutable-where-it-matters data architecture — the evidence base the entire platform reasons over.