Documentation Menu↓
Introduction to CrawlSage AI Engine
How our models convert technical SEO logs to direct tag edits.
Overview
The CrawlSage AI Engine is the core reasoning layer that transforms raw crawler data into production-ready code patches. Rather than generating generic SEO advice, it analyzes the specific HTML structure and metadata of each page, then writes precise, context-aware corrections that can be deployed directly to your CMS.
AI Recommendations Workspace Panel
The AI optimization workspace showing the generated tag updates grid cards, confidence scores ratings, and the primary 'Apply Fix' deploy buttons.
How the AI Engine Works
The engine operates in a four-stage pipeline:
Parse
Crawler extracts HTML DOM structure
Classify
Issues scored by severity and type
Generate
AI writes context-aware HTML patches
Validate
Patches verified before deploy
What the AI Engine Generates
| Issue Type | AI Output |
|---|---|
| Missing Meta Title | Generates SEO-optimised title under 60 characters using page content context |
| Missing Meta Description | Writes compelling description under 160 characters with primary keyword placement |
| Missing Schema Markup | Produces JSON-LD structured data blocks (Article, Product, FAQ, BreadcrumbList) |
| Duplicate Titles | Suggests unique titles for each duplicate page based on its content signals |
| Missing Canonical Tag | Generates correct canonical URL pointing to the preferred version of the page |
Context-Aware Generation
The AI Engine reads the visible page content, heading structure, and existing meta tags before generating suggestions. This ensures recommendations are page-specific, not generic templates.
Confidence Scores
Every AI recommendation includes a confidence score (0–100%) indicating how certain the engine is about the suggestion. High-confidence fixes (above 85%) are typically safe to deploy immediately. Lower-confidence suggestions should be manually reviewed before deploying.
What the AI Engine Does Not Do
- It does not rewrite your page content or body copy.
- It does not modify JavaScript files or CSS stylesheets.
- It does not auto-deploy — every fix requires explicit user approval.
- It does not access or store your private database credentials.
Data Privacy