Usage Guide

This guide covers the core features of CrawlSage and how to integrate them into your daily workflow for maximum impact.

Full Audit

A Full Audit is the most comprehensive scan CrawlSage offers. It crawls every discoverable page on your domain to build a complete map of your site's health.

• Crawling: We follow internal links to find every page.
• Validation: We check status codes (200, 404, 500, etc.) for every asset.
• SEO Analysis: We evaluate H1s, meta titles, descriptions, and canonical tags.

Quick Scan

Need results fast? The Quick Scan audits your top 50 most important pages (based on traffic or sitemap priority). It's perfect for a daily check-up or after a small deployment.

Security Scan

Our security engine checks for common web vulnerabilities, including:

• Missing security headers (CSP, HSTS, X-Frame-Options).
• Exposed sensitive files (e.g., .env, .git).
• Outdated software versions in detected CMS.

Reading audit results

Results are categorized into three levels of severity:

1. Critical: Issues that prevent indexing or pose immediate security risks. Fix these first.
2. Warning: Issues that impact rankings or user experience but don't break the site.
3. Notice: Minor optimizations or best practices.

Fixing and rescanning

Once you've implemented a fix, you don't need to wait for a scheduled scan. Go to the issue details and click "Validate Fix". CrawlSage will immediately re-crawl the affected page and update the status.

Best practices

• Schedule Weekly Audits: Keep a baseline of your site health.
• Use Annotations: Mark when you've made significant changes (like a site migration) to see the impact in your health score over time.
• Integrate with Slack: Get notified the moment a Critical issue is detected.