Documentation Menu↓
Installation
Get CrawlSage set up on your project in just a few steps. We've designed the onboarding process to be as frictionless as possible.
Requirements
Before you begin, ensure you have the following:
- A CrawlSage account (you can sign up at app.crawlsage.com).
- Access to the website you want to audit (admin access is preferred but not required for basic audits).
- A modern web browser (Chrome, Firefox, Safari, or Edge).
1. Create your account
Visit our application portal and sign up with your email. You'll receive a verification link to activate your account. Once verified, you can start using your free daily credits immediately.
2. Configure your project
After logging in, click "New Project". You'll be prompted to enter your website's primary URL. CrawlSage will perform a quick pre-scan to detect your site's structure and CMS (WordPress, Next.js, etc.).
Pro Tip:
If you have a large site (10,000+ pages), we recommend starting with a Quick Scan to get immediate results while the full audit runs in the background.
3. Run your first audit
Select "Start Audit". You can choose from three audit modes:
- Technical SEO: Focuses on crawlability, indexing, and meta data.
- Performance: Analyzes Core Web Vitals and load speeds.
- Security: Checks for common vulnerabilities and SSL issues.
Troubleshooting
If CrawlSage is unable to reach your site, check the following:
- Robots.txt: Ensure your
robots.txtfile isn't blocking our crawler (User-Agent:CrawlSageBot). - Firewall: If you use a WAF (Cloudflare, Sucuri), you may need to whitelist our IP range.
- SSL: Ensure your SSL certificate is valid and not expired.