Crawler

Why are there already remove link rules applied to my site?

Mon, 17 Nov, 2025 at 9:01 PM

Update to the robots.txt parser

Mon, 11 Apr, 2022 at 10:56 AM

Why are broken links highlighted in relation to the "longdesc" tag?

Mon, 14 Feb, 2022 at 10:05 AM

What does "Pending site approval" mean?

Mon, 9 May, 2022 at 2:15 PM

Can Siteimprove scan a site built on our website framework?

Mon, 30 May, 2022 at 12:22 PM

The Siteimprove Crawler – Bot Information

Wed, 4 Dec, 2024 at 6:24 PM

Dynamic Content

Tue, 17 Feb, 2026 at 9:31 PM

Using VPN Connect with Siteimprove

Wed, 26 Nov, 2025 at 9:18 PM

Crawl Errors: Excluded URLs, Redirects, and HTTP 400 Issues

Fri, 24 Apr, 2026 at 9:44 PM

Crawl Errors: Index URL blocked by exclude or remove rules

Fri, 24 Apr, 2026 at 9:44 PM