Skip to main content

Crawler

About PillarScanBot

PillarScanBot is the crawler used by PillarScan to run website accessibility scans requested by website owners or by visitors using our free single-page scan.

How it behaves

  • User agent: Mozilla/5.0 (compatible; PillarScanBot/1.0; +https://pillarscan.com/bot)
  • Loads pages one at a time in a headless Chromium browser, like a single visitor, with a 25-second timeout per page.
  • Full-site scans are capped by the customer's plan (100, 500 or 2,000 pages) and run monthly or weekly.
  • Only public pages are loaded. We never submit forms, log in, or download documents.
  • Requests originate from Cloudflare's network.

Allow-listing

If your firewall or bot-management product blocks headless browsers, add an allow rule for the user agent string above. In Cloudflare WAF, create a custom rule: (http.user_agent contains "PillarScanBot") → Skip. In Imperva/Akamai/Sucuri, add the user agent to the bot allow list. A scan report marked partial means more than 20% of pages could not be loaded.

Opting out

To stop the free scan from ever loading your site, email support@pillarscan.com with the domain. Customer-requested scans of their own sites are controlled by the customer.