User-agent clarity
Automated monitoring requests identify as ProofCairnBot and include this policy page in the user-agent string. Trust-audit and screenshot checks also use ProofCairn-branded identification.
Responsible monitoring
ProofCairn monitors public business pages for competitor and peer intelligence briefs. We identify automated requests, respect robots.txt signals, rate-limit by domain, and honor reasonable requests from site owners.
Automated monitoring requests identify as ProofCairnBot and include this policy page in the user-agent string. Trust-audit and screenshot checks also use ProofCairn-branded identification.
Monitoring checks robots.txt before page and catalog fetches. If a policy disallows the path for ProofCairnBot or general crawlers, the system skips that URL instead of forcing extraction.
ProofCairn applies per-domain request limits and delay windows. The product is designed for business-readable change detection, not high-volume crawling.
If you own or operate a business and want ProofCairn to stop monitoring your domain, submit a request below and verify ownership with a DNS TXT record or a file under your/.well-known directory. Verified domains are added to our persisted opt-out list.
Verified exclusions and robots/rate-limit skips are logged internally with the URL, domain, source, and reason. This gives the operation a durable paper trail as monitoring scales.
Self-serve verification
Submit your domain and we will generate a verification token. Once you prove ownership with DNS or a well-known file, ProofCairn will automatically activate the opt-out before any future monitoring starts.
Prefer manual handling? Email hello@proofcairn.com.