What is Clearscopebot?

Clearscopebot is a web scraper used by Clearscope to retrieve publicly available content from websites. This powers many of our services ranging from Content Grade recommendations to Content Inventory. Clearscopebot is designed to be efficient, respectful, and compliant with industry standards, including adherence to robots.txt rules.

IP Addresses

Clearscopebot uses the following IP addresses for crawling:

• 35.212.41.100

• 35.212.43.110

• 35.212.80.198

• 35.212.21.16

• 35.212.6.64

To ensure uninterrupted access for Clearscopebot, we recommend allowing traffic from these IP addresses.

Allowing Clearscopebot with Cloudflare and Other Services

Many websites use services like Cloudflare, Akamai, or other security solutions that may block web crawlers. To ensure Clearscopebot can access your website, refer to documentation provided by the relevant service:

• Cloudflare

• Incapsula

• ModSecurity

• Sucuri

• Siteground

• Ionos

• Bluehost

• Hostgator

• Hostinger

• GoDaddy

• GreenGeeks

• Liquid Web

• InMotion

• A2 Hosting

Contact

For questions or issues related to Clearscopebot, please contact our support team at support@clearscope.io.