Cloudflare is a widely used content delivery network (CDN) and security platform that helps protect websites from malicious traffic. However, its security mechanisms can sometimes block legitimate services like Ahrefs, a popular SEO tool. To ensure Ahrefs can properly crawl and analyze a website, users need to whitelist its IP addresses in Cloudflare. This process prevents Cloudflare from blocking or serving captchas to Ahrefs bots.
Table of Contents
Why Whitelist Ahrefs IP Addresses?
Ahrefs relies on automated bots to crawl websites for data collection and SEO analysis. If Cloudflare mistakenly blocks these bots, Ahrefs may not be able to gather accurate information about a site’s backlinks, rankings, and other key metrics. Whitelisting Ahrefs IP addresses ensures uninterrupted access for Ahrefs crawlers.
How to Whitelist an IP Address in Cloudflare
Follow these steps to whitelist Ahrefs IP addresses in Cloudflare:
Step 1: Log into Cloudflare
Visit Cloudflare’s dashboard and log in with your credentials. Once logged in, select your domain to access its settings.
Step 2: Navigate to Security & WAF
On the left-hand menu, click on Security and then select WAF (Web Application Firewall). This section allows users to manage firewall rules and IP access lists for better control over incoming traffic.
Step 3: Create a New Firewall Rule
- Click on the Create Rule button.
- Give the rule a recognizable name (e.g., “Allow Ahrefs”).
- Under Field, choose IP Address.
- Under Operator, select is in.
- In the Value field, enter the list of Ahrefs IP addresses, which can be found on the official Ahrefs bot page.
- Under Action, select Allow to ensure Ahrefs crawlers are not blocked.
- Click Deploy to save the changes.
Step 4: Verify the Changes
To confirm that Ahrefs bots are no longer blocked, check Cloudflare’s firewall event logs. If Ahrefs requests were previously being blocked, they should now be allowed.
Step 5: Test Ahrefs Crawling
Visit Ahrefs and request a new site audit or backlink check to ensure their crawlers can access your website without issues. If problems persist, consider temporarily disabling Cloudflare’s security functions to diagnose the cause.
Common Issues and Troubleshooting
- Ahrefs remains blocked: Double-check that the IP addresses were entered correctly in Cloudflare’s firewall rules.
- Cloudflare managed rules interfering: Review Cloudflare’s Managed Challenge settings under Security & WAF and ensure Ahrefs bots are not flagged.
- Other security plugins: If additional security tools (such as Wordfence or Sucuri) are active, check their settings to make sure Ahrefs is not blocked at the application level.
Conclusion
Whitelisting Ahrefs in Cloudflare is a straightforward process that ensures uninterrupted SEO analysis without compromising website security. By following the steps outlined above, users can maintain optimal protection while allowing trusted bots to access their site. Regularly review Cloudflare’s security logs and Ahrefs performance to ensure smooth operation.
FAQs
1. Where can I find Ahrefs’ official IP addresses?
Ahrefs publishes its bot IP addresses on its official page. Always check this page for updates to ensure accurate whitelisting.
2. Will whitelisting an IP compromise security?
No, whitelisting only allows trusted IPs to bypass Cloudflare’s security checks. As long as the IPs belong to Ahrefs, security remains intact.
3. How long does it take for Cloudflare to apply changes?
Changes to firewall rules are applied immediately. However, if Ahrefs was previously blocked, it may take some time before their services reflect the updates.
4. Can I temporarily disable Cloudflare to test Ahrefs access?
Yes, users can pause Cloudflare under the “Overview” tab in the dashboard. However, this is not recommended unless troubleshooting persistent issues.
5. Does whitelisting Ahrefs prevent all bot-related issues?
While whitelisting resolves access problems with Ahrefs, it does not affect other bots. Users should still monitor site traffic for unwanted bot activity.