CSF is blocking googlebot

iko_1998

Registered
Jun 12, 2018
1
0
0
indonesia
cPanel Access Level
Website Owner
My website - Removed - cannot be crawl by Googlebot. The error message is "Network Unreachable" Then i disable CSF and the result on Google Sitemap is OK.

Please help, how to set my CSF not to block Googlebot.

Thanks.
 
Last edited by a moderator:

cPanelLauren

Product Owner II
Staff member
Nov 14, 2017
13,266
1,309
363
Houston
Hi @iko_1998

If this is occurring you may want to whitelist the IP's - Googlebot doesn't publish an official list of their IP addresses because they change over time but you can find them by running a google search for them: googlebot ips - Google Search