Awstats robots reports

[Patrickintheforest]

In my robots.txt file I have denied Yandexbot
Under robots spider visitors, hits, I see for example
Yandexbot 0/2
Does this mean that the bot tried twice but was blocked.
If so I know my Yandexbot deny has worked
Patrick

 

[cPanelMichael]

Hello @Patrickintheforest,

The access attempt itself from the bot/crawler is still logged, and that's what Awstats is showing you. Note the robots.txt file won't technically prevent a crawler/bot from accessing your website files. There's some useful information on this topic at:

Block bots by specific urls with robots.txt in php apache environment

If you have root access to the server, it's sometimes a better idea to block the bot in your firewall rules. There's a thread on this topic at:

SOLVED - Blocking bad bots

Thank you.

 

[Patrickintheforest]

Thank you cpanelmichael.
My bandwidth has been drastically reduced since the deny.