Can someone please explain this to me.
So I downloaded this and put the spider.txt file in catalogue/includes folder.
But upon reading the readme.txt file I found this to be somewhat confusing.
"For example, "ebot" matches Googlebot, "nbot" matches msnbot."
What does this mean?
Does this mean that because I have "ebot" in spider.txt file googlebot will not index my site on their search engine?
Or is the "Googlebot" a harmful robot that just takes my bandwidth and its not from the company Google?
Please someone explain this to me, I just wanted yandex.ru off my site because they were always there...