1 reply to this topic

[John W]

Hi Everyone,

This might be old news to some of you but this page has a list of the web robots http://www.robotstxt.org/wc/active/html/index.html. I'm not sure how up to date it is but it seemed kind of cool to me.

[karmagun]

Link changed to

http://www.robotstxt.org/wc/active.html