Jump to content



Latest News: (loading..)

gaspower

Member Since 14 Aug 2003
OFFLINE Last Active Feb 18 2013 04:13 PM
-----

Posts I've Made

In Topic: Stop Msn.bot indexing Site

18 February 2013 - 04:15 PM

Hello,

Got it,

User-agent: msnbot
Crawl-delay: 20
Request-rate: 1/2
Visit-time: 0300-0900


Thanks JR

In Topic: Stop Msn.bot indexing Site

14 February 2013 - 04:03 PM

Hello,
I was able to understand. I created a file called http://www.domain.com/robots.txt with below content,

Crawl-delay: 2
Request-rate: 1/2
Visit-time: 0300-0900

I set permissions to 644, correct?

Thanks JR

In Topic: Stop Msn.bot indexing Site

13 February 2013 - 07:48 PM

Hello,

I should of asked. Do I need to use the robot addon contribution?

JR

In Topic: Stop Msn.bot indexing Site

12 February 2013 - 09:32 PM

Thank you very much.

In Topic: Automatically send data feed to Froogle

02 December 2012 - 03:45 PM

Hello,

Thank you very much, that worked.