Jump to content
  • Checkout
  • Login
  • Get in touch

osCommerce

The e-commerce.

robots.txt


jswan

Recommended Posts

Hi:

 

Any reason to not exclude robots from my admin, images, includes, and download folders? I am just learning about this file, so any suggestions would be most welcome.

 

Thanks,

 

Jason

Link to comment
Share on other sites

nope, no reasons.

Just exclude them spiders from everything except your catalog!

 

It might be a good idea to use the robot metatags as well:

if ($request_type == 'SSL') {

 echo '<meta name="Robots" Content="NoIndex, Follow">' . "n";

} else {

 echo '<meta name="Robots" Content="Index,Follow">' . "n";

}

Just put this somewhere in the header of each page. Or, if you've installed Linda's metatag controller, in includes/header_tags.php.

 

M@rcel

Greetings from Marcel

|Current version|Documentation|Contributions|

Link to comment
Share on other sites

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...