Jump to content
  • Checkout
  • Login
  • Get in touch

osCommerce

The e-commerce.

Are Bing and MSN bot retarded?


mhsuffolk

Recommended Posts

I have had an OSC shop since 2009, before that I had a simple frames based shop. The have all been under the same domain.

 

Both Bing and MSN bots still look for pages from the original frame based shop and also the OSC thumb images from my previous 2.2RC2a shop.

 

They still keep looking for these on my new 2.3.3.4 shop.

 

Are they retarded?

Live shop Phoenix 1.0.8.4 on PHP 7.4 Working my way up the versions.

Link to comment
Share on other sites

You need to make sure your server serves up a correct http error message for missing files, which in return will lead to Binga and Google dropping those urls over time.

Link to comment
Share on other sites

If your shop (SEO or not) is merely redirecting missing pages to the storefront, with a 200 code, the search engines will never realize the link is invalid. In the process, you may be getting dinged for duplicate content. If I understand it correctly, you need to send back a 404 code for those URIs (or better yet, a 301 if there is a replacement page) so the search engines will realize that the requested content is gone.

Link to comment
Share on other sites

There is no direct replacement page so the server replies with a 404 not found every time, that's why I think they are retarded. On checking their IPs they appear to be genunine as opposed to a hacker masquerading. The 2.3.3.4 site went live in January 2014, should they have learnt by now?

Live shop Phoenix 1.0.8.4 on PHP 7.4 Working my way up the versions.

Link to comment
Share on other sites

Thank you for you replies @@MrPhil. I have solved the problem.

 

I have this addon by @@FIMBLE http://addons.oscommerce.com/info/5914 Security Trap

 

It lists the http errors including 404s in a module within admin It also puts a redirect in htaccess thus

 

ErrorDocument 400 /catalog/Error.php?Error=400
ErrorDocument 401 /catalog/Error.php?Error=401
ErrorDocument 403 /catalog/Error.php?Error=403
ErrorDocument 404 /catalog/Error.php?Error=404
ErrorDocument 405 /catalog/Error.php?Error=405
ErrorDocument 408 /catalog/Error.php?Error=408
ErrorDocument 415 /catalog/Error.php?Error=415
ErrorDocument 416 /catalog/Error.php?Error=416
ErrorDocument 417 /catalog/Error.php?Error=417
ErrorDocument 500 /catalog/Error.php?Error=500
ErrorDocument 501 /catalog/Error.php?Error=501
ErrorDocument 502 /catalog/Error.php?Error=502
ErrorDocument 503 /catalog/Error.php?Error=503
ErrorDocument 504 /catalog/Error.php?Error=504
ErrorDocument 505 /catalog/Error.php?Error=505

 

On inspecting my raw logs I found what should have been 404s were 302s

 

I contacted my host who investigated and decided the htaccess code was the issue. They commented out the 404 line and all is now well but the 404 errors no longer appear in Security trap, I can live with that.

Live shop Phoenix 1.0.8.4 on PHP 7.4 Working my way up the versions.

Link to comment
Share on other sites

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...