Jump to content
Sign in to follow this  
quicklyshop

Search engines eating my bandwidth

Recommended Posts

This month my site spent 30 Gb of bandwith and it is costing me fortune as it is caused by search engines. What can i do. I dont know anyway to stop this bandwidth destruction. Please help me.


I can't type a trick like i can type.

Share this post


Link to post
Share on other sites

Thank you. It really helped. I am going to disallow all search engines


I can't type a trick like i can type.

Share this post


Link to post
Share on other sites

That should ensure that nobody will ever find your site. :roll:

Share this post


Link to post
Share on other sites

I'm just curious, which search engines are eating 30G of bandwidth???? I have google, alexa, looksmart,etc and never had more than about 500K in a whole month and they are on my site almost daily....

Share this post


Link to post
Share on other sites

There the new Bot from Microsoft that seems to be quite aggressive.


"Use no way as way, have no limitation as limitation." - Bruce Lee

Share this post


Link to post
Share on other sites

No success. Using robots.txt and baning all search engines did not simply work

I am still under attack 65.214.36.117


I can't type a trick like i can type.

Share this post


Link to post
Share on other sites

65.214.36.117

1217 customers online. When i clicked on who is online. I ve been using oscommerce for about a year and this is getting worst everyday :cry:


I can't type a trick like i can type.

Share this post


Link to post
Share on other sites

You could always add a 'deny from xxx.xxx.xxx.xxx' in your .htaccess (if you use it), but i would take burts suggestion...and hit up ask jeeves.

 

On a side note...are you killing all SID's - I imagine that might be part of the problem, unique SID's are being assigned to ask, and therefore it thinks it keeps finding more unique content.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this  

×