4 replies to this topic

[egorig]

Hi everybody,

I'm wondering if osCommerce search engine is even possible to handle 5 millions of products.

I've made lots of modification on the search engine to make it handle 0.6 million of products. The server is acting good, but I'm not sure it will handle that much products. Are there any optimizations already created ? What can I do if I want my store to be able to easily handle that much products ?

May be any paid eCommerce catalogs ?
I haven't played with osCommerce 3 Alpha. Do you think it will be better ?
Any opinions are welcomed

Thanks to everyone.

[andy_1984]

egorig, on 16 December 2010, 18:46, said:

Hi everybody,

I'm wondering if osCommerce search engine is even possible to handle 5 millions of products.

I've made lots of modification on the search engine to make it handle 0.6 million of products. The server is acting good, but I'm not sure it will handle that much products. Are there any optimizations already created ? What can I do if I want my store to be able to easily handle that much products ?

May be any paid eCommerce catalogs ?
I haven't played with osCommerce 3 Alpha. Do you think it will be better ?
Any opinions are welcomed

Thanks to everyone.

i dont know if any ecommerce solution would cope with 5 million products all displayed at the same time (if thats what you mean) but with limits on the amount of results returned from mysql and pagination i dont think it would be much of an issue ?

[egorig]

andy_1984, on 17 December 2010, 19:58, said:

i dont know if any ecommerce solution would cope with 5 million products all displayed at the same time (if thats what you mean) but with limits on the amount of results returned from mysql and pagination i dont think it would be much of an issue ?

I'm not talking about displaying 5 million products at the same time.

This is the SQL query from a default osCommerce 2.3.1 :
select distinct p.products_image, m.manufacturers_id, p.products_id, pd.products_name, p.products_price, p.products_tax_class_id, IF(s.status, s.specials_new_products_price, NULL) as specials_new_products_price, IF(s.status, s.specials_new_products_price, p.products_price) as final_price from ziwico_conz.products p left join manufacturers m using(manufacturers_id) left join specials s on p.products_id = s.products_id, ziwico_conz.products_description pd, categories c, ziwico_conz.products_to_categories p2c where p.products_status = '1' and p.products_id = pd.products_id and pd.language_id = '1' and p.products_id = p2c.products_id and p2c.categories_id = c.categories_id and ((pd.products_name like '%galaxy%' or p.products_model like '%galaxy%' or m.manufacturers_name like '%galaxy%' or pd.products_description like '%galaxy%') ) order by pd.products_name

This query takes 30-40 seconds to complete (with 500,000 products). Imagine how long it will execute with 5,000,000 products in the database. How about if there are 20 customers online ? The server will crash immediately.

I don't think the default oscommerce can handle 5 million of products. There has to be modified ecommerces (even not free).
I have seen many ecommerce sites with more than 5 million products and the search is extremely fast.

[kymation]

I doubt that any of the big sites are trying to use SQL search on their database. They're most likely using a real search engine. With that many products I would probably be using Google to search, either through their site search API or the search appliance.

Regards
Jim

[andy_1984]

i understand what you mean now. any website would have problems with that i believe. it all depends on the server really doesn't it ?