Jump to content

rs2k

Members
  • Content count

    221
  • Joined

  • Last visited

Everything posted by rs2k

  1. I'm now populating 47,000 items into my store. The first 10,000 process within a few minutes. After that is slows to a crawl. The last 10,000 takes longer than the first 30,000. I know this contribution is not designed for such a large store, but except for the speed it works very well. Here is my layman's take on it: I am not very good with php but my guess is that the script in easy populate does one SQL query per line. To speed up the process is it possible to store the SQL queries into a temp file or even the memory and then run at the queries at once?
  2. After deleting all the products in my test store I reuploaded them with different model numbers and the product ids as an extra field. After loading close to 27,000 items it seems to have worked just fine. I had a few item descriptions that ruined the csv format, but other than that the operation went smoothly. One question: When I try to upload all 27,000 products in one file at once the screen will stop refreshing but the process continues in the background. This is fine except when there is an error there is no way of knowing. Is it possible to have the errors write to log file? Also, I have very little trouble updating 27,000 products at a time, however, I cannot use the delete function with that many products. The only way I know to delete 27,000 items is to manually delete the top level categories one by one. It seems if I try to delete more than 1000 products at a time the browser does not update and I end up having to restart apache. Easy populate is working very well for me! I am nearly ready to add another 8000 products to our store. =)
  3. EP vers: 2.76g-MS2 osCommerce Online Merchant v2.2 RC1 OS: Linux 2.6.9-023stab046.2-enterprise HTTP: Apache/1.3.39 (Unix) PHP/5.2.5 mod_auth_passthrough/1.8 mod_bwlimited/1.4 mod_log_bytes/1.2 mod_gzip/1.3.26.1a FrontPage/5.0.2.2635 DAV/1.0.3 mod_ssl/2.8.30 OpenSSL/0.9.7a DB: MySQL 5.0.45-community PHP: 5.2.5 (Zend: 2.2.0) I love how simple it is to add extra fields with Easy Populate 2.76g-MS2! This contribution keeps getting better and better! I just want to know if I can add products_id to the extra fields. I need to change all of my model numbers in my DB but I need to keep the same product IDs. I was planing on downloading the product DB using a complete EP download, changing the model numbers, clearing the DB in the store, and then uploading everything with the new model numbers. I just didn't know if EP can change and auto incremental key field. btw: EP vers: 2.76g-MS2 is working great for my 27,000 product store on my VPS. Thanks!
  4. The only directories that are 777 are /images and /admin/backup all the rest are 755. Any other ideas?
  5. Why would having a 0777 directory change the way SEO works? Which directories could cause this problem? Thanks!
  6. It is acting like the USU entries in .htaccess aren't there at all. My host just told me that the entries in .htaccess look correct but that the server runs suPHP and rewrites may sometimes require special tweaking.
  7. Here are the apache errors I get while trying to use SEO: [Fri May 9 23:41:03 2008] [error] mod_gzip: EMPTY FILE [/tmp/_32510_253_154.wrk] in sendfile2 [Fri May 9 23:41:03 2008] [error] mod_gzip: Make sure all named directories exist and have the correct permissions. [Fri May 9 23:46:17 2008] [error] [client ~MY IP~] File does not exist: /usr/local/apache/htdocs/index.php [Fri May 9 23:46:22 2008] [error] [client ~MY IP~] File does not exist: /usr/local/apache/htdocs/index.php
  8. The configuration files are correct. There's only one way for them to work as far as I know. I spent my time changing everything I know to be host related.
  9. I just moved mt store to a new VPS host. Now my SEO doesn't work. The page comes up but when I click on a product or category the correct SEO URL shows up in the URL bar but all I get is a blank page. My SIDs are also not going away. I'm wondering if the problem is related.
  10. I had the same problem. It was caused by Ultimate SEOs. The fix was to Reset SEO URLs Cache.
  11. rs2k

    [Contribution] STS v4

    Hello, I have a new store using OSC 2.2 RC2a. The only modificiations right now are Easy populate and STSv4.5.8 for all osC 2.2 versions. After I installed and enabled STSv4.5.8 for all osC 2.2 versions the left colum is no longer lined up correctly. The store goes back to normal when STS is disabled. First I tried to copy the files from the RC2.2 directory of the zip file because I had a fresh install. When that didn't work I restored my backup and tried editing the files manually. I got the exact same problem. I am sure I did the install correctly. Everything works except for these exceptions: the left column is a different size then the right column, the header now has more space between the top of the browser and the logo, and the red warning text appears in the content part of the page instead of above the logo. The only shange to the sts template is a added "said Sadie!" after the default message. This problem existed before I did that. Please see these screen shots: OSC when STSv4.5.8 is enabled OSC when STSv4.5.8 is disabled
  12. OK, here we go again. ;) The "stopping at the exact bit" problem was caused by the shared ssl. The problem does not occur on all of my subdomains all of the time, though. For now, I will call this problem solved... Now onto the next problem: Here's some more info. I am using a brand new installation with 2.76g-MS2 as the ONLY change. My host has told me the only limitation I have for php is a 5 minute script allowance. Here are the settings: EP vers: 2.76g-MS2 osCommerce Online Merchant v2.2 RC2a OS: Linux 2.6.22-9_1.BHsmp HTTP: Apache/2.2.8 (Unix) mod_ssl/2.2.8 OpenSSL/0.9.8g DAV/2 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 DB: MySQL 5.0.45-community-log PHP: 5.2.5 (Zend: 2.2.0) Temp Directory: /home/kwdhomec/public_html/kdtest/temp/ Temp Dir is Writable Magic Quotes is: off register_globals is: on Split files on: 300 records Model Num Size: 12 Price with tax: false Calc Precision: 2 Replace quotes: false Field seperator: comma Excel safe output: true Preserve tab/cr/lf: false Category depth: 7 Enable attributes: true SEF Froogle URLS: false More Pics: false Unknown Pics: false HTC: false SPPC: false Extra Fields: false Uploads: I have about 23,000 items in this store and was able to upload about 10,000 lines at a time after I increased the PHP.ini memory_limit. This takes about 1 minute to do. None of the php.ini settings that have to do with time (like max_execution_time and max_input_time) seem to be able to increase that number. I have also tried enabling set_time_limit=330 in easypopulate.php. I am not complaining about this at all though. I realize that most people have to split the files at 300 lines. Downloads: I've been able to download up to 9.3 - 9.6 MBs of items file now without using the shared SSL while using "download on the fly" for a complete file. This gives me about 6000 out of 23000 products. The number varies, the time it takes varies, but the last line is always complete. When I choose a custom file with no options I can get all of my items in the download. When I choose to create a file in the temp directory as a complete file or create and then download as a complete file I get the 500 internal server error and the logs show the "Premature end of script headers: easypopulate.php" error. When I choose to create a file in the temp directory as a custom file with no options or create and then download as a custom file with no options. It works. I am able to download the file. In fact, I am able to download everything but the description. That seems to put it over the edge. It seems to me that the script is timing out and ending early because the file it is trying to create is too large, but there is nothing in the logs that says anything like that. Is there a way to split downloads like the uploads can be split? Thanks for all your help!
  13. I know for sure it's not a hosting problem now. I know it's confusing, but I hope you can follow my description as follows: Ok, I moved the kwdhasit store to a new subdomain (I'll call it STORE A ) and tried again. I got the exact same problems. I then moved the kwdhome store to a subdomain (STORE B ) and set it up for a shared SSL instead of the private SSL. It worked just fine. I tried using the DB from STORE B with STORE A and still got the errors on STORE A. I also tried the db from STORE A on STORE B and it worked just fine. This tells me that there is a scripting error somewhere in STORE A and kwdhasit. The only option I seem to have right now is compare each file 1 by 1 until I find the error. I can rule out the SQL databases, .htaccess, easypopulate.php, application_top.php, and both configuration.php files, as I have tried swapping these files already. Any other ideas? My guess is that there is a typo somewhere.
  14. can you eliminate a data problem by running this subdomain with the same source and the same data? - I will try. I will contact my host again. Are there any questions you can recommend that I can ask? I will post a link to the file, but I don;t think it will do any good. It always stops on the character that makes the file 149,567 bytes. It even takes different amounts of time to make the files. Here is a complete "on the fly file" here is a custom "on the fly file" with no options selected. Thanks.
  15. I should also mention that EP v2.76e works just fine on my test store on another sub domain. I upgraded to 2.76g last night and tried again. I get the exact same problem. Here are the new settings: EP vers: 2.76g-MS2 osCommerce Online Merchant v2.2 RC1 OS: Linux 2.6.22-9_1.BHsmp HTTP: Apache/2.2.8 (Unix) mod_ssl/2.2.8 OpenSSL/0.9.8g DAV/2 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 DB: MySQL 5.0.45-community-log PHP: 5.2.5 (Zend: 2.2.0) Temp Directory: /home/kwdhomec/public_html/kwdhasit/temp/ Temp Dir is Writable Magic Quotes is: off register_globals is: off Split files on: 300 records Model Num Size: 30 Price with tax: false Calc Precision: 2 Replace quotes: false Field seperator: comma Excel safe output: true Preserve tab/cr/lf: false Category depth: 7 Enable attributes: true SEF Froogle URLS: false More Pics: false Unknown Pics: false HTC: false SPPC: false Extra Fields: false What causes a "Premature end of script headers:" error?
  16. Hello again, I have contacted my host and they have enlightened me to some more error logs: So that you don't have to look back here is my problem: When I try to download using EP create on the fly. I can only download 146KB of data but get no error logs. When I try to create in the temp dir I get a 500 internal server error and these log entries: [Thu Mar 27 22:43:23 2008] [error] [client 74.220.195.150] Premature end of script headers: easypopulate.php, referer: https://secure.hostmonster.com/~kwdhomec/kw...asypopulate.php [Thu Mar 27 22:43:23 2008] [error] [client 74.220.195.150] File does not exist: /home/kwdhomec/public_html/500.shtml, referer: https://secure.hostmonster.com/~kwdhomec/kw...asypopulate.php My host told me that this is a scripting error, there is nothing that is limiting my http downloads. Here is my information: PHP Version: 5.2.5 (Zend: 2.2.0) PHP Settings: max_execution_time = 300 ; Maximum execution time of each script, in seconds max_input_time = 600 ; Maximum amount of time each script may spend parsing request data memory_limit = 200M ; Maximum amount of memory a script may consume (32MB) Server OS: Linux 2.6.22-9_1.BHsmp HTTP Server: Apache/2.2.6 (Unix) mod_ssl/2.2.6 OpenSSL/0.9.8g DAV/2 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 EP settings: EP vers: 2.76e Temp Dir: /home/kwdhomec/public_html/kwdhasit/temp/ Temp Dir is Writable Magic Quotes is: off register_globals is: off Split files on: 30000 records Model Num Size: 30 Price with tax: false Calc Precision: 2 Replace quotes: false Field seperator: comma Excel safe output: true Preserve tab/cr/lf: false Category depth: 7 Enable attributes: true SEF Froogle URLS: false More Pics: false Unknown Pics: false HTC: true SPPC: false Extra Fields: false Thanks!
  17. I made a slight error in my post. I actually have EP v 2.76e. I did not have a "how to ask for help" section in my read me file. I downloaded 2.76f and found the "how to ask for help" section. Here is more information for you: PHP Version: 5.2.5 (Zend: 2.2.0) PHP Settings: max_execution_time = 300 ; Maximum execution time of each script, in seconds max_input_time = 600 ; Maximum amount of time each script may spend parsing request data memory_limit = 200M ; Maximum amount of memory a script may consume (32MB) Server OS: Linux 2.6.22-9_1.BHsmp HTTP Server: Apache/2.2.6 (Unix) mod_ssl/2.2.6 OpenSSL/0.9.8g DAV/2 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 EP settings: EP vers: 2.76e Temp Dir: /home/kwdhomec/public_html/kwdhasit/temp/ Temp Dir is Writable Magic Quotes is: off register_globals is: off Split files on: 30000 records Model Num Size: 30 Price with tax: false Calc Precision: 2 Replace quotes: false Field seperator: comma Excel safe output: true Preserve tab/cr/lf: false Category depth: 7 Enable attributes: true SEF Froogle URLS: false More Pics: false Unknown Pics: false HTC: true SPPC: false Extra Fields: false ======================================================================= Download on the fly: No errors. just can only download 146 KB (149,567 bytes), no matter what options I choose to download. The log entry goes to kwdhome.com, not kwdhasit.kwdhome.com kwdhome.com Access log show: Please note, I modified the IP and date information: HOST.MONSTER.IP - MY.USER.NAME [DATE.OF.OCCURRENCE:TIME.OF.OCCURRENCE -TIME.ZONE] "GET /~kwdhomec/kwdhasit/admin/easypopulate.php HTTP/1.0" 200 63909 "https://secure.hostmonster.com/~kwdhomec/kwdhasit/admin/categories.php?selected_box=catalog" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12" ======================================================================= Create then download: Internal Server Error 500: The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator, webmaster@kwdhome.com and inform them of the time the error occurred, and anything you might have done that may have caused the error. More information about this error may be available in the server error log. Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request. Apache/2.2.6 (Unix) mod_ssl/2.2.6 OpenSSL/0.9.8g DAV/2 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 Server at 74.220.222.244 Port 443 The log entry goes to kwdhome.com, not kwdhasit.kwdhome.com kwdhome.com Access log show: Please note, I modified the IP and date information: HOST.MONSTER.IP - - [DATE.OF.OCCURRENCE:TIME.OF.OCCURRENCE-TIME ZONE] "GET /~kwdhomec/kwdhasit/admin/easypopulate.php?download=stream&dltype=custom&epcust_category_filter=&epcust_manufacturer_filter=&epcust_status_filter=&submit=Build+File HTTP/1.0" 404 2605 "https://secure.hostmonster.com/~kwdhomec/kwdhasit/admin/easypopulate.php" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12" ======================================================================= Create in Temp Dir: Internal Server Error 500: The server encountered an internal error or misconfiguration and was unable to complete your request. Please contact the server administrator, webmaster@kwdhome.com and inform them of the time the error occurred, and anything you might have done that may have caused the error. More information about this error may be available in the server error log. Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request. Apache/2.2.6 (Unix) mod_ssl/2.2.6 OpenSSL/0.9.8g DAV/2 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 Server at 74.220.222.244 Port 443 The log entry goes to kwdhome.com, not kwdhasit.kwdhome.com kwdhome.com Access log show: Please note, I modified the IP and date information: HOST.MONSTER.IP - - [DATE.OF.OCCURRENCE:TIME.OF.OCCURRENCE-TIME ZONE] "GET /~kwdhomec/kwdhasit/admin/easypopulate.php?download=tempfile&dltype=custom&epcust_category_filter=&epcust_manufacturer_filter=&epcust_status_filter=&submit=Build+File HTTP/1.0" 404 2605 "https://secure.hostmonster.com/~kwdhomec/kwdhasit/admin/easypopulate.php" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12"
  18. I figured it out, some of my picture directories have ampersands in them.
  19. I can't figure what's going on here. For some reason the thumbnailer won't display the images in this category on my site: http://www.kwdhasit.com/watches-smith-wess...20_121_124.html I've been using this contribution for a few months now with no problems at all.
  20. readme.txt III. SUPPORT ------------------------------------------------- See the /docs/EasyPopulate_Manual.txt file for the support location. EasyPopulate_Manual.txt Remember that this was written by volunteers, if you have questions, post in the forums, don't email any of the authors involved, since they may not be supporting the script any longer! Lives change and people contribute and move on :) Before you ask a question in the support thread, please, please, read the entire docs AND at least the last 4-5 pages of the support thread. Then, search the the thread for your answer. If you don't understand what a setting is or does, please ask. Only after that, should you ask for help with an error or problem USING this contribution. If it isn't obvious you have exhausted all resources to find a solution, you may not get an answer. (please make a little effort) Support for this release is provided in this thread: http://forums.oscommerce.com/index.php?showtopic=162244 Am I missing something here? I have completed all of these steps listed in the code boxes above. I have read a lot more than the last 4-5 pages and have tried at least 20 different search strings. In fact, I was able to learn so much about easy populate while trying to fix it that I was able to modify it to add 5 other fields to my database. (Both the original code and my modified one have the same problem.) What other information would you like me to provide? I am happy to help you help me. Thanks.
  21. What does your DIR_FS_CATALOG in catalog/includes/configure.php read?
  22. I have uncommented the line and have also tried I tried setting it to 3300. MY server is not in PHP safe mode. I also tried changing the php.ini file to 3300. I also tried increasing the memory from 32M to 64M using php.ini. Besides, it only takes about 3 seconds to reach 149KB, not 330 seconds or even 3300 seconds. I also noticed that the error only occurs on my sub domain. For example, when I go to newstore.mysite.com/admin/easypopulate.php I can only download 149kb. When I go to mysite.com/easypopulate.php I can download at least 700K. I can probably do more than 700K but as it is a live store I can't test that theory.
  23. You want to get it straight from Google. The one in the OSCommerce Community Add-ons section is not complete for some reason. The file you want is "google-checkout-oscommerce-v1.4.5a.zip". Here is the page that you get it: http://code.google.com/p/google-checkout-oscommerce/ Here is the link directly from Google's site: http://google-checkout-oscommerce.googleco...rce-v1.4.5a.zip Don't forget to enter in your API callback URL into your Google account after you install Google checkout.
  24. I have been using EP 1.76f for a while now. Since I have added more products to my store I have found a problem. It seems the maximum file size I can download is 146 KB (149,567 bytes). It doesn't matter what options I choose. Every time I try to "download on the fly" I get a file that is 146 KB (149,567 bytes) in size. Any ideas? I get a 404 error if I try to create the file in the temp directory first.
  25. Check out the post a little ways up. Click here to go to Post 391. See if that might be the cause.
×