Jump to content
Chemo

[CONTRIBUTION] Google XML Sitemap Feed - by Chemo

Recommended Posts

Hi,

 

For people who have had good results from this contribution, have you noticed anything diferent about the new pages that Google has indexed?

 

I have submitted sitemaps for 2 osCommerce sites and it seems that for all the new pages, Google isn't indexing any meta content, page title, or infact anything from that page. It is following links on each page though, but again not indexing any of the content. When I do a site:www.mysite.com (with safesearch = off)seach from Google, it shows all the previously indexed pages with title, and description, but all the new pages are only listed as URL's.

 

Has anyone else had this or any diferent results?

 

Regards,

 

Fish

Share this post


Link to post
Share on other sites

I have a question for Bobby.

 

When I view the category site map, I notice the urls look like this: http://aphroditespleasurechest.com/catalog...ex.php?cPath=22

 

But with the cName contribution, the category path in OSC actually looks like this:

http://aphroditespleasurechest.com/catalog.../cName/lingerie

 

Now, I know how much search engines hate redirects, so do you think this will make a difference on how they are indexed?

 

The product urls would run into the same issue as well. (i.e. http://aphroditespleasurechest.com/catalog...roducts_id/2180 vs. http://aphroditespleasurechest.com/catalog...es-hats-gloves)


Stress is a luxury afforded to those of us that need it least.

Where lipstick is concerned, the important thing is not color, but to accept God's final word on where your lips end. --Jerry Seinfeld

If you pick up a starving dog, and make him prosperous, he will not bite you. This is the principal difference between a man and a dog. --Mark Twain

Share this post


Link to post
Share on other sites
I have a question for Bobby.

 

When I view the category site map, I notice the urls look like this:  http://aphroditespleasurechest.com/catalog...ex.php?cPath=22

 

But with the cName contribution, the category path in OSC actually looks like this:

http://aphroditespleasurechest.com/catalog.../cName/lingerie

 

Now, I know how much search engines hate redirects, so do you think this will make a difference on how they are indexed?

 

The product urls would run into the same issue as well.  (i.e. http://aphroditespleasurechest.com/catalog...roducts_id/2180 vs. http://aphroditespleasurechest.com/catalog...es-hats-gloves)

Errr, forgive my short-term memory. :blush: I will see if I can reach you another way.


Stress is a luxury afforded to those of us that need it least.

Where lipstick is concerned, the important thing is not color, but to accept God's final word on where your lips end. --Jerry Seinfeld

If you pick up a starving dog, and make him prosperous, he will not bite you. This is the principal difference between a man and a dog. --Mark Twain

Share this post


Link to post
Share on other sites

hi all seems to work for me except the cron job

 

i get a report email saying

 

Warning: main(includes/configure.php): failed to open stream: No such file or directory in /xxxx/xxxxx/xxxxx/ucsuk.com/httpdocs/googlesitemap/index.php on line 38

 

Fatal error: main(): Failed opening required 'includes/configure.php' (include_path='.:/usr/share/php') in /xxxx/xxxxx/xxxxx/ucsuk.com/httpdocs/googlesitemap/index.php on line 38

 

any ideas

 

it works fine if i do it from web browser

 

Regards Andy

Share this post


Link to post
Share on other sites

Hey Bobby,

 

I have to say "THANKS!!" for the great contribution. I don't know what I would do without all of you guys.

 

The sitemap works great. Everything works great!

 

Only one question... What is the <priority> function? Not sure what that means. But, anytime a page of mine gets a priority of 0.1 I get a bit nervous. :rolleyes:

 

Another thing. Why are people worried about whether or not you can use this service for commercial websites, when Google has this to say:

 

10. Can I use Google Sitemaps to submit URLs for my commercial websites?

 

Yes, the Google Sitemaps program would like to know about all the URLs you would like included in the Google index, including your commercial websites.

Just saw that in the Google Sitemaps FAQ.

 

Feedback on the <priority question is greatly appreciated.

 

Thank you again Bobby for everything you do!

Share this post


Link to post
Share on other sites

I had no problems setting up this contribution but I have my own server running and do not have c-panel. I did however set up the crontab through my vi editor. How will I recieve an e-mail to send the info to google. or how will i send the info to google. I am new to alot of things so I don't undrstand alot of things.

Share this post


Link to post
Share on other sites

Hi,

I have a small problem.

I have uploaded all files as directed, but I was gettin an error.

I had to add "googlesitemap" before all three xml files to work fine.

now my 3 dummy xml files are named as below:

 

googlesitemapsitemapindex.xml

googlesitemapsitemapproducts.xml

googlesitemapsitemapcategories.xml

 

and everything works just fine!!!!

 

Can any one help me to correct this problem.

here is the error that I was receiving:

 

Warning: ?fopen(/home/bargai74/public_html/shop/googlesitemapsitemapproducts.xml): failed to open stream: Permission denied in /home/bargai74/public_html/shop/googlesitemap/sitemap.class.php on line 291
ERROR: Google Product Sitemap Generation FAILED!


Warning: ?fopen(/home/bargai74/public_html/shop/googlesitemapsitemapcategories.xml): failed to open stream: Permission denied in /home/bargai74/public_html/shop/googlesitemap/sitemap.class.php on line 291
ERROR: Google Category Sitemap Generation FAILED!


Warning: ?fopen(/home/bargai74/public_html/shop/googlesitemapsitemapindex.xml): failed to open stream: Permission denied in /home/bargai74/public_html/shop/googlesitemap/sitemap.class.php on line 291
ERROR: Google Sitemap Index Generation FAILED!

Array
(
? ?[QUERY] => Array
? ? ? ?(
? ? ? ? ? ?[PRODUCTS] => Array
? ? ? ? ? ? ? ?(
? ? ? ? ? ? ? ? ? ?[STATUS] => success
? ? ? ? ? ? ? ? ? ?[NUM_ROWS] => 63
? ? ? ? ? ? ? ?)

? ? ? ? ? ?[CATEOGRY] => Array
? ? ? ? ? ? ? ?(
? ? ? ? ? ? ? ? ? ?[STATUS] => success
? ? ? ? ? ? ? ? ? ?[NUM_ROWS] => 19
? ? ? ? ? ? ? ?)

? ? ? ?)

? ?[SAVE_FILE_XML] => Array
? ? ? ?(
? ? ? ? ? ?[0] => Array
? ? ? ? ? ? ? ?(
? ? ? ? ? ? ? ? ? ?[file] => /home/bargai74/public_html/shop/googlesitemapsitemapproducts.xml
? ? ? ? ? ? ? ? ? ?[status] => failure
? ? ? ? ? ? ? ? ? ?[file_exists] => false
? ? ? ? ? ? ? ?)

? ? ? ? ? ?[1] => Array
? ? ? ? ? ? ? ?(
? ? ? ? ? ? ? ? ? ?[file] => /home/bargai74/public_html/shop/googlesitemapsitemapcategories.xml
? ? ? ? ? ? ? ? ? ?[status] => failure
? ? ? ? ? ? ? ? ? ?[file_exists] => false
? ? ? ? ? ? ? ?)

? ? ? ? ? ?[2] => Array
? ? ? ? ? ? ? ?(
? ? ? ? ? ? ? ? ? ?[file] => /home/bargai74/public_html/shop/googlesitemapsitemapindex.xml
? ? ? ? ? ? ? ? ? ?[status] => failure
? ? ? ? ? ? ? ? ? ?[file_exists] => false
? ? ? ? ? ? ? ?)

? ? ? ?)

)

 

Thank you

Edited by omidhz

Regards,

Share this post


Link to post
Share on other sites

Hi,

With the above problem, I have submitted the googlesitemap/index.php to google, but Google shows the following error:

 

Parsing error

 

We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting.

 

Is there anyone who could help me with this?

 

Thanks


Regards,

Share this post


Link to post
Share on other sites

I would like to install this contribution but Oscommerce is only one part of my site.

I have XOOPS installed in the root with Oscommerce in the root/catalog folder the xoops part of the site links to the store via tabbed buttons, so my site gets spidered fine. If I install this contribution will my xoops part of my site no longer get spidered correctly? or is there a way I can add my xoops data to the xml output files?

 

Any help would be much apperciated :thumbsup:

Share this post


Link to post
Share on other sites

Very nice contribution. I downloaded the latest copy and found few issues. I fixed them as below

 

 

index.php

 

define('DIR_WS_CATALOG', DIR_WS_HTTP_CATALOG);

 

require_once('includes/configure.php');

 

 

reversed

 

require_once('includes/configure.php');

 

define('DIR_WS_CATALOG', DIR_WS_HTTP_CATALOG);

 

 

--------------------

sitemap.class.php

 

$this->savepath = DIR_FS_CATALOG;

 

added / at end

 

$this->savepath = DIR_FS_CATALOG ."/";

 

---------------

when both added date and modified date are null for a product/category in database, getting php error with method strtotime() for time being empty

 

It will be better, if it is checked and given a proper error message

 

--------------

Share this post


Link to post
Share on other sites
Hi,

With the above problem, I have submitted the googlesitemap/index.php to google, but Google shows the following error:

 

Parsing error

 

We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting.

 

Is there anyone who could help me with this?

 

Thanks

 

Regarding this and especially the errors that you were showing in a prior thread. It looks you you have not changed the permissions for the sitemap files to 777.

 

Once you have the dummy XML files uploaded you will need to make them wrtieable by the web server. The easiest way to do this is to start your favorite FTP client, right click the files, and change the permissions on each one. The correct settings will vary based on your server setup but generally speaking a setting of 777 or read, write, execute will work every time.

 

 

Check that step and if you are still having problems please post a URL to your site.

 

Paul

Share this post


Link to post
Share on other sites
Regarding this and especially the errors that you were showing in a prior thread. It looks you you have not changed the permissions for the sitemap files to 777.

Check that step and if you are still having problems please post a URL to your site.

 

Paul

Hi,

I have changed the permission to 777, but the problem is with the file name.

I have to add "googlesitemap" before the name of the dummy xml files. now my dumy files are as following:

 

googlesitemapsitemapindex.xml

googlesitemapsitemapproducts.xml

googlesitemapsitemapcategories.xml

 

 

Here is a url to my dummy files:

 

http://bargaincollection.com/shop/googlesi...itemapindex.xml

http://bargaincollection.com/shop/googlesi...mapproducts.xml

http://bargaincollection.com/shop/googlesi...pcategories.xml

 

Thank you


Regards,

Share this post


Link to post
Share on other sites
Hi,

I have changed the permission to 777, but the problem is with the file name.

I have to add "googlesitemap" before the name of the dummy xml files. now my dumy files are as following:

 

googlesitemapsitemapindex.xml

googlesitemapsitemapproducts.xml

googlesitemapsitemapcategories.xml

Here is a url to my dummy files:

 

http://bargaincollection.com/shop/googlesi...itemapindex.xml

http://bargaincollection.com/shop/googlesi...mapproducts.xml

http://bargaincollection.com/shop/googlesi...pcategories.xml

 

Thank you

 

I am not sure why you have to "add 'googlesitemap' before the name. I just ran through the files and these files

 

Here is your sitemap index: http://bargaincollection.com/shop/sitemapindex.xml

Here is your product sitemap: http://bargaincollection.com/shop/sitemapproducts.xml

Here is your category sitemap: http://bargaincollection.com/shop/sitemapcategories.xml

 

work just fine. ;)

 

Paul

Share this post


Link to post
Share on other sites
I am not sure why you have to "add 'googlesitemap' before the name. I just ran through the files and these files

 

Here is your sitemap index: http://bargaincollection.com/shop/sitemapindex.xml

Here is your product sitemap: http://bargaincollection.com/shop/sitemapproducts.xml

Here is your category sitemap: http://bargaincollection.com/shop/sitemapcategories.xml

 

work just fine. ;)

 

Paul

Thanks for your reply,

I know the files are working just fine when I add "googlesitemap" before the name.

I have another question, I have uploaded these three files manually to google sitemap, but I'm not sure if that is the right way and if that will cause my site to be indexed in google.

Thanks

:thumbsup:


Regards,

Share this post


Link to post
Share on other sites

omidhz

 

Just upload the 'sitemapindex.xml' next time. It is an index that points to the other two. The reason has been answered in previous posts.

 

Rochdalemark

 

I run a hybrid of phpGroupWare with osC as a module. Post some of the indexing 'errors' so I can look at them. This should be easy to remedy.


· willross

··········

Share this post


Link to post
Share on other sites

Hi All

 

I've install this contrib and all seems to work well.

 

Google has finally listed my page. Only thing in goole none of my heading are correct.

 

So i just would like to confirm this is what is meant to be in the xml files

 

- <url>

<loc>http://www.up2date.net.au/product_info.php?products_id=1099</loc>

<lastmod>2005-06-20</lastmod>

<changefreq>weekly</changefreq>

<priority>1.0</priority>

</url>

- <url>

<loc>http://www.up2date.net.au/product_info.php?products_id=968</loc>

<lastmod>2005-06-25</lastmod>

<changefreq>weekly</changefreq>

<priority>0.3</priority>

</url>

- <url>

<loc>http://www.up2date.net.au/product_info.php?products_id=786</loc>

<lastmod>2005-04-28</lastmod>

<changefreq>weekly</changefreq>

<priority>0.2</priority>

</url>

- <url>

<loc>http://www.up2date.net.au/product_info.php?products_id=874</loc>

<lastmod>2005-04-28</lastmod>

<changefreq>weekly</changefreq>

<priority>0.2</priority>

 

Does the above look right ?

 

 

This is what google is listing my pages as there are hundereds of these.

 

www.up2date.net.au/product_info.php?products_id=1307

Similar pages

 

www.up2date.net.au/product_info.php?products_id=2202

Similar pages

 

www.up2date.net.au/product_info.php?products_id=854

 

 

 

Any help would be great.

 

THanks

Scott

Share this post


Link to post
Share on other sites

I have no "http://Mydomain.com/" in the generated .xml files, it just "<loc>/catalog/italy-design-bright-white-diamonds-platinum-ring-p-53.html</loc>"

 

How does this happened? I installed this on another site before, and everything is ok. I didn't modify any thing in the code except chang the domain name path.

 

But on the google, it says the status is ok.

 

I want to know if it will have some problems.

 

Thanks.

Share this post


Link to post
Share on other sites

Hello everyone! I am having the same problem a few people had on this contribution, when I go to http://www.compshop4u.com/googlesitemap/index.php this is what I see:

 Warning:  fopen(/public_html/sitemapproducts.xml): failed to open stream: No such file or directory in /home/web/compshop4u.com/public_html/googlesitemap/sitemap.class.php on line 291
ERROR: Google Product Sitemap Generation FAILED!


Warning:  fopen(/public_html/sitemapcategories.xml): failed to open stream: No such file or directory in /home/web/compshop4u.com/public_html/googlesitemap/sitemap.class.php on line 291
ERROR: Google Category Sitemap Generation FAILED!


Warning:  fopen(/public_html/sitemapindex.xml): failed to open stream: No such file or directory in /home/web/compshop4u.com/public_html/googlesitemap/sitemap.class.php on line 291
ERROR: Google Sitemap Index Generation FAILED!

Array
(
   [QUERY] => Array
       (
           [PRODUCTS] => Array
               (
                   [STATUS] => success
                   [NUM_ROWS] => 120
               )

           [CATEOGRY] => Array
               (
                   [STATUS] => success
                   [NUM_ROWS] => 26
               )

       )

   [SAVE_FILE_XML] => Array
       (
           [0] => Array
               (
                   [file] => /public_html/sitemapproducts.xml
                   [status] => failure
                   [file_exists] => false
               )

           [1] => Array
               (
                   [file] => /public_html/sitemapcategories.xml
                   [status] => failure
                   [file_exists] => false
               )

           [2] => Array
               (
                   [file] => /public_html/sitemapindex.xml
                   [status] => failure
                   [file_exists] => false
               )

       )

)

 

The three dummy files are in my site's root directory and are "777"

The googlesitemap directory is also in the root of my site. What should I do??? Any help is appreciated. THANK YOU!

Share this post


Link to post
Share on other sites

Hi - great contribution - superb instructions and everything seemed to work first time.

 

The only problem I had was a crontab email saying:-

 

php: not found

 

(referring to the /googlesitemap/index.php i just copied and pasted the path as per the instruction and would like to know if I should change the url to the one I would use to type in the browser address bar. Does this email message mean the sitemap was not run but got submitted?

 

Im pretty sure the sitemaps got submitted to google though.


The sooner you fall behind, the more time you'll have to catch up.

Share this post


Link to post
Share on other sites
Hello everyone! I am having the same problem a few people had on this contribution, when I go to http://www.compshop4u.com/googlesitemap/index.php this is what I see:

 

Warning:  fopen(/public_html/sitemapproducts.xml): failed to open stream: No such file or directory in /home/web/compshop4u.com/public_html/googlesitemap/sitemap.class.php on line 291

ERROR: Google Product Sitemap Generation FAILED!

Warning:  fopen(/public_html/sitemapcategories.xml): failed to open stream: No such file or directory in /home/web/compshop4u.com/public_html/googlesitemap/sitemap.class.php on line 291

ERROR: Google Category Sitemap Generation FAILED!

Warning:  fopen(/public_html/sitemapindex.xml): failed to open stream: No such file or directory in /home/web/compshop4u.com/public_html/googlesitemap/sitemap.class.php on line 291

ERROR: Google Sitemap Index Generation FAILED!

 

...

 

The three dummy files are in my site's root directory and are "777"

The googlesitemap directory is also in the root of my site. What should I do??? Any help is appreciated. THANK YOU!

[right][post=660963]<{POST_SNAPBACK}>[/post][/right]

check your path to root

 

You have /home/web/compshop4u.com/... and it should look something like /home/web/compshop/path/to/root


Stress is a luxury afforded to those of us that need it least.

Where lipstick is concerned, the important thing is not color, but to accept God's final word on where your lips end. --Jerry Seinfeld

If you pick up a starving dog, and make him prosperous, he will not bite you. This is the principal difference between a man and a dog. --Mark Twain

Share this post


Link to post
Share on other sites
Hi - great contribution - superb instructions and everything seemed to work first time.

 

The only problem I had was a crontab email saying:-

 

php: not found

 

(referring to the /googlesitemap/index.php i just copied and pasted the path as per the instruction and would like to know if I should change the url to the one I would use to type in the browser address bar. Does this email message mean the sitemap was not run but got submitted?

 

Im pretty sure the sitemaps got submitted to google though.

If your cron wasn't run because it couldn't find the php, then the file wasn't generated, and not sent to google.

 

What is the exact command you are running? Sounds like you're pointing your server to the wrong path to php


Stress is a luxury afforded to those of us that need it least.

Where lipstick is concerned, the important thing is not color, but to accept God's final word on where your lips end. --Jerry Seinfeld

If you pick up a starving dog, and make him prosperous, he will not bite you. This is the principal difference between a man and a dog. --Mark Twain

Share this post


Link to post
Share on other sites
I have no "http://Mydomain.com/" in the generated .xml files, it just "<loc>/catalog/italy-design-bright-white-diamonds-platinum-ring-p-53.html</loc>"

 

How does this happened? I installed this on another site before, and everything is ok. I didn't modify any thing in the code except chang the domain name path.

 

But on the google, it says the status is ok.

 

I want to know if it will have some problems.

 

Thanks.

If google says your status is ok, then I wouldn't worry about it.


Stress is a luxury afforded to those of us that need it least.

Where lipstick is concerned, the important thing is not color, but to accept God's final word on where your lips end. --Jerry Seinfeld

If you pick up a starving dog, and make him prosperous, he will not bite you. This is the principal difference between a man and a dog. --Mark Twain

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×