[module] Google sitemap.xml Generator

[Woudloper]

About the integration you were telling, I am OK with it - the code is actually very simple for this Google sitemap module, can be integrated easily. However, some people (just like I do) might only want a SEO module and are not using a sitemap module at all.

Yes, you are right. This 'Google Sitemap XML generator' module can best be made as an 'admin addon', since I has nothing to do with the pages. Therefore I would like to suggest that this module will/can be converted into an admin addon.

[Yvonne]

Is the module onlu for WB 2.6.1. I use 2.5.2 and i get errors like:

No public news posts found.

Warning: fopen(/home/devalett/public_html/chambres/sitemap.xml): failed to open stream: Permission denied in /home/devalett/public_html/chambres/modules/gsitemap/view.php on line 163

Warning: fwrite(): supplied argument is not a valid stream resource in /home/devalett/public_html/chambres/modules/gsitemap/view.php on line 164

Warning: fclose(): supplied argument is not a valid stream resource in /home/devalett/public_html/chambres/modules/gsitemap/view.php on line 165
Done in 0 seconds.

Submitting sitemap to Google...
Done.
Answer from Google is: HTTP/1.0 200 OK Content-Type: text/html; charset=UTF-8 Cache-control: private Content-Length: 1305 Date: Wed, 18 Jan 2006 17:11:15 GMT Server: GFE/1.3 Connection: Keep-Alive

Or is it me that is doing something wrong.

Yvonne

[viulian]

In your case, the username under which the Apache server runs does not have the right to write the file

/home/devalett/public_html/chambres/sitemap.xml

Make sure you give the permisions (such as for example 777 for the first try) on that file. Probably you have to create it first by hand - just create an empty file - and then give it the right permissions.

Then it will work

[Yvonne]

I'm sorry, but it does't work. I have make an empty file (sitemap.php) and changed the permissions to 777.
After that i created in WB a page (sitemap type xml generator) and i still get the errors as my message above

I really like to use the module, because its very handy i think

Yvonne

[viulian]

sitemap.php or sitemap.xml ?

[Yvonne]

What do you mean with sitemap.php or sitemap.xml. I have created a emty sitemap.php file. Does it have to be an xml.type. If yes, were should i create an empty xml.type. The sitemap.php file should be under pages isn't it.

Yvonne

[viulian]

The sitemap is stored into a file called sitemap.xml .

Instead, you have created a file called sitemap.php which doesn't actually solve anything - because the plugin will want to write in a file called sitemap.xml

So please remove the sitemap.php file, create instead a sitemap.xml file - give it 777 and rerun the plugin. The error message sais that there is permission denied - that is the apache is not allowed to create/write that file in that directory - and that's why you have to create it by hand first so you don't have to tweak the permissions of the directories.

Hope it is clearer now

[pcwacht]

The error:

Warning: fopen(/home/devalett/public_html/chambres/sitemap.xml): failed to open stream: Permission denied

says it all

path: /home/devalett/public_html/chambres/ NOT pages!!!
file : sitemap.xml


Have fun...
John

[Yvonne]

It works. Thank you very much.

Yvonne

[bupaje]

Hi. I'm not sure if you are interested in checking this out but when I go to Google to check my stats for the file now I get the following

Parsing error (Line 229)  We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting. 

Not sure if they made a change on thier end as it previously didn't generate the error.

[viulian]

Hi!

Thanks for letting me know of this. There are two bugs in my code:
1. one is that I assumed the locations of the pages will always be under the wb directory (and it turns out - I just quickly checked but I will investigate more today) that you have a page which points to turbosquid.
2. that link uses & but is not OK for ampersands to be used in XML - which is perfectly OK for html, but I was not expecting them to appear so they are not escaped.

If you want to quickly fix the problem with google, you would have to manually edit the sitemap.xml and replace the line with turbosquid with this one:

Code:

<loc>http://www.turbosquid.com/Search/Index.cfm?FuseAction=ProcessSmartSearch&amp;istIncAuthor=bupaje &amp;blAuthorExact=y&amp;intMediaType=-1&amp;stgBoolean=l&amp;blExternal=TRUE.php</loc>

I will update the code in max one day to properly handle this case.

Thanks!

[bupaje]

Thanks very much. I will wait for your fix since I have fat fingers that break everything.

[viulian]

Hi!

I have updated the code. Sorry for the delay, had lots of errands to run this weekend.

The code now ignores the menu links that point to an outside address. In fact, sitemap.xml has to include only the links that belong to the site.
I haven't urlencoded the links yet, I assume they are already stored correctly in the database.

Please download and have a look the file is attached in the first topic of the thread.

Let me know after you run the new code, so I can double check.

Thanks

[Francisco]

 Does this work for 2.6.2? 

[wwwMARKLEYcouk]

Does this work for 2.6.2? 

im using it with 2.6.2 with no problems yet

[SaschaN]

I have a problem.
On all the pages I used the sitemap generator: no problems.
But on this page there is a problem and I don't know what problem it is:

http://schreinerei-nos.de/pages/google-sitemap.php

I hope, you could help me.
Thanks!

[viulian]

Hi!

I've looked at the webpage and while the main content works OK - I do not understand why the strange behaviour...
It is probably related to the template as far as I can tell, because the module just displays basic HTML - but what ends up on the screen is a loop in which the round template is embedded recursively... however the round template is not in fact the default template for the page so.. why is it loaded ?

Please investigate the template issue, as I do not have other ideeas right now ...

[SaschaN]

Hi!

I've looked at the webpage and while the main content works OK - I do not understand why the strange behaviour...
It is probably related to the template as far as I can tell, because the module just displays basic HTML - but what ends up on the screen is a loop in which the round template is embedded recursively... however the round template is not in fact the default template for the page so.. why is it loaded ?

Please investigate the template issue, as I do not have other ideeas right now ...

When I change the template, it's the same problem ...

[viulian]

Still I belive there might be something on the server - here's why:

1. If i close the browser and go directly to the google sitemap page by clicking the link in your post above - I get an Internal Server Error.
2. If I first open the webpage by going to http://schreinerei-nos.de/ and only after it loads I do load the google sitemap page - it will enter in that loop with the template.

Can you please post some meaningful informations (related to sitemap plugin) from the server error log ?

Thanks!

[MrRedlich]

That extension does not work.

It spit out that cryptic dingdong i do not understand, what php want to say me...

No public news posts found.

Warning: fopen(/mnt/sda/home/u0000345024/public_html/fahrrad/sitemap.xml): failed to open stream: Permission denied in /mnt/sda/home/u0000345024/public_html/fahrrad/modules/gsitemap/view.php on line 186

Warning: fwrite(): supplied argument is not a valid stream resource in /mnt/sda/home/u0000345024/public_html/fahrrad/modules/gsitemap/view.php on line 187

Warning: fclose(): supplied argument is not a valid stream resource in /mnt/sda/home/u0000345024/public_html/fahrrad/modules/gsitemap/view.php on line 188
Done in 0 seconds.

Link is: http://blublub.de/fahrrad/sitemap.xml
Link is: /webmasters/sitemaps/ping?sitemap=http%3A%2F%2Fblublub.de%2Ffahrrad%2Fsitemap.xml
Submitting sitemap to Google...
Done.
Answer from Google is: HTTP/1.0 200 OK Content-Type: text/html; charset=UTF-8 Cache-control: private Content-Length: 1305 Date: Sun, 12 Mar 2006 02:13:39 GMT Server: GFE/1.3 Connection: Keep-Alive

And i never want that the programm contacts google. I am currently build my webseite, and it is not good, when a human googlesitececker see a webseite without any content.

The sitemap.xml is not in the directry... i cant find it with my ftp programm.


OK I have solved the problem...  by reading page 2 of that subforum.

Dear Moduleauthor, please write in the install notes, that user maybe have to create a empty sitemap.xml selfe with 777 so that that module work.

[viulian]

Hi!

Thanks for the sugestion, I will update the module info I omitted that because I am too familliar with these kind of errors and I almost know by heard that I need to grant permissions.

About the program contacting Google - there is no problem, Google will not come if you have not first submitted the page on Google Sitemaps. I mean you have to create an account, add your sitemap there, and only after that will the robots come and visit you. At least that is what happened to me: on my webpage I tested the module before adding the sitemap to Google Sitemap page, and only after adding it manually the robots came and slurp the sitemap.xml.

I hope it makes sense

[MrRedlich]

Oha... thanks for aditional info 

[SaschaN]

Still I belive there might be something on the server - here's why:

1. If i close the browser and go directly to the google sitemap page by clicking the link in your post above - I get an Internal Server Error.
2. If I first open the webpage by going to http://schreinerei-nos.de/ and only after it loads I do load the google sitemap page - it will enter in that loop with the template.

Can you please post some meaningful informations (related to sitemap plugin) from the server error log ?

Thanks!

The problem is that I have more domains with the same provider and all this domains have no problems with creating google-sitemap.

[SaschaN]

I don't know if this helps you. 

80.67.17.125 - - [13/Mar/2006:00:12:51 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
66.249.66.37 - - [13/Mar/2006:00:12:51 +0100] "GET /pages/produkte/beschattung/markisen.php HTTP/1.1" 200 6071 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
68.142.251.171 - - [13/Mar/2006:00:44:09 +0100] "GET /robots.txt HTTP/1.0" 404 288 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
80.67.17.125 - - [13/Mar/2006:00:44:10 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
68.142.250.50 - - [13/Mar/2006:00:44:10 +0100] "GET / HTTP/1.0" 200 5650 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
80.67.17.125 - - [13/Mar/2006:01:15:06 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
66.249.66.37 - - [13/Mar/2006:01:15:06 +0100] "GET /pages/produkte/beschattung/raffstores.php HTTP/1.1" 200 5931 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
150.101.122.239 - - [13/Mar/2006:01:22:15 +0100] "GET /pages/google-sitemap.php HTTP/1.1" 500 618 "http://forum.websitebaker.org/index.php/topic,1751.40.html" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:16 +0100] "GET /favicon.ico HTTP/1.1" 404 297 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
80.67.17.125 - - [13/Mar/2006:01:22:35 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
150.101.122.239 - - [13/Mar/2006:01:22:35 +0100] "GET / HTTP/1.1" 200 5669 "http://forum.websitebaker.org/index.php/topic,1751.40.html" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:36 +0100] "GET /templates/sn/std.css HTTP/1.1" 200 5259 "http://schreinerei-nos.de/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:36 +0100] "GET /templates/sn/logo.gif HTTP/1.1" 200 3970 "http://schreinerei-nos.de/templates/sn/std.css" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:37 +0100] "GET /templates/sn/hg-context.gif HTTP/1.1" 200 2505 "http://schreinerei-nos.de/templates/sn/std.css" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:37 +0100] "GET /media/kostenlosanrufen/callfree.gif HTTP/1.1" 200 1671 "http://schreinerei-nos.de/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:37 +0100] "GET /media/luftbefeuchtung.jpg HTTP/1.1" 200 5747 "http://schreinerei-nos.de/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:37 +0100] "GET /media/insektenschutz.jpg HTTP/1.1" 200 5183 "http://schreinerei-nos.de/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:37 +0100] "GET /media/baumhaus.jpg HTTP/1.1" 200 12018 "http://schreinerei-nos.de/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:38 +0100] "GET /templates/sn/hg_holz.jpg HTTP/1.1" 200 31654 "http://schreinerei-nos.de/templates/sn/std.css" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:41 +0100] "GET /favicon.ico HTTP/1.1" 404 297 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:45 +0100] "GET /templates/simple/screen.css HTTP/1.1" 200 928 "http://schreinerei-nos.de/pages/google-sitemap.php" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:46 +0100] "GET /templates/simple/print.css HTTP/1.1" 200 396 "http://schreinerei-nos.de/pages/google-sitemap.php" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:22:49 +0100] "GET /pages/google-sitemap.php HTTP/1.1" 200 347307 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
150.101.122.239 - - [13/Mar/2006:01:23:16 +0100] "GET /favicon.ico HTTP/1.1" 404 297 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
68.142.251.171 - - [13/Mar/2006:01:32:07 +0100] "GET /robots.txt HTTP/1.0" 404 288 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
68.142.249.66 - - [13/Mar/2006:01:32:08 +0100] "GET /search?wb_session_id=0132692d5bc884cf46611e5a7b26d8a3 HTTP/1.0" 301 372 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
80.67.17.125 - - [13/Mar/2006:01:32:08 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
68.142.249.66 - - [13/Mar/2006:01:32:08 +0100] "GET /search/?wb_session_id=0132692d5bc884cf46611e5a7b26d8a3 HTTP/1.0" 200 4953 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
80.67.17.125 - - [13/Mar/2006:01:44:45 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
66.249.66.37 - - [13/Mar/2006:01:44:45 +0100] "GET /pages/gallery/6077.php HTTP/1.1" 200 4639 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
80.67.17.125 - - [13/Mar/2006:02:14:03 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
66.249.66.37 - - [13/Mar/2006:02:14:03 +0100] "GET /pages/unternehmen/impressum.php?wb_session_id=12561ad5f64e60d103709755949ee2e4 HTTP/1.1" 200 7285 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
68.142.249.149 - - [13/Mar/2006:02:37:30 +0100] "GET /robots.txt HTTP/1.0" 404 291 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
80.67.17.125 - - [13/Mar/2006:02:37:31 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
68.142.249.53 - - [13/Mar/2006:02:37:31 +0100] "GET /pages/unternehmen/kontakt.php HTTP/1.0" 200 8691 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
80.67.17.125 - - [13/Mar/2006:02:47:16 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
66.249.66.37 - - [13/Mar/2006:02:47:16 +0100] "GET /pages/gallery/tisch-trupp-01165.php HTTP/1.1" 200 4925 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
80.67.17.125 - - [13/Mar/2006:02:47:17 +0100] "GET /templates/sn/breadcrumb-menu.txt HTTP/1.0" 200 4469 "-" "-"
66.249.66.37 - - [13/Mar/2006:02:47:17 +0100] "GET /pages/gallery/3956.php HTTP/1.1" 200 4844 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

[viulian]

Can you please post from the serverr error log ? (not access log). I mean try to access the google sitemap module (and let it fail) then paste here the contents from the error log.

Thanks.