HTML Logo by World Wide Web Consortium (www.w3.org). Click to learn more about our commitment to accessibility and standards.

[RESOLVED] v7.0.1 - Sitemap not being autogenerated

Login / Search

 [ Join | More ]
 Add topic 
Posted
Rating:
#74113
Avatar

Community saint

Chris-

Thanks for the recommendation. I stumbled across that there was a disallow to the site root.

Bob
Back to the top
 
Posted
Rating:
#74157
Avatar

Community saint

I do wish this auto-generated the site map file as advertised. I made a number of small structural changes and almost forgot to update the sitemap.

Bob
Back to the top
 
Posted
Rating:
#74648
Avatar

Community saint

Chris Graham said

Add this to robots.txt if you want

Code

Sitemap: /ocp_sitemap.xml
Chris-

When I test the crawler access in Google Webmaster Tools, I get the following:


I think I will just remove this from robots.txt since the sitemap has been submitted and the site crawled but can you think of a reason why this did not work?

Bob
Back to the top
 
Posted
Rating:
#74675
Avatar

ocStaff (admin)

I think I will just remove this from robots.txt since the sitemap has been submitted and the site crawled but can you think of a reason why this did not work?

I assumed it would support relative URLs, maybe it can't :(. So you'd need to put your full URL in there instead.



Become a fan of ocPortal on Facebook or add me as a friend.

Expand: Was I helpful? Was I helpful?

Expand: Follow me on Twitter Follow me on Twitter







If I answered something that you think should be in the documentation, please take the initiative and add it to the community documentation. We really need people to help out here and build a well-organised large support resource.
Back to the top
 
Posted
Rating:
#76683
Avatar

Community saint

Is there any chance that we can get the sitemap generated once again as part of the cron job. It's a real pain to have to remember to manually update the sitemap each and every time I add or rearrange something.

It's not like I am asking for something new, just something to work as advertised.

Bob
Back to the top
 
Posted
Rating:
#76687
Avatar

ocStaff (admin)

It should work, but I just did some testing and found it could stop working if it failed part way through once (it thinks it is still running so avoids running it again).

Try putting this into OcCLE:

Code

:set_value('sitemap_building_in_progress','0'); set_value('last_sitemap_time_calc',0);



Become a fan of ocPortal on Facebook or add me as a friend.

Expand: Was I helpful? Was I helpful?

Expand: Follow me on Twitter Follow me on Twitter







If I answered something that you think should be in the documentation, please take the initiative and add it to the community documentation. We really need people to help out here and build a well-organised large support resource.
Back to the top
 
Posted
Rating:
#76688
Avatar

Community saint

Well, that nudged it to create the new sitemap once. My CRON job runs every 15 minutes with the last run at 8:45 but the sitemap was last created at 7:45.

Seems it must hang up often although I never have problems creating it manually.

Bob
Back to the top
 
Posted
Rating:
#76689
Avatar

ocStaff (admin)

It avoids regenerating each time it runs, to avoid big server load, and annoying Google.

Glad it works.



Become a fan of ocPortal on Facebook or add me as a friend.

Expand: Was I helpful? Was I helpful?

Expand: Follow me on Twitter Follow me on Twitter







If I answered something that you think should be in the documentation, please take the initiative and add it to the community documentation. We really need people to help out here and build a well-organised large support resource.
Back to the top
 
Posted
Rating:
#76690
Avatar

Community saint

Looking at server resource usage and it looks like the second time the CRON job ran, it maxed out CPU resources. Why would it be different one time to the next? The number of entry processes were only a bit higher and nowhere near the limit.

Any thoughts?

I think I may need to get eLief involved in this to get it resolved.

Bob
Back to the top
 
Posted
Rating:
#76691
Avatar

Community saint

Chris Graham said

It avoids regenerating each time it runs, to avoid big server load, and annoying Google.

Glad it works.
How does it determine whether or not to regenerate? Is it a case of run x out of even y times or is there another trigger?

Bob
Back to the top
 
Posted
Rating:
#76692
Avatar

ocStaff (admin)

It runs once per day.

All the CRON 'hooks' determine themselves how regularly to run, so any time you run the master cron_bridge.php file you don't necessarily know what will be running that particular time.



Become a fan of ocPortal on Facebook or add me as a friend.

Expand: Was I helpful? Was I helpful?

Expand: Follow me on Twitter Follow me on Twitter







If I answered something that you think should be in the documentation, please take the initiative and add it to the community documentation. We really need people to help out here and build a well-organised large support resource.
Back to the top
 
Posted
Rating:
#76696
Avatar

Community saint

Okay…I'll just keep an eye on it over the next few days.

Bob
Back to the top
 
Posted
Rating:
#76705
Avatar

Community saint

Something is still not right with this. I just checked and the sitemap had not been updated since &:45 yesterday morning - over 28 hours - so had to manually update it.

If this issue is the process hanging, what should I be looking for? Is this an ocPortal issue or a hosting issue?

Is anyone having success with their sitemap being updated automatically?

Bob
Back to the top
 
Posted
Rating:
#76711
Avatar

ocStaff (admin)

You may have already factored this in, but I think there's a small delay between ocPortal's submission to Google, and when Google actually gets around to downloading it.


Like ocPortal on Facebook:
Back to the top
 
Posted
Rating:
#76712
Avatar

ocStaff (admin)

It was a bug, and I feel like a muppet. It always locked up on the CRON tick after the CRON tick where it would work. I have uploaded a fix. Thanks for checking it, no one else bothered enough (including me) to actually monitor it, except for the first instance.
I have also implemented an unlocker - if the cron script times out, it will try again in 3 days time.
Attachment
sources/hooks/systems/cron/sitemap.php
» Download: sitemap.php (1.15 Kb, 17 downloads so far)



Become a fan of ocPortal on Facebook or add me as a friend.

Expand: Was I helpful? Was I helpful?

Expand: Follow me on Twitter Follow me on Twitter







If I answered something that you think should be in the documentation, please take the initiative and add it to the community documentation. We really need people to help out here and build a well-organised large support resource.
Back to the top
 
Posted
Rating:
#76717
Avatar

Community saint

Thanks, Chris, for fixing this.

Don't feel like a muppet as no software is bug-free and you always make an honest effort to fix problems when reported even if a bit of persistence is required by the reporter. It's one of the many reasons I feel good about supporting ocPortal.

Bob
Back to the top
 
Posted
Rating:
#76848
Avatar

Community saint

Pleased to report that the sitemap is now auto-generating each day. Looks like you nailed in down with your last fix.

Bob
Back to the top
 
Posted
Rating:
#76859
Avatar

Community saint

BobS said

Pleased to report that the sitemap is now auto-generating each day. Looks like you nailed in down with your last fix.

Great news Bob! Thanks for persisting with this.

When I get a chance I will try it also (I suppose I should, I did start this thread after all  :$ ).

Do you have a Samsung Galaxy S / Galaxy S II ? If so, why not check out my ScreenFree FM Radio .
Back to the top
 
Posted
Rating:
#76867
Avatar

Community saint

temp-

Yeah, I'm really pleased that I can count on the sitemap being updated daily. I usually try to remember to manually update it when I've added or changed stuff around but this is some nice insurance.

Bob
Back to the top
 
Posted
Rating:
#76908
Avatar

Community saint

I've reset sitemap_building_in_progress & last_sitemap_time_calc, and applied the new sources/hooks/systems/cron/sitemap.php but its still not working for me after about 3.25 days :'(


Do you have a Samsung Galaxy S / Galaxy S II ? If so, why not check out my ScreenFree FM Radio .
Back to the top
 
1 guests and 0 members have just viewed this: None
Control functions:

Quick reply   Expand