HTML Logo by World Wide Web Consortium (www.w3.org). Click to learn more about our commitment to accessibility and standards.

Moving forward with Composr

ocPortal has been relaunched as Composr CMS, which is now in beta. ocPortal 9 will be superseded by Composr 10.

Head over to compo.sr for our new site, and to our migration roadmap. Existing ocPortal member accounts have been mirrored.


More Google crawl errors

Login / Search

 [ Join | More ]
 Add topic 
Posted
Rating:
#75680 (In Topic #15657)
Avatar

Community saint

I was just looking through my Google HTTP crawl errors (basically, 401 errors) and reviewing them and it appears that all these URLs should be NO-FOLLOW since they all would require a user to be logged in. I believe some of these have been addressed in another post but I don't think the "/groups/" have been. I see no place to set visibility to the groups (only for hidden groups) but unless there is a visibility setting, they should never be followed.

Code

http://www.domain.com/groups/view/administrators.htm 401 error   Oct 2, 2011
http://www.domain.com/groups/view/sr-member.htm 401 error   Oct 2, 2011
http://www.domain.com/groups/view/super-moderators.htm 401 error   Oct 2, 2011
http://www.domain.com/index.php?page=groups&type=view&id=sr-member&keep_has_js=0 401 error   Oct 2, 2011
http://www.domain.com/index.php?page=groups&type=misc&keep_has_js=0 401 error   Oct 1, 2011
http://www.domain.com/groups/misc.htm 401 error   Oct 1, 2011
http://www.domain.com/groups/view/jr-member.htm 401 error   Sep 30, 2011
http://www.domain.com/groups/view/guests.htm 401 error   Sep 30, 2011
http://www.domain.com/groups/view/author.htm 401 error   Sep 30, 2011
http://www.domain.com/groups/view/new-member.htm 401 error   Sep 29, 2011
http://www.domain.com/groups/view/publisher.htm 401 error   Sep 29, 2011
http://www.domain.com/groups/view/editor.htm 401 error   Sep 29, 2011
http://www.domain.com/adminzone/admin_lookup/misc/93.100.116.104.htm 401 error   Sep 29, 2011
http://www.domain.com/index.php?page=groups&type=view&id=editor&keep_has_js=0 401 error   Sep 27, 2011
http://www.domain.com/warnings/ed.htm 401 error   Sep 2, 2011
http://www.domain.com/warnings/ad.htm 401 error   Sep 2, 2011
http://www.domain.com/bookmarks/misc.htm 401 error   Sep 2, 2011
http://www.domain.com/bookmarks/ad.htm 401 error   Sep 2, 2011
http://www.domain.com/search/my.htm 401 error   Sep 2, 2011
http://www.domain.com/forum/vforums/unread.htm 401 error   Sep 2, 2011
http://www.domain.com/forum/vforums/recently_read.htm 401 error   Sep 2, 2011
http://www.domain.com/forum/vforums/misc.htm 401 error   Sep 2, 2011
http://www.domain.com/forum/forumview/pt.htm 401 error   Sep 2, 2011
http://www.domain.com/forum/topics/new_pt.htm 401 error   Sep 2, 2011
http://www.domain.com/personalzone/privacy.htm


Bob
Back to the top
 
Posted
Rating:
#75705
Avatar

Those not already handled…

Code

http://www.domain.com/groups/view/administrators.htm 401 error   Oct 2, 2011

Bug, fixed (shouldn't have XML-sitemap'd to hidden groups).

Code

http://www.domain.com/groups/misc.htm 401 error   Oct 1, 2011

I think possibly you might have changed your permissions after Google initially got the link. Not a bug I think. It should forget about it soon.

Code

http://www.domain.com/adminzone/admin_lookup/misc/93.100.116.104.htm 401 error   Sep 29, 2011

Don't know where Google got this link, doubt it was fed directly by ocPortal.

Code

http://www.domain.com/personalzone/privacy.htm

Bug, fixed.


Become a fan of ocPortal on Facebook or add me as a friend. Add me on on Twitter.
Was I helpful?
  • If not, please let us know how we can do better (please try and propose any bigger ideas in such a way that they are fundable and scalable).
  • If so, please let others know about ocPortal whenever you see the opportunity.
  • If my reply is too Vulcan or expressed too much in business-strategy terms, and not particularly personal, I apologise. As a company & project maintainer, time is very limited to me, so usually when I write a reply I try and make it generic advice to all readers. I'm also naturally a joined-up thinker, so I always express my thoughts in combined business and technical terms. I recognise not everyone likes that, don't let my Vulcan-thinking stop you enjoying ocPortal on fun personal projects.
  • If my response can inspire a community tutorial, that's a great way of giving back to the project as a user.
Back to the top
 
Posted
Rating:
#75708
Avatar

Community saint

Thanks, Chris.

I don't know where Google digs up some of this stuff. There are links appearing from when I accidentally removed the password to my site in June which no longer exists but Google seems to be pulling them from its cache.

I've set several of the URL parameters which should address issues in both "Crawl errors" and duplications in "HTML suggestions" but Google seems to take their sweet time removing these even though they suggest using the URL parameters:
Telling Googlebot about each parameter's purpose helps us crawl your site more efficiently, saving you bandwidth and boosting the overall number of unique pages Googlebot can crawl

I still have a lot of "wide_print" URLs which I excluded a couple of weeks ago.

Bob
Back to the top
 
There are too many online users to list.
Control functions:

Quick reply   Contract

Your name:
Your message: