gogole robot
Printed From: Web Wiz Forums
Category: Web Wiz Web App Support Forums
Forum Name: Web Wiz Forums
Forum Description: Support forum for Web Wiz Forums application.
URL: https://forums.webwiz.net/forum_posts.asp?TID=21149
Printed Date: 09 April 2026 at 4:18am
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com
Topic: gogole robot
Posted By: kevsc
Subject: gogole robot
Date Posted: 27 August 2006 at 9:45am
| I am a little confused, I have closed all access for the guest account but the robot seems to get through still, any way of blocking this as I dont want user profiles being on public display. |
Replies:
Posted By: WebWiz-Bruce
Date Posted: 27 August 2006 at 11:43am
|
You need to be a registered user in order to read a users profile. If the Google Robot follows a link to a users profile it just gets a page saying that it needs to be registered in order to read that users profiles, so never actually reads the users actual profile. If you are reading in the active users page that Google Robot is viewing 'username profile' then this is a bit in accurate as they are actually viewing a page saying it needs to be registered to view this users profile. I shall look into changing this for the next version so that the active users page shows a more accurate message for this page. ------------- https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting |
Posted By: dfrancis
Date Posted: 27 August 2006 at 12:41pm
You rock boRgman! (That's a good thing my kids tell me.)
I was thinking the same thing. I was thinking about offering a meta noindex follow and then a site map of public pages could help with SEO as well as customer service to the unregistered user. |
-boRg- wrote:Posted By: kevsc
Date Posted: 27 August 2006 at 1:07pm
| thank you so much... am a little less worried now, love the program just trying to figure everything out, is there a way of including location under their avatar? |
Posted By: jckruger
Date Posted: 30 August 2006 at 11:36pm
|
I have just put a robots.txt file in the root of my server and haven't seen any googlebots since. Here is a reference you can use From http://www.robotstxt.org/wc/faq.html - http://www.robotstxt.org/wc/faq.html "How do I stop robots scanning my site" How do I prevent robots scanning my site?The quick way to prevent robots visiting your site is put these two lines into the /robots.txt file on your server: User-agent: * Disallow: / but its easy to http://www.robotstxt.org/wc/faq.html#robotstxt - be more selective than that. |