Web Wiz Forums - Search Engine Access

Print Page | Close Window

Search Engine Access

Printed From: Web Wiz Forums
Category: Web Wiz Web App Support Forums
Forum Name: Web Wiz Forums
Forum Description: Support forum for Web Wiz Forums application.
URL: https://forums.webwiz.net/forum_posts.asp?TID=28215
Printed Date: 02 April 2026 at 4:42am
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com

Topic: Search Engine Access

Posted By: snadowitz
Subject: Search Engine Access
Date Posted: 08 January 2010 at 10:12am

Hi- I noticed whilst looking at my statistics page that the yahoo and google search bots have been on the site for a long time

Guest 1	66.249.71.185	Today at 04:32	455 minutes	Search Robot Google	Writing Reply [Access Denied] http://www.flamineight.co.uk/TattooForum/forum_posts.asp?TID=339" rel="nofollow - Still scabby!
Guest 2	67.195.112.158	Today at 00:33	694 minutes	Search Robot Yahoo	Viewing Topic http://www.flamineight.co.uk/TattooForum/forum_posts.asp?TID=1015" rel="nofollow - where to start?

The google bot seems stuck on this page for ages even though it cannot access it yet the yahoo bot page changes everytime I reload. How can I stop the google bot (in fact any bot) from trying to index pages it should not be indexing?

Replies:

Posted By: WebWiz-Bruce
Date Posted: 08 January 2010 at 11:41am

There is not much that can be done about this as Web Wiz Forums already has features in place to tell search engines not to follow links to these pages and not index them. Unfortunately search engine bots sometime ignore these requests and still try to access the page and are meet by an access denied page with the page set to not be indexed.

-------------
https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting
https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting