Google not spidering
Printed From: Web Wiz Forums
Category: Web Wiz Web App Support Forums
Forum Name: Web Wiz Forums
Forum Description: Support forum for Web Wiz Forums application.
URL: https://forums.webwiz.net/forum_posts.asp?TID=9711
Printed Date: 07 April 2026 at 11:38pm
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com
Topic: Google not spidering
Posted By: peter
Subject: Google not spidering
Date Posted: 10 February 2004 at 4:11pm
|
Google spiders the first page of my forum (and lists it) but isn't spidering the rest of it. I know this for a fact. Why is this? I can't find one, but perhaps webwiz has some kind of spider=no tag on all the other pages?? It does spider the rest of the site (the forum is inside a /forum folder) but not the forum, other than the first page. You do NOT need to be logged in to view posts either. If someone could help me with this I'd really appreciate it. |
Replies:
Posted By: WebWiz-Bruce
Date Posted: 10 February 2004 at 5:57pm
|
There is no reason in the code for google not to spider pages inside your forum. Google spiders all the pages in the forum on this site and many other sites running web wiz forums. ------------- https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting |
Posted By: dpyers
Date Posted: 10 February 2004 at 7:36pm
|
Google does an initial scan of a site - just the home page and a couple of links off of it. Then returns 2-6 weeks later and performs a deep scan. ------------- 
Lead me not into temptation... I know the short cut, follow me. |
Posted By: peter
Date Posted: 10 February 2004 at 7:39pm
| Ahh - that must be it. Thanks a lot for that dpyers. |