googlebots!
Printed From: Web Wiz Forums
Category: General Discussion
Forum Name: General Discussion
Forum Description: General discussion and chat on any topic.
URL: https://forums.webwiz.net/forum_posts.asp?TID=16355
Printed Date: 31 March 2026 at 3:07pm
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com
Topic: googlebots!
Posted By: pilot99
Subject: googlebots!
Date Posted: 27 August 2005 at 6:01pm
look at this i have a screen shot of my forum where i have 3 googlebots and 1 msnbot on at the same time. i thought this was interesting.
 holy crap and then a little while later i looked back and now i have 4 googlebots.
 |
Replies:
Posted By: dpyers
Date Posted: 27 August 2005 at 8:31pm
|
Looking at the logged in times, it appears you have 4 new googlebots. Google bot seems to spawn itself more often than other bots. The theory is that it'll index faster, but the trade-off is that a lot of pages get indexed several times on the same day which just increases your bandwidth load. I "think" one thing that initiates a spawn is if you have a page that links to itself - e.g. a link to your home page from your home page. I "think" that the bot realizes it's in a loop and spawns other bots to follow other links on the page. As a test once, I submitted a page that had no incoming or outgoing links - just 1 link on the page to itself. The link was full path - www.example.com/testpage.htm. When google finally came to index it, I had 2001 google sessions against the page that day. ------------- 
Lead me not into temptation... I know the short cut, follow me. |
Posted By: MadDog
Date Posted: 27 August 2005 at 10:11pm
|
Ive had over 200 bots on my website at the same time... nothing knew about having multiple google bots on at the same time... ------------- http://www.iportalx.net" rel="nofollow"> 
|