Web Wiz Support and Community Forums : Google sucking my bandwidth https://forums.webwiz.net/ Copyright (c) 2006-2013 Web Wiz Forums - All Rights Reserved. Tue, 07 Apr 2026 20:08:25 +0000 Mon, 23 Apr 2007 17:56:01 +0000 http://blogs.law.harvard.edu/tech/rss Web Wiz Forums 12.08 360 https://forums.webwiz.net/RSS_post_feed.asp?TID=23166 <![CDATA[Web Wiz Support and Community Forums]]> https://forums.webwiz.net/forum_images/web_wiz_forums.png https://forums.webwiz.net/ <![CDATA[Google sucking my bandwidth : Web Wiz Forums doesn&#039;t create...]]> https://forums.webwiz.net/google-sucking-my-bandwidth_topic23166_post122262.html#122262 Author: WebWiz-Bruce
Subject: 23166
Posted: 23 April 2007 at 5:56pm

Web Wiz Forums doesn't create session ID's for search engine robots.

Web Wiz Forums detects the users browser and OS for the active users list/page, this data is then also used so when a session is created for a user if the browser is detected as being a robot it doesn't create a session for that user.

The code you have above is in PHP and not ASP, it also would be a waste of time getting that code to work with web wiz forums as it's already handle but not so simply.
]]> Mon, 23 Apr 2007 17:56:01 +0000 https://forums.webwiz.net/google-sucking-my-bandwidth_topic23166_post122262.html#122262 <![CDATA[Google sucking my bandwidth : Hello All, I am having problem...]]> https://forums.webwiz.net/google-sucking-my-bandwidth_topic23166_post122254.html#122254 Author: kibrisca
Subject: 23166
Posted: 23 April 2007 at 4:15pm

Hello All,

I am having problem with google they send me this message about googlebot sucking my bandwith.

The end result was their Googlebot doesn’t handle sessions well:

"From the log snippet you provided, we can see that your site is using session IDs. As you’ve observed, session IDs can cause problems for our robots. Please disable session IDs for Googlebot so that our robots may crawl your site more efficiently."

can you provide me how forum doesn’t create a session for the Googlebot.?

I have found this script to block googlebot with session ID, and one of website saying this;

Im thinking a solution could be the following:
In the Global.asp file, create an IF, THEN, ELSE statement that says something about If googlebot. THEN don’t index sessions ELSE index the rest of the pages…

Can anyone make this MOD for us, it will really appriciated...

[QUOTE=PHP Code]

$isspider = is_spider();
if ($isspider != 'init') {
    //turn off session id for spiders
    ini_set(’session.use_trans_sid’, false);     
}

function is_spider()
{
    // don't know if this is a spider or not yet
    $spiders = array(
        "almaden.ibm.com" ,
        "gigabot" ,
        "appie 1.1" ,
        "architext" ,
        "ask jeeves",
        "asterias2.0",
        "augurfind" ,
        "baiduspider" ,
        "bannana_bot" ,
        "bdcindexer" ,
        "crawler" ,
        "crawler@fast" ,
        "docomo" ,
        "fast-webcrawler",
        "fluffy the spider",
        "frooglebot",
        "geobot",
        "googlebot",
        "mediapartners-google",
        "gulliver",
        "henrythemiragorobot",
        "ia_archiver",
        "infoseek",
        "kit_fireball",
        "lachesis",
        "lycos_spider",
        "mantraagent",
        "mercator",
        "msnbot",
        "moget" ,
        "muscatferret" ,
        "nationaldirectory-webspider" ,
        "naverrobot" ,
        "ncsa beta" ,
        "netresearchserver" ,
        "ng/1.0" ,
        "osis-project" ,
        "polybot" ,
        "pompos" ,
        "scooter" ,
        "seventwentyfour" ,
        "sidewinder" ,
        "sleek spider" ,
        "slurp" ,
        "steeler" ,
        "szukacz" ,
        "t-h-u-n-d-e-r-s-t-o-n-e" ,
        "teoma" ,
        "turnitinbot" ,
   ]]> Mon, 23 Apr 2007 16:15:06 +0000 https://forums.webwiz.net/google-sucking-my-bandwidth_topic23166_post122254.html#122254