Web Wiz Forums - Google sucking my bandwidth

Print Page | Close Window

Google sucking my bandwidth

Printed From: Web Wiz Forums
Category: Web Wiz Web App Support Forums
Forum Name: Web Wiz Forums
Forum Description: Support forum for Web Wiz Forums application.
URL: https://forums.webwiz.net/forum_posts.asp?TID=23166
Printed Date: 07 April 2026 at 8:04pm
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com

Topic: Google sucking my bandwidth

Posted By: kibrisca
Subject: Google sucking my bandwidth
Date Posted: 23 April 2007 at 4:15pm

Hello All,

I am having problem with google they send me this message about googlebot sucking my bandwith.

The end result was their Googlebot doesn�t handle sessions well:

"From the log snippet you provided, we can see that your site is using session IDs. As you�ve observed, session IDs can cause problems for our robots. Please disable session IDs for Googlebot so that our robots may crawl your site more efficiently."

can you provide me how forum doesn�t create a session for the Googlebot.?

I have found this script to block googlebot with session ID, and one of website saying this;

Im thinking a solution could be the following:
In the Global.asp file, create an IF, THEN, ELSE statement that says something about If googlebot. THEN don�t index sessions ELSE index the rest of the pages�

Can anyone make this MOD for us, it will really appriciated...

[QUOTE=PHP Code]

$isspider = is_spider();
if ($isspider != 'init') {
    //turn off session id for spiders
    ini_set(�session.use_trans_sid�, false);
}

function is_spider()
{
    // don't know if this is a spider or not yet
    $spiders = array(
        "almaden.ibm.com" ,
        "gigabot" ,
        "appie 1.1" ,
        "architext" ,
        "ask jeeves",
        "asterias2.0",
        "augurfind" ,
        "baiduspider" ,
        "bannana_bot" ,
        "bdcindexer" ,
        "crawler" ,
        "crawler@fast" ,
        "docomo" ,
        "fast-webcrawler",
        "fluffy the spider",
        "frooglebot",
        "geobot",
        "googlebot",
        "mediapartners-google",
        "gulliver",
        "henrythemiragorobot",
        "ia_archiver",
        "infoseek",
        "kit_fireball",
        "lachesis",
        "lycos_spider",
        "mantraagent",
        "mercator",
        "msnbot",
        "moget" ,
        "muscatferret" ,
        "nationaldirectory-webspider" ,
        "naverrobot" ,
        "ncsa beta" ,
        "netresearchserver" ,
        "ng/1.0" ,
        "osis-project" ,
        "polybot" ,
        "pompos" ,
        "scooter" ,
        "seventwentyfour" ,
        "sidewinder" ,
        "sleek spider" ,
        "slurp" ,
        "steeler" ,
        "szukacz" ,
        "t-h-u-n-d-e-r-s-t-o-n-e" ,
        "teoma" ,
        "turnitinbot" ,

Replies:

Posted By: WebWiz-Bruce
Date Posted: 23 April 2007 at 5:56pm

Web Wiz Forums doesn't create session ID's for search engine robots.

Web Wiz Forums detects the users browser and OS for the active users list/page, this data is then also used so when a session is created for a user if the browser is detected as being a robot it doesn't create a session for that user.

The code you have above is in PHP and not ASP, it also would be a waste of time getting that code to work with web wiz forums as it's already handle but not so simply.

-------------
https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting
https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting