Web Wiz - Green Windows Web Hosting

  New Posts New Posts RSS Feed - Google sucking my bandwidth
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Google sucking my bandwidth

 Post Reply Post Reply
Author
kibrisca View Drop Down
Newbie
Newbie
Avatar

Joined: 01 May 2006
Location: Cyprus
Status: Offline
Points: 3
Post Options Post Options   Thanks (0) Thanks(0)   Quote kibrisca Quote  Post ReplyReply Direct Link To This Post Topic: Google sucking my bandwidth
    Posted: 23 April 2007 at 4:15pm

Hello All,

I am having problem with google they send me this message about googlebot sucking my bandwith.

The end result was their Googlebot doesn’t handle sessions well:

"From the log snippet you provided, we can see that your site is using session IDs. As you’ve observed, session IDs can cause problems for our robots. Please disable session IDs for Googlebot so that our robots may crawl your site more efficiently."

can you provide me how forum doesn’t create a session for the Googlebot.?

I have found this script to block googlebot with session ID, and one of website saying this;

Im thinking a solution could be the following:
In the Global.asp file, create an IF, THEN, ELSE statement that says something about If googlebot. THEN don’t index sessions ELSE index the rest of the pages…

Can anyone make this MOD for us, it will really appriciated...

[QUOTE=PHP Code]

$isspider = is_spider();
if (
$isspider != 'init') {
    
//turn off session id for spiders
    
ini_set(’session.use_trans_sid’, false);     
}

function
is_spider()
{
    
// don't know if this is a spider or not yet
    
$spiders = array(
        
"almaden.ibm.com" ,
        
"gigabot" ,
        
"appie 1.1" ,
        
"architext" ,
        
"ask jeeves",
        
"asterias2.0",
        
"augurfind" ,
        
"baiduspider" ,
        
"bannana_bot" ,
        
"bdcindexer" ,
        
"crawler" ,
        
"crawler@fast" ,
        
"docomo" ,
        
"fast-webcrawler",
        
"fluffy the spider",
        
"frooglebot",
        
"geobot",
        
"googlebot",
        
"mediapartners-google",
        
"gulliver",
        
"henrythemiragorobot",
        
"ia_archiver",
        
"infoseek",
        
"kit_fireball",
        
"lachesis",
        
"lycos_spider",
        
"mantraagent",
        
"mercator",
        
"msnbot",
        
"moget" ,
        
"muscatferret" ,
        
"nationaldirectory-webspider" ,
        
"naverrobot" ,
        
"ncsa beta" ,
        
"netresearchserver" ,
        
"ng/1.0" ,
        
"osis-project" ,
        
"polybot" ,
        
"pompos" ,
        
"scooter" ,
        
"seventwentyfour" ,
        
"sidewinder" ,
        
"sleek spider" ,
        
"slurp" ,
        
"steeler" ,
        
"szukacz" ,
        
"t-h-u-n-d-e-r-s-t-o-n-e" ,
        
"teoma" ,
        
"turnitinbot" ,
   

Back to Top
WebWiz-Bruce View Drop Down
Admin Group
Admin Group
Avatar
Web Wiz Developer

Joined: 03 September 2001
Location: Bournemouth
Status: Offline
Points: 9844
Post Options Post Options   Thanks (0) Thanks(0)   Quote WebWiz-Bruce Quote  Post ReplyReply Direct Link To This Post Posted: 23 April 2007 at 5:56pm
Web Wiz Forums doesn't create session ID's for search engine robots.

Web Wiz Forums detects the users browser and OS for the active users list/page, this data is then also used so when a session is created for a user if the browser is detected as being a robot it doesn't create a session for that user.

The code you have above is in PHP and not ASP, it also would be a waste of time getting that code to work with web wiz forums as it's already handle but not so simply.
Back to Top
 Post Reply Post Reply

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.08
Copyright ©2001-2026 Web Wiz Ltd.


Become a Fan on Facebook Follow us on X Connect with us on LinkedIn Web Wiz Blogs
About Web Wiz | Contact Web Wiz | Terms & Conditions | Cookies | Privacy Notice

Web Wiz is the trading name of Web Wiz Ltd. Company registration No. 05977755. Registered in England and Wales.
Registered office: Web Wiz Ltd, Unit 18, The Glenmore Centre, Fancy Road, Poole, Dorset, BH12 4FB, UK.

Prices exclude VAT at 20% unless otherwise stated. VAT No. GB988999105 - $, € prices shown as a guideline only.

Copyright ©2001-2026 Web Wiz Ltd. All rights reserved.