Do Search Engine Bots slow my site down
Printed From: Web Wiz Forums
Category: Web Wiz Web App Support Forums
Forum Name: Web Wiz Forums
Forum Description: Support forum for Web Wiz Forums application.
URL: https://forums.webwiz.net/forum_posts.asp?TID=27848
Printed Date: 02 April 2026 at 9:26am Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com
Topic: Do Search Engine Bots slow my site down
Posted By: rlens
Subject: Do Search Engine Bots slow my site down
Date Posted: 18 September 2009 at 7:40pm
Hi, I have an information site www.screamingmouse.com, and it takes forever to get on. Just today my site was taken off a server and it was found that every other website on the same server (many with even more info than mine + pics), worked incredibly fast afterwards! One thing that I have noticed is that I am getting a lot of visitors with IP addresses from other countries that seem "stuck" at trying to register - are those spammers? Also, I usually have anywhere from 2 to 4 search engine bots from MSN or GOOGLE... searching my site at the same time... especially on the Calendar... does this sound right?
Is something that I can do to speed up my website... I think I read here that there were codes to stop bots in some parts of the website???
Please help, I value your advice. :)
|
Replies:
Posted By: WebWiz-Bruce
Date Posted: 21 September 2009 at 12:11pm
Lots of hits on the site like search engines can slow things down and use up bandwidth. You can slow down the speed at which search engines crawl your website by creating a robots.txt file with the following:-
User-agent: googlebot Crawl-delay: 60
User-agent: yahoo Crawl-delay: 60
|
Lots of hits on the registration page suggest that your web site is under some type of automated attack either from spam bots trying to signup or some type of DoS attack.
------------- https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting
|
Posted By: rlens
Date Posted: 21 September 2009 at 1:27pm
Thank You! You're the best! Now if I need to find another server and have this problem fixed, is this something you can facilitate? If so, could you send me the details and prices?
Thanks again :) < id="gwProxy" ="">< ="jsCall;" id="jsProxy" ="">
|
Posted By: rlens
Date Posted: 21 September 2009 at 1:30pm
Also, what in the world is that "code" looking thing that ends up after
all of my posts??? This is the first time I've seen it anywhere but on
my site! To post without it I usually have to copy what I'm trying to
post, "clear form", then paste it back into the box and submit.
Whew!
|
Posted By: WebWiz-Bruce
Date Posted: 21 September 2009 at 1:37pm
Yes we can host your website and/or forum for you on our own network and servers. These servers are specially setup for Web Wiz Forums and so support the full range of features including image/file uploading and URL rewriting. For more infor see the page below:-
http://www.webwiz.net/webhosting" rel="nofollow - http://www.webwiz.net/webhosting
The code you see in your posts is coursed by software injecting code into the pages you visit on the internet. I did a quick search and seams that the code you have is injected is by some Firefox Highlighter plugin.
------------- https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting
|
Posted By: rlens
Date Posted: 21 September 2009 at 1:43pm
Again, thank you SO MUCH for your help! I am going to review the information you sent with my husband and see where I go from there.
Again, you guys are the best!! XOX < id="gwProxy" ="">< ="jsCall;" id="jsProxy" ="">
|
Posted By: billd3
Date Posted: 21 September 2009 at 7:06pm
Huge advantages having your forum hosted with Webwiz:
Support is great. Speeds are great. We've had almost 0 for any sort of hiccups since changing (maybe it is 0, I can't remember). Who knows the forum software and its needs better??
It was sure a good move for us.
------------- BillD
http://theamcpages.com
http://theamcforum.com
|
Posted By: Scotty32
Date Posted: 22 September 2009 at 9:29pm
WebWiz-Bruce wrote:
Lots of hits on the site like search engines can slow things down and use up bandwidth. You can slow down the speed at which search engines crawl your website by creating a robots.txt file with the following:-
User-agent: googlebot Crawl-delay: 60
User-agent: yahoo Crawl-delay: 60
|
Lots of hits on the registration page suggest that your web site is under some type of automated attack either from spam bots trying to signup or some type of DoS attack.
|
I dont believe the Googlebot one works, as the Google Webmaster Centre always says that the line was ignored.
But you can slow down Googles crawlers by creating an account at http://www.google.co.uk/sitemaps" rel="nofollow - Google Sitemaps and adding your website. Theres an option to control the speed of the crawler
------------- S2H.co.uk - http://www.s2h.co.uk/wwf/" rel="nofollow - WebWiz Mods and Skins
For support on my mods + skins, please use http://www.s2h.co.uk/forum/" rel="nofollow - my forum .
|
|