| Author |
 Topic Search  Topic Options
|
rlens 
Newbie
Joined: 25 May 2009
Status: Offline
Points: 14
|
 Post Options
 Thanks(0)
 Quote  Reply
 Topic: Do Search Engine Bots slow my site down
Posted: 18 September 2009 at 7:40pm |
|
Hi, I have an information site www.screamingmouse.com, and it takes forever to get on. Just today my site was taken off a server and it was found that every other website on the same server (many with even more info than mine + pics), worked incredibly fast afterwards! One thing that I have noticed is that I am getting a lot of visitors with IP addresses from other countries that seem "stuck" at trying to register - are those spammers? Also, I usually have anywhere from 2 to 4 search engine bots from MSN or GOOGLE... searching my site at the same time... especially on the Calendar... does this sound right?
Is something that I can do to speed up my website... I think I read here that there were codes to stop bots in some parts of the website???
Please help, I value your advice. :)
Edited by rlens - 18 September 2009 at 9:04pm
|
 |
WebWiz-Bruce
Admin Group
Web Wiz Developer
Joined: 03 September 2001
Location: Bournemouth
Status: Offline
Points: 9844
|
Post Options
Thanks(0)
Quote Reply
Posted: 21 September 2009 at 12:11pm |
Lots of hits on the site like search engines can slow things down and use up bandwidth. You can slow down the speed at which search engines crawl your website by creating a robots.txt file with the following:-
User-agent: googlebot
Crawl-delay: 60
User-agent: yahoo
Crawl-delay: 60
|
Lots of hits on the registration page suggest that your web site is under some type of automated attack either from spam bots trying to signup or some type of DoS attack.
|
|
|
|
rlens
Newbie
Joined: 25 May 2009
Status: Offline
Points: 14
|
Post Options
Thanks(0)
Quote Reply
Posted: 21 September 2009 at 1:27pm |
Thank You! You're the best! Now if I need to find another server and have this problem fixed, is this something you can facilitate? If so, could you send me the details and prices? Thanks again :) < id="gwProxy" ="">< ="jsCall;" id="jsProxy" ="">
|
|
rlens
Newbie
Joined: 25 May 2009
Status: Offline
Points: 14
|
Post Options
Thanks(0)
Quote Reply
Posted: 21 September 2009 at 1:30pm |
|
Also, what in the world is that "code" looking thing that ends up after
all of my posts??? This is the first time I've seen it anywhere but on
my site! To post without it I usually have to copy what I'm trying to
post, "clear form", then paste it back into the box and submit.
Whew!
|
|
WebWiz-Bruce
Admin Group
Web Wiz Developer
Joined: 03 September 2001
Location: Bournemouth
Status: Offline
Points: 9844
|
Post Options
Thanks(0)
Quote Reply
Posted: 21 September 2009 at 1:37pm |
Yes we can host your website and/or forum for you on our own network and servers. These servers are specially setup for Web Wiz Forums and so support the full range of features including image/file uploading and URL rewriting. For more infor see the page below:- http://www.webwiz.net/webhostingThe code you see in your posts is coursed by software injecting code into the pages you visit on the internet. I did a quick search and seams that the code you have is injected is by some Firefox Highlighter plugin.
|
|
|
|
rlens
Newbie
Joined: 25 May 2009
Status: Offline
Points: 14
|
Post Options
Thanks(0)
Quote Reply
Posted: 21 September 2009 at 1:43pm |
Again, thank you SO MUCH for your help! I am going to review the information you sent with my husband and see where I go from there. Again, you guys are the best!! XOX < id="gwProxy" ="">< ="jsCall;" id="jsProxy" ="">
|
|
billd3
Senior Member
Joined: 19 February 2003
Location: United States
Status: Offline
Points: 530
|
Post Options
Thanks(0)
Quote Reply
Posted: 21 September 2009 at 7:06pm |
|
Huge advantages having your forum hosted with Webwiz:
Support is great.
Speeds are great.
We've had almost 0 for any sort of hiccups since changing (maybe it is 0, I can't remember).
Who knows the forum software and its needs better??
It was sure a good move for us.
|
|
BillD
http://theamcpages.com
http://theamcforum.com
|
|
Scotty32
Moderator Group
Joined: 30 November 2002
Location: Manchester, UK
Status: Offline
Points: 1682
|
Post Options
Thanks(0)
Quote Reply
Posted: 22 September 2009 at 9:29pm |
 WebWiz-Bruce wrote:
Lots of hits on the site like search engines can slow things down and use up bandwidth. You can slow down the speed at which search engines crawl your website by creating a robots.txt file with the following:-
User-agent: googlebot
Crawl-delay: 60
User-agent: yahoo
Crawl-delay: 60
|
Lots of hits on the registration page suggest that your web site is under some type of automated attack either from spam bots trying to signup or some type of DoS attack.
|
I dont believe the Googlebot one works, as the Google Webmaster Centre always says that the line was ignored. But you can slow down Googles crawlers by creating an account at Google Sitemaps and adding your website. Theres an option to control the speed of the crawler
|
|
|
|
