Web Wiz - Green Windows Web Hosting
Web Wiz Homepage Search Web Wiz

  New Posts New Posts RSS Feed - ban Search Robot Unknown
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

ban Search Robot Unknown
 Post Reply Post Reply
Author
  Topic Search Topic Search  Topic Options Topic Options
fooladi View Drop Down
Groupie
Groupie


Joined: 21 July 2003
Status: Offline
Points: 60 		Post Options Post Options   Thanks (0) Thanks(0)   Quote fooladi Quote  Post ReplyReply Direct Link To This Post Topic: ban Search Robot Unknown
    Posted: 13 October 2011 at 10:15pm
how can i ban"Search Robot Unknown" user from indexing my site?
currently i do this by their IP. but their ip changed quickly.
Back to Top
WebWiz-Bruce View Drop Down
Admin Group
Admin Group
Avatar
Web Wiz Developer

Joined: 03 September 2001
Location: Bournemouth
Status: Offline
Points: 9844 		Post Options Post Options   Thanks (0) Thanks(0)   Quote WebWiz-Bruce Quote  Post ReplyReply Direct Link To This Post Posted: 14 October 2011 at 8:25am
Just because the search engine is listed as unknown does not mean it is bad as constantly updating Web Wiz Forums to identify these search engines.

For example the next release will have support to recognise Buidu which is a Chinese serach engine that is bigger than Google in China.
Web Wiz Forums Hosting
ASP.NET Web Hosting
Back to Top
fooladi View Drop Down
Groupie
Groupie


Joined: 21 July 2003
Status: Offline
Points: 60 		Post Options Post Options   Thanks (0) Thanks(0)   Quote fooladi Quote  Post ReplyReply Direct Link To This Post Posted: 14 October 2011 at 11:17am
thanks
I request help for this reasons:
1. limited in bandwidth and server performance
2. spam sites that steal web contents to show their advertisement.
3. website downloader programs.

disabling geust session is not good idea but I think if excessive activity of an ip  or unknown  robot  detected then somehow force them to CAPTCHA page.
similar to  flood control for sending messages.



Edited by fooladi - 14 October 2011 at 11:26am
Back to Top
 Post Reply Post Reply

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.08
Copyright ©2001-2026 Web Wiz Ltd.

Become a Fan on Facebook Follow us on X Connect with us on LinkedIn Web Wiz Blogs
About Web Wiz | Contact Web Wiz | Terms & Conditions | Cookies | Privacy Notice

Web Wiz is the trading name of Web Wiz Ltd. Company registration No. 05977755. Registered in England and Wales.
Registered office: Web Wiz Ltd, Unit 18, The Glenmore Centre, Fancy Road, Poole, Dorset, BH12 4FB, UK.

Prices exclude VAT at 20% unless otherwise stated. VAT No. GB988999105 - $, € prices shown as a guideline only.

Copyright ©2001-2026 Web Wiz Ltd. All rights reserved.