Print Page | Close Window

ban Search Robot Unknown

Printed From: Web Wiz Forums
Category: Web Wiz Web App Support Forums
Forum Name: Web Wiz Forums
Forum Description: Support forum for Web Wiz Forums application.
URL: https://forums.webwiz.net/forum_posts.asp?TID=29870
Printed Date: 01 April 2026 at 5:47am
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com


Topic: ban Search Robot Unknown
Posted By: fooladi
Subject: ban Search Robot Unknown
Date Posted: 13 October 2011 at 10:15pm
how can i ban"Search Robot Unknown" user from indexing my site?
currently i do this by their IP. but their ip changed quickly.



Replies:
Posted By: WebWiz-Bruce
Date Posted: 14 October 2011 at 8:25am
Just because the search engine is listed as unknown does not mean it is bad as constantly updating Web Wiz Forums to identify these search engines.

For example the next release will have support to recognise Buidu which is a Chinese serach engine that is bigger than Google in China.


-------------
https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting
https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting


Posted By: fooladi
Date Posted: 14 October 2011 at 11:17am
thanks
I request help for this reasons:
1. limited in bandwidth and server performance
2. spam sites that steal web contents to show their advertisement.
3. website downloader programs.

disabling geust session is not good idea but I think if excessive activity of an ip  or unknown  robot  detected then somehow force them to CAPTCHA page.
similar to  flood control for sending messages.




Print Page | Close Window

Forum Software by Web Wiz Forums® version 12.08 - https://www.webwizforums.com
Copyright ©2001-2026 Web Wiz Ltd. - https://www.webwiz.net