Web Wiz Forums - ban Search Robot Unknown

Print Page | Close Window

ban Search Robot Unknown

Printed From: Web Wiz Forums
Category: Web Wiz Web App Support Forums
Forum Name: Web Wiz Forums
Forum Description: Support forum for Web Wiz Forums application.
URL: https://forums.webwiz.net/forum_posts.asp?TID=29870
Printed Date: 01 April 2026 at 5:47am
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com

Topic: ban Search Robot Unknown

Posted By: fooladi
Subject: ban Search Robot Unknown
Date Posted: 13 October 2011 at 10:15pm

how can i ban"Search Robot Unknown" user from indexing my site?
currently i do this by their IP. but their ip changed quickly.

Replies:

Posted By: WebWiz-Bruce
Date Posted: 14 October 2011 at 8:25am

Just because the search engine is listed as unknown does not mean it is bad as constantly updating Web Wiz Forums to identify these search engines.

For example the next release will have support to recognise Buidu which is a Chinese serach engine that is bigger than Google in China.

-------------
https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting
https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting

Posted By: fooladi
Date Posted: 14 October 2011 at 11:17am

thanks
I request help for this reasons:
1. limited in bandwidth and server performance
2. spam sites that steal web contents to show their advertisement.
3. website downloader programs.

disabling geust session is not good idea but I think if excessive activity of an ip or unknown robot detected then somehow force them to CAPTCHA page.
similar to flood control for sending messages.