Web Wiz - Green Windows Web Hosting - Celebrating 25 Years!
Web Wiz Homepage Search Web Wiz

  New Posts New Posts RSS Feed - where can I find a full Search Robot list
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

where can I find a full Search Robot list
 Post Reply Post Reply
Author
  Topic Search Topic Search  Topic Options Topic Options
Eran View Drop Down
Newbie
Newbie


Joined: 20 May 2005
Location: Israel
Status: Offline
Points: 5 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Eran Quote  Post ReplyReply Direct Link To This Post Topic: where can I find a full Search Robot list
    Posted: 31 May 2005 at 11:38am
I saw that the forum have a list using the Request.ServerVariables("HTTP_USER_AGENT").
From where can I find a full list of the Search Robots that I could identify them?
Back to Top
WebWiz-Bruce View Drop Down
Admin Group
Admin Group
Avatar
Web Wiz Developer

Joined: 03 September 2001
Location: Bournemouth
Status: Offline
Points: 9844 		Post Options Post Options   Thanks (0) Thanks(0)   Quote WebWiz-Bruce Quote  Post ReplyReply Direct Link To This Post Posted: 31 May 2005 at 4:18pm
I've not found anywhere yet that lists them all, it's a case of lots of research on google to track down various spiders and what their user agent ID is.
Web Wiz Forums Hosting
ASP.NET Web Hosting
Back to Top
Eran View Drop Down
Newbie
Newbie


Joined: 20 May 2005
Location: Israel
Status: Offline
Points: 5 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Eran Quote  Post ReplyReply Direct Link To This Post Posted: 01 June 2005 at 11:10am

bot the wwforum do have a small list of the main spiders..

I'm using that list but I know that it much bigger than that...
Back to Top
sfd19 View Drop Down
Senior Member
Senior Member


Joined: 20 December 2004
Status: Offline
Points: 263 		Post Options Post Options   Thanks (0) Thanks(0)   Quote sfd19 Quote  Post ReplyReply Direct Link To This Post Posted: 01 June 2005 at 12:51pm
Originally posted by Eran Eran wrote:

I saw that the forum have a list using the Request.ServerVariables("HTTP_USER_AGENT").
From where can I find a full list of the Search Robots that I could identify them?


http://www.google.com/search?q=spiders+user+agents&meta=

http://www.psychedelix.com/agents1.html
Politics, economy & social issues: StudentsforDemocracy.net
Back to Top
 Post Reply Post Reply

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.08
Copyright ©2001-2026 Web Wiz Ltd.

Become a Fan on Facebook Follow us on X Connect with us on LinkedIn Web Wiz Blogs
About Web Wiz | Contact Web Wiz | Terms & Conditions | Cookies | Privacy Notice

Web Wiz is the trading name of Web Wiz Ltd. Company registration No. 05977755. Registered in England and Wales.
Registered office: Web Wiz Ltd, Unit 18, The Glenmore Centre, Fancy Road, Poole, Dorset, BH12 4FB, UK.

Prices exclude VAT at 20% unless otherwise stated. VAT No. GB988999105 - $, € prices shown as a guideline only.

Copyright ©2001-2026 Web Wiz Ltd. All rights reserved.