Web Developer needed
Printed From: Web Wiz Forums
Category: General Discussion
Forum Name: General Discussion
Forum Description: General discussion and chat on any topic.
URL: https://forums.webwiz.net/forum_posts.asp?TID=13310
Printed Date: 28 March 2026 at 6:50pm
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com
Topic: Web Developer needed
Posted By: NPRI
Subject: Web Developer needed
Date Posted: 11 January 2005 at 7:03am
|
Hi all,
I think this is the right place to post this, but here goes anyway.
I am looking for a web developer to build and deploy an internet search engine with a meta & link following spider. I am currently using the Web Wiz Internet Search Engine but if anyone can think of a way of it so that the spider would populate the database then I would really love to hear from you.
Currently our servers can run PHP and ASP, however we cannot run Mysql.
There is one snagg. As the search engine is for a non-profit group we can afford no cost, however we would be more than willing to place the developers advert on the site for the entire life of the engine.
If you are interested in this project please either PM me or contact me through our website that is in my profile.
Regards, Neal |
Replies:
Posted By: huwnet
Date Posted: 11 January 2005 at 11:46am
| I recommend you find a site listing developers. However if you are a charity why do you need you on Search Engine? Why not use the Google API? Do you know how much space you will need for a proper search engine? You cannot run it off Access and you don't have MySQL so you will have to run MSSQL. |
Posted By: Gullanian
Date Posted: 11 January 2005 at 11:49am
| Depends if your planning on indexing pages of specific types or the entire Internet |
Posted By: michael
Date Posted: 11 January 2005 at 2:10pm
|
If you look at the website in the profile it is just for some paranormal sites, so no charity but some free work for nothing. You may find someone interested in helping you if he is into that kinda stuff... ------------- http://baumannphoto.com" rel="nofollow - Blog | http://mpgtracker.com" rel="nofollow - MPG Tracker |
Posted By: dpyers
Date Posted: 11 January 2005 at 2:38pm
|
One of the MS Front Page server extensions is a search engine. It's the only FP extension that actually has any value.
Hint... Put your meta tags in the head section of your page, not external to the html. ------------- 
Lead me not into temptation... I know the short cut, follow me. |
Posted By: NPRI
Date Posted: 11 January 2005 at 3:35pm
|
Hi guys,
Thanks for your comments. As stated by Michael we are a paranormal group not a charity. The engine I would like would just be for paranormal related sites. Please excuse me for being ignorant but what is this google API? As I am sure you can guess I dont really know to much about this type of thing
 but im willing to learn.The problem with MS front page extensions is the cost, as we have no money to play with at all on this one I was wondering if anyone would like to help me out, prahaps someone who is looking to add to there portfolio. All the best,
Neal
|
Posted By: Mart
Date Posted: 11 January 2005 at 4:17pm
| I doubt anyone would help if they do not get something out of it in one way or another. |
Posted By: dpyers
Date Posted: 11 January 2005 at 4:25pm
|
Gogle has a search box you can embed into a web page on your site. It has radio options to select either "Search This Site" or "Search The Web" -------------
Lead me not into temptation... I know the short cut, follow me. |
Posted By: NPRI
Date Posted: 11 January 2005 at 6:55pm
|
Thanks for that. I have looked into the Google option but have decided that that isnt the way to go as there are way to many commercial sites on there. The whole reason for setting up the paranormal search engine was so that the visitors will get 100% relevent search results.
I have been checking out my servers and apparently I can have Mysql installed.
I know that this is a long shot but as my good ol mum always says "If you dont ask you dont get"
|
Posted By: Gullanian
Date Posted: 11 January 2005 at 8:33pm
|
You might find a developer to help with small things for free, but as I
understand writting a web crawler that parses out all relevant
information is pretty difficult and resource consuming. |
Posted By: dpyers
Date Posted: 11 January 2005 at 11:58pm
|
Actually, writing a web crawler isn't a big thing. I've done them in perl, c++ and java. The perl one was a dog though as they really need to be multi-threaded and that wasn't an option at the time. IIRC, I wrote the java one as part of a java 101 type exercise in threading.
You could probably do a .net one if you can handle the web server timeout issue. My java crawler ran through an app server, not a web server and the pearl and c++ ones hit outbound tcp ports directly, didn't go through a web or an app server.
The issue isn't so much one of crawling pages, but what do you do with the data on those pages. What words and phrases do you extract? How do you id content instead of something like java script. Do you ignore meta tags? Comments? Finally, how do you rationalize the data into a db that allows you the ability to scan it fast with some degree of relevance to the search term. -------------
Lead me not into temptation... I know the short cut, follow me. |
Posted By: Phat
Date Posted: 12 January 2005 at 5:37am
| In other words just use google. |
Posted By: Gullanian
Date Posted: 12 January 2005 at 8:55am
I think you missunderstood me  I said that writting one that parses information is difficult 
|
Posted By: dpyers
Date Posted: 12 January 2005 at 9:18am
 -------------
Lead me not into temptation... I know the short cut, follow me. |
Posted By: Bluefrog
Date Posted: 12 January 2005 at 10:58am
Not difficult if you are really lazy and only return crap results. Rocket Science if you return relevant results... 3 expensive technologies: Search, Compression, Encryption. Those core things are all very difficult and not within the scope of a single developer. They require large teams to come up with something good, or a LOT of time. ------------- http://renegademinds.com/" rel="nofollow - Renegade Minds - Guitar Software http://renegademinds.com/Default.aspx?tabid=65" rel="nofollow - Slow Down Music |
Gullanian wrote:Posted By: NPRI
Date Posted: 12 January 2005 at 11:52am
|
Hi guys,
Thanks for all your input on this. I guess I had better qualify this a bit more. The sider is needed to index meta tags and links on the spidered sites. The ranking system does not have to be too far fetched, my idea was to have it rank pages by keywords in the meta tags and by the ammount of internal and external links, however if this is too much then ranking just by the keywords in the meta tags will do just fine.
All the best,
Neal
|
Posted By: Gullanian
Date Posted: 12 January 2005 at 1:29pm
| How about do it with meta tags only, but order results by user ratings of the websites provided in the search results. |
Posted By: NPRI
Date Posted: 12 January 2005 at 1:45pm
|
Yeah I guess thats an option but in a way that would defeat the object of the porject. In an ideal world I would like it to only rank sites that have a set list of keywords such as: paranormal, ghosts...ect then move on to external sites and index them so that the database is semi self populating.
What do you honestly think my chances are of finding a developer that will do this for free? If you think that I have next to no chance, then do you know where I could learn how to do this my self?
Thanks for all your help on this subject guys.
Neal
|
Posted By: Gullanian
Date Posted: 13 January 2005 at 10:17am
|
Seeming as they probably will have to start from scratch and won't get
paid it unfortunatly probably is next to nothing. Maybe perhaps
you could start it off as an open source project and see if anyone is
willing to join? w3schools.com is a good place to learn ASP. |
Posted By: NPRI
Date Posted: 13 January 2005 at 1:33pm
| OK thanks for that, I will take a look. |