ASP.NET Discussion - extract data from a webpage??

Print Page | Close Window

extract data from a webpage??

Printed From: Web Wiz Forums
Category: General Discussion
Forum Name: ASP.NET Discussion
Forum Description: Discussion and chat on ASP.NET related topics.
URL: https://forums.webwiz.net/forum_posts.asp?TID=1065
Printed Date: 28 March 2026 at 4:08am
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com

Topic: extract data from a webpage??

Posted By: wancherng
Subject: extract data from a webpage??
Date Posted: 16 March 2003 at 11:59pm

Assume there are webpage-A and webpage-B.
Webpage-A contains a table of data which will be refreshed(or updated) every moment.
I would like to know how can I use VB.Net to write an ASP page to extract the data in real time so that I can use the data later in the Webpage-B?

Replies:

Posted By: ulfe
Date Posted: 26 March 2003 at 6:10am

Study the XMLHTTP object, with that you can grab all of the content from another page, and then you have to so some regexp or string manipulation to get to the data you need.

Posted By: karp13
Date Posted: 27 March 2003 at 6:14am

It is called "Screen Scraping" do a search for it on Google and you will find tons of info and examples.

Posted By: Bluefrog
Date Posted: 29 March 2003 at 8:21am

If it is on the same website, you don't need to do screen scraping - that's a lot of needless work in that case. If you can be a bit more specific about that it would help.

If you do need to do screen scraping in real time you'll end up consuming a lot of resources. Probably better just to update the results every so often (2 minutes, 5 minutes, 15 minutes).

And if you are doing screen scraping, depending on where you get your content, you may be liable for theft. Check on that first.

Posted By: wancherng
Date Posted: 30 March 2003 at 2:39am

both pages are in different websites. but because need the data to b stored in a database, so i decided to write a webrequest in VB.Net.

i just need the "table" part of the website. Do u guys know how can i start the code to extract the data??

hope u all can help,thanx in advance.

Posted By: ulfe
Date Posted: 30 March 2003 at 11:18am

http://www.123aspx.com/redir.aspx?res=28781 - http://www.123aspx.com/redir.aspx?res=28781

have a couple of articles, that should really get you going =)

Posted By: ravi
Date Posted: 02 April 2003 at 4:56am

Hi,

I know a great project for you: http://www.dbai.tuwien.ac.at/proj/lixto/ - http://www.dbai.tuwien.ac.at/proj/lixto/

This Visual Wrapper has received many awards and was written by some friends of mine at the TU-Wien.

Greets,
ravi
http://www.premotion.com - http://www.premotion.com