Web Wiz - Green Windows Web Hosting
Web Wiz Homepage Search Web Wiz

  New Posts New Posts RSS Feed - extract data from a webpage??
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

extract data from a webpage??
 Post Reply Post Reply
Author
  Topic Search Topic Search  Topic Options Topic Options
wancherng View Drop Down
Newbie
Newbie
Avatar

Joined: 16 March 2003
Status: Offline
Points: 8 		Post Options Post Options   Thanks (0) Thanks(0)   Quote wancherng Quote  Post ReplyReply Direct Link To This Post Topic: extract data from a webpage??
    Posted: 16 March 2003 at 11:59pm
Assume there are webpage-A and webpage-B.
Webpage-A contains a table of data which will be refreshed(or updated) every moment.
I would like to know how can I use VB.Net to write an ASP page to extract the data in real time so that I can use the data later in the Webpage-B?
Back to Top
ulfe View Drop Down
Senior Member
Senior Member


Joined: 25 September 2001
Location: Sweden
Status: Offline
Points: 332 		Post Options Post Options   Thanks (0) Thanks(0)   Quote ulfe Quote  Post ReplyReply Direct Link To This Post Posted: 26 March 2003 at 6:10am
Study the XMLHTTP object, with that you can grab all of the content from another page, and then you have to so some regexp or string manipulation to get to the data you need.
Back to Top
karp13 View Drop Down
Groupie
Groupie
Avatar

Joined: 03 January 2002
Location: United States
Status: Offline
Points: 152 		Post Options Post Options   Thanks (0) Thanks(0)   Quote karp13 Quote  Post ReplyReply Direct Link To This Post Posted: 27 March 2003 at 6:14am
It is called "Screen Scraping"  do a search for it on Google and you will find tons of info and examples.
Back to Top
Bluefrog View Drop Down
Senior Member
Senior Member


Joined: 23 October 2002
Location: Korea, South
Status: Offline
Points: 1701 		Post Options Post Options   Thanks (0) Thanks(0)   Quote Bluefrog Quote  Post ReplyReply Direct Link To This Post Posted: 29 March 2003 at 8:21am

If it is on the same website, you don't need to do screen scraping  - that's a lot of needless work in that case. If you can be a bit more specific about that it would help.

If you do need to do screen scraping in real time you'll end up consuming a lot of resources. Probably better just to update the results every so often (2 minutes, 5 minutes, 15 minutes).

And if you are doing screen scraping, depending on where you get your content, you may be liable for theft. Check on that first.

 
Back to Top
wancherng View Drop Down
Newbie
Newbie
Avatar

Joined: 16 March 2003
Status: Offline
Points: 8 		Post Options Post Options   Thanks (0) Thanks(0)   Quote wancherng Quote  Post ReplyReply Direct Link To This Post Posted: 30 March 2003 at 2:39am

both pages are in different websites. but because need the data to b stored in a database, so i decided to write a webrequest in VB.Net.

i just need the "table" part of the website. Do u guys know how can i start the code to extract the data??

hope u all can help,thanx in advance.
Back to Top
ulfe View Drop Down
Senior Member
Senior Member


Joined: 25 September 2001
Location: Sweden
Status: Offline
Points: 332 		Post Options Post Options   Thanks (0) Thanks(0)   Quote ulfe Quote  Post ReplyReply Direct Link To This Post Posted: 30 March 2003 at 11:18am

http://www.123aspx.com/redir.aspx?res=28781

have a couple of articles, that should really get you going =)
Back to Top
ravi View Drop Down
Newbie
Newbie


Joined: 02 April 2003
Status: Offline
Points: 2 		Post Options Post Options   Thanks (0) Thanks(0)   Quote ravi Quote  Post ReplyReply Direct Link To This Post Posted: 02 April 2003 at 4:56am

Hi,

I know a great project for you: http://www.dbai.tuwien.ac.at/proj/lixto/

This Visual Wrapper has received many awards and was written by some friends of mine at the TU-Wien.

Greets,
ravi
http://www.premotion.com
Back to Top
 Post Reply Post Reply

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.08
Copyright ©2001-2026 Web Wiz Ltd.

Become a Fan on Facebook Follow us on X Connect with us on LinkedIn Web Wiz Blogs
About Web Wiz | Contact Web Wiz | Terms & Conditions | Cookies | Privacy Notice

Web Wiz is the trading name of Web Wiz Ltd. Company registration No. 05977755. Registered in England and Wales.
Registered office: Web Wiz Ltd, Unit 18, The Glenmore Centre, Fancy Road, Poole, Dorset, BH12 4FB, UK.

Prices exclude VAT at 20% unless otherwise stated. VAT No. GB988999105 - $, € prices shown as a guideline only.

Copyright ©2001-2026 Web Wiz Ltd. All rights reserved.