|
Scraping web sites for information of value can be done automatically by screen-scraper. Once you set up screen-scraper for a specific site it can crawl through the web pages, extracting out data such as stock quotes, mortgage rates, or travel itineraries.
A common use case for screen-scraper is to set it up to scrape multiple web sites for information, insert that information into a database, then allow it to be searched via a web interface. This is commonly known as "meta-searching", and is probably the most common use for screen-scraper. screen-scraper can mine sites for data either on-demand (e.g., right when the user submits a search form) or on a scheduled basis.
|
