Text Data Mining

The web is an enormous repository of information. Unfortunately, the vast majority of it is only designed to be accessed by human beings through a web browser. screen-scraper allows for text data mining by crawling through web sites, automatically parsing HTML, revealing information you're interested in.

Once screen-scraper has mined text and data from a web page it can then save the information by writing it to a spreadsheet/CSV, plain text file, or even inserting it into a database.

Examples of using screen-scraper for text data mining include:

• Mining data that includes contact information for business customers
• Pulling product information from multiple web sites so that they can all be searched from your web site
• Extracting text news headlines to use in RSS feeds