Web Content Mining

The web is often referred to as the world's largest database. screen-scraper allows you to mine content from the web almost as if you were searching a database.

Just like you might search a SQL Server or mySQL database from your software, likewise you can interface your software with screen-scraper so that it mines the content you're interested in, then allows you to use that data in your own application. screen-scraper can be accessed from most modern programming languages, including Java, .NET, PHP, Visual Basic, Active Server Pages (ASP), and any language that can use SOAP.

Examples of using screen-scraper for web content mining include:

• Crawl a web site containing data such as product prices and descriptions that you want to mine
• Use content mined from financial web sites to make predictions about how data such as rates and quotes might change over time
• Automatically scrape data from various auto or car web sites so that listings can be searched from a single web site