Screen-Scaper - Capture the Web

Technology: Scripting Engine

  Next: Multiple Run Modes

click to view
who's using screen-scraper

When extracting information from web sites it's often necessary to use logic in traversing through pages, put mined data into a consistent format, or insert information into a database as it's being extracted. While scripts written in screen-scraper are generally simple, the scripting engine allows for an unlimited range of actions to be taken while scraping data and parsing HTML.

Scripts can be written in the following languages:

  • VBScript
  • JScript
  • Perl
  • JavaScript
  • Python
  • Java

screen-scraper also provides methods for facilitating actions such as:

  • Sending email
  • Automatically writing data to a CSV file
  • Downloading binary files such as images and PDF files
  • Debugging via breakpoints

If you don't have a lot of experience programming don't worry, scripts written in screen-scraper are typically few and simple. You can often use the examples we provide and simply alter them for your own needs.

  Next: Multiple Run Modes
Download screen-scraper here