|
screen-scraper contains a powerful proxy server that allows you to browse web sites and capture web pages in the background. Once recorded by the proxy server, you can then indicate which pages you're interested in mining data from.
Making use of screen-scraper's proxy server saves you from having to worry about details such as cookies, HTTP headers, and the structure of POST data. Unlike many other logging proxy servers, screen-scraper is also able to handle both HTTP and HTTPS/SSL transactions.
|
