Thoughts, tips, and updates on screen-scraping
Todd Wilson This one contains several changes: Including a UseGlobalExternalProxyForAllScrapingSessions property in the screen-scraper.properties file will now cause global proxy settings to apply to all scraping sessions. Fixed a minor bug related to invalid extractor pattern token names. Undo in certain text boxes can now be triggered properly via keyboard shortcut on a Mac. Now notifying the … Read moreVersion 5.0.37a of screen-scraper Released
A few months ago we announced a drop in the price of our anonymization service for those using the latest alpha versions of screen-scraper. Unfortunately, things didn’t work out with this quite as we had planned, so, for the time being, we’re returning to our previous price of 25 cents per server per hour. For … Read moreAnonymization Service Price Change
Just fixed a minor bug related to cookie handling that resulted from the recent upgrade to the proxy.
In this release we’ve updated screen-scraper’s proxy server to use HttpClient version 4. HttpClient is one of the core libraries used by screen-scraper, and this upgrade should result in increased efficiency, as well as a bit of functionality we wouldn’t have without it. It’s likely that we’ll still need to work some kinks out related … Read moreVersion 5.0.35a of screen-scraper Released
Just a couple of minor changes in this one: Token editor now saves and closes when the return key is hit. Fixed a bug related to finding script instances. Full details in the Alpha Change Log.
Just a small fix in this one: Fixed a bug related to selecting extractor pattern tokens. Check the Alpha Log for details on other changes.
Just a few fixes in this one: Fixed a bug related to editing extractor pattern tokens. Fixed a bug related to highlighting of data records in the last response tab. Optimized highlighting of data records in the last response tab. As always, see the Alpha Change Log for the full list of changes since 5.0.
This release contains just one feature enhancement: when creating a new extractor pattern token screen-scraper will now attempt to guess the regular expression that should be used. Based on initial testing, screen-scraper seems to be able to correctly guess most of the time. This is a small feature, but will hopefully save a fair amount … Read moreVersion 5.0.30a of screen-scraper Released
Changes in this release: Fixed a bug on Mac OS X where an overwrite prompt was not being given in exporting scraping sessions. Fixed a message formatting issue in certain script errors. Fixed an issue with anonymous proxies being terminated externally. You can view a cumulative list of changes since 5.0 on our Change Log … Read moreVersion 5.0.29a of screen-scraper Released
One of the main aspects that I think differentiates screen-scraper from many other solutions is its ability to handle large-scale scraping needs. Additionally, it was designed from the ground up to integrate with other systems, so it generally fits nicely into most any existing setup. If you’re doing a simple one-off data extraction project screen-scraper … Read moreEnterprise-Scale Screen-Scraping