Web Scraping News: November Monthly Recap

Jeremy Singer-Vine Tracks the Government, Not the Midterms

original source: cjr.org

Saving the economy
Saving the economy

In September Jeremy Singer-Vine, a data journalist and computer programmer in New York started the Data Liberation Project, which aims to create datasets from public government data not easily accessible, then clean it up and publish it for the benefit of reporters. As he states to cjr.org, this data “can be broadly useful regardless of what is happening right now in the news cycle.”

He asks an average of five Freedom of Information Act requests per month and at the same time, he uses web scraping to generate datasets from other public sources where data is not readily usable.

Continue reading