Scrutinizing what you scrape: How The New York Times investigated arbitration

A graphic from The New York Times’ arbitration series Court records have long been a vital tool for journalists looking to hold powerful corporations accountable. But what happens when disputes between companies and consumers move out of open court and into private meeting rooms? What happens when class action lawsuits – and the wealth of…

Read more »

Learn to write code, build a web scraper at our September workshop

IRE and the University of Missouri Journalism School are offering a special workshop Sept. 4-7 that will introduce the basics of newsroom programming by teaching how to build one of the simplest but most useful tools in a data journalist’s toolbox: a web scraper designed to automate the downloading of data. The workshop will also…

Read more »

One-on-one mentoring deadline ends May 21

Don’t miss your chance to meet with an experienced pro in Boston at the 2012 IRE Conference. This is an opportunity for in-depth, one-on-one coaching on investigative reporting. These private sessions allow attendees to seek advice on challenging stories or followup ideas. You must have registered for the conference and have signed up for a…

Read more »

Learning to liberate data

By Anna [email protected] Syntax error. What does this bit of code do? Syntax error. Let’s go back to the source. Syntax error. Maybe try this? After two hours of educated guesses, trial, error and some friendly help, Pam Dempsey, of cu-citizenaccess.org, and I had finally scraped our first bit of text: the word “2011” from a page of…

Read more »