MediaCloud, a Berkman Center project, and StopBadware, a former Berkman Center project that has spun off as an independent organization, have each built systems to crawl websites and save the results ...

The Web serves as a vast, renewable resource for the most valuable thing in existence: data. However, getting useful data from the Web isn’t always an easy task. Luckily, there are a handful of open ...