Hadoop Wins Converts Outside Silicon Valley

Open-source Hadoop has spread far from its Silicon Valley roots

Two years ago, when the Detroit Crime Commission began collecting and analyzing the social media posts of suspected criminals, it found Excel wasn’t up to the task. The 11-person agency began using Hadoop, a software suite developed in the early 2000s to help Web giants such as Google and Yahoo! store and analyze mountains of data. “Several million pieces of content is a lot and cannot easily be analyzed within any Excel spreadsheet, so we needed to do something a lot more robust,” says Lyle Dungy, director for intelligence at the Detroit Crime Commission. The software has already helped reveal a relationship between two suspected criminal organizations. “There’s so much digital evidence that’s out there. Most agencies are not exploiting it,” says Dungy.

To continue reading this article you must be a Bloomberg Professional Service Subscriber.