Dark Reading is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Risk

San Francisco Team Solves DARPA Shredder Challenge

Using custom algorithms, three programmers pieced together five shredded documents based on a common theme to win $50,000.

Obama's Tech Tools
(click image for larger view)
Slideshow: Obama's TechTools
Custom-code computer-vision algorithms helped a San Francisco-based team solve a challenge by the Defense Advanced Research Projects Agency (DARPA) to solve complex puzzles comprised of shredded documents.

Thirty-three days after DARPA unveiled the so-called Shredder Challenge, a team of three programmers called "All Your Shreds Are Belong to U.S." pieced together the five documents in the challenge, beating out nearly 9,000 other teams to claim the $50,000 prize.

The team spent nearly 600 hours creating algorithms to assemble the documents, which were shredded into more than 10,000 pieces. The team developed algorithms to suggest fragment pairings and then manually verified the pairings to piece together the documents--which in the end turned out to have a common theme (PDF).

[DARPA is trying a number of unusual tactics. Read DARPA Investigates Storytelling As Security Science..]

The theme running throughout the puzzles was Antonio Prohias, creator of a comic strip that debuted in Mad Magazine in 1961 called "Spy vs. Spy." The strip spawned a television show and other commercial paraphernalia.

Given the difficult nature of the challenges, DARPA organizers said they were surprised not only that all of the puzzles were solved, but at the relatively short time it took to solve them.

"Lots of experts were skeptical that a solution could be produced at all let alone within the short time frame," said Dan Kaufman, director, DARPA Information Innovation Office, in a press statement.

He said that the most effective approaches to solving the puzzles in the end were a combination of computational tools, crowd-sourcing, and "clever detective work."

"We are impressed by the ingenuity this type of competition elicits," Kaufman said.

DARPA introduced the challenge Oct . 27, with the goal of reassembling five shredded documents of increasing difficulty. The first two problems contained 224 and 373 pieces, respectively; puzzle three had 1,115 pieces; puzzle four had 2,340 pieces; and puzzle five had 6,068 pieces.

The practical aim of the challenge was to develop ways to reconstruct shredded documents that U.S. soldiers come across to use to gather intelligence information. The Department of Defense (DOD) also wants to try to figure out how enemies might be reassembling U.S. documents by crowdsourcing document unscrambling.

The Obama administration has turned to crowdsourcing and challenges to help the feds solve technological and other problems. The administration has even launched a website called Challenge.gov on which agencies can post challenges for people to solve for a range of cash prizes.

Our annual Federal Government IT Priorities Survey shows how agencies are managing the many mandates competing for their limited resources. Also in the new issue of InformationWeek Government: NASA veterans launch cloud startups, and U.S. Marshals Service completes tech revamp. Download the issue now. (Free registration required.)

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Stop Defending Everything
Kevin Kurzawa, Senior Information Security Auditor,  2/12/2020
Small Business Security: 5 Tips on How and Where to Start
Mike Puglia, Chief Strategy Officer at Kaseya,  2/13/2020
Architectural Analysis IDs 78 Specific Risks in Machine-Learning Systems
Jai Vijayan, Contributing Writer,  2/13/2020
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Current Issue
6 Emerging Cyber Threats That Enterprises Face in 2020
This Tech Digest gives an in-depth look at six emerging cyber threats that enterprises could face in 2020. Download your copy today!
Flash Poll
How Enterprises Are Developing and Maintaining Secure Applications
How Enterprises Are Developing and Maintaining Secure Applications
The concept of application security is well known, but application security testing and remediation processes remain unbalanced. Most organizations are confident in their approach to AppSec, although others seem to have no approach at all. Read this report to find out more.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2012-2412
PUBLISHED: 2020-02-17
** REJECT ** DO NOT USE THIS CANDIDATE NUMBER. ConsultIDs: CVE-2012-4531. Reason: This candidate is a duplicate of CVE-2012-4531. Notes: All CVE users should reference CVE-2012-4531 instead of this candidate. All references and descriptions in this candidate have been removed to prevent accidental u...
CVE-2014-4981
PUBLISHED: 2020-02-17
LPAR2RRD in 3.5 and earlier allows remote attackers to execute arbitrary commands due to insufficient input sanitization of the web GUI parameters.
CVE-2014-7236
PUBLISHED: 2020-02-17
Eval injection vulnerability in lib/TWiki/Plugins.pm in TWiki before 6.0.1 allows remote attackers to execute arbitrary Perl code via the debugenableplugins parameter to do/view/Main/WebHome.
CVE-2014-8089
PUBLISHED: 2020-02-17
SQL injection vulnerability in Zend Framework before 1.12.9, 2.2.x before 2.2.8, and 2.3.x before 2.3.3, when using the sqlsrv PHP extension, allows remote attackers to execute arbitrary SQL commands via a null byte.
CVE-2015-8751
PUBLISHED: 2020-02-17
Integer overflow in the jas_matrix_create function in JasPer allows context-dependent attackers to have unspecified impact via a crafted JPEG 2000 image, related to integer multiplication for memory allocation.