Dark Reading is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Risk

San Francisco Team Solves DARPA Shredder Challenge

Using custom algorithms, three programmers pieced together five shredded documents based on a common theme to win $50,000.

Obama's Tech Tools
(click image for larger view)
Slideshow: Obama's TechTools
Custom-code computer-vision algorithms helped a San Francisco-based team solve a challenge by the Defense Advanced Research Projects Agency (DARPA) to solve complex puzzles comprised of shredded documents.

Thirty-three days after DARPA unveiled the so-called Shredder Challenge, a team of three programmers called "All Your Shreds Are Belong to U.S." pieced together the five documents in the challenge, beating out nearly 9,000 other teams to claim the $50,000 prize.

The team spent nearly 600 hours creating algorithms to assemble the documents, which were shredded into more than 10,000 pieces. The team developed algorithms to suggest fragment pairings and then manually verified the pairings to piece together the documents--which in the end turned out to have a common theme (PDF).

[DARPA is trying a number of unusual tactics. Read DARPA Investigates Storytelling As Security Science..]

The theme running throughout the puzzles was Antonio Prohias, creator of a comic strip that debuted in Mad Magazine in 1961 called "Spy vs. Spy." The strip spawned a television show and other commercial paraphernalia.

Given the difficult nature of the challenges, DARPA organizers said they were surprised not only that all of the puzzles were solved, but at the relatively short time it took to solve them.

"Lots of experts were skeptical that a solution could be produced at all let alone within the short time frame," said Dan Kaufman, director, DARPA Information Innovation Office, in a press statement.

He said that the most effective approaches to solving the puzzles in the end were a combination of computational tools, crowd-sourcing, and "clever detective work."

"We are impressed by the ingenuity this type of competition elicits," Kaufman said.

DARPA introduced the challenge Oct . 27, with the goal of reassembling five shredded documents of increasing difficulty. The first two problems contained 224 and 373 pieces, respectively; puzzle three had 1,115 pieces; puzzle four had 2,340 pieces; and puzzle five had 6,068 pieces.

The practical aim of the challenge was to develop ways to reconstruct shredded documents that U.S. soldiers come across to use to gather intelligence information. The Department of Defense (DOD) also wants to try to figure out how enemies might be reassembling U.S. documents by crowdsourcing document unscrambling.

The Obama administration has turned to crowdsourcing and challenges to help the feds solve technological and other problems. The administration has even launched a website called Challenge.gov on which agencies can post challenges for people to solve for a range of cash prizes.

Our annual Federal Government IT Priorities Survey shows how agencies are managing the many mandates competing for their limited resources. Also in the new issue of InformationWeek Government: NASA veterans launch cloud startups, and U.S. Marshals Service completes tech revamp. Download the issue now. (Free registration required.)

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
I 'Hacked' My Accounts Using My Mobile Number: Here's What I Learned
Nicole Sette, Director in the Cyber Risk practice of Kroll, a division of Duff & Phelps,  11/19/2019
DevSecOps: The Answer to the Cloud Security Skills Gap
Lamont Orange, Chief Information Security Officer at Netskope,  11/15/2019
Attackers' Costs Increasing as Businesses Focus on Security
Robert Lemos, Contributing Writer,  11/15/2019
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Current Issue
Navigating the Deluge of Security Data
In this Tech Digest, Dark Reading shares the experiences of some top security practitioners as they navigate volumes of security data. We examine some examples of how enterprises can cull this data to find the clues they need.
Flash Poll
Rethinking Enterprise Data Defense
Rethinking Enterprise Data Defense
Frustrated with recurring intrusions and breaches, cybersecurity professionals are questioning some of the industrys conventional wisdom. Heres a look at what theyre thinking about.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2019-13157
PUBLISHED: 2019-11-22
nsGreen.dll in Naver Vaccine 2.1.4 allows remote attackers to overwrite arbitary files via directory traversal sequences in a filename within nsz archive.
CVE-2012-2079
PUBLISHED: 2019-11-22
A cross-site request forgery (CSRF) vulnerability in the Activity module 6.x-1.x for Drupal.
CVE-2019-11325
PUBLISHED: 2019-11-21
An issue was discovered in Symfony before 4.2.12 and 4.3.x before 4.3.8. The VarExport component incorrectly escapes strings, allowing some specially crafted ones to escalate to execution of arbitrary PHP code. This is related to symfony/var-exporter.
CVE-2019-18887
PUBLISHED: 2019-11-21
An issue was discovered in Symfony 2.8.0 through 2.8.50, 3.4.0 through 3.4.34, 4.2.0 through 4.2.11, and 4.3.0 through 4.3.7. The UriSigner was subject to timing attacks. This is related to symfony/http-kernel.
CVE-2019-18888
PUBLISHED: 2019-11-21
An issue was discovered in Symfony 2.8.0 through 2.8.50, 3.4.0 through 3.4.34, 4.2.0 through 4.2.11, and 4.3.0 through 4.3.7. If an application passes unvalidated user input as the file for which MIME type validation should occur, then arbitrary arguments are passed to the underlying file command. T...