Dark Reading is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Risk

San Francisco Team Solves DARPA Shredder Challenge

Using custom algorithms, three programmers pieced together five shredded documents based on a common theme to win $50,000.

Obama's Tech Tools
(click image for larger view)
Slideshow: Obama's TechTools
Custom-code computer-vision algorithms helped a San Francisco-based team solve a challenge by the Defense Advanced Research Projects Agency (DARPA) to solve complex puzzles comprised of shredded documents.

Thirty-three days after DARPA unveiled the so-called Shredder Challenge, a team of three programmers called "All Your Shreds Are Belong to U.S." pieced together the five documents in the challenge, beating out nearly 9,000 other teams to claim the $50,000 prize.

The team spent nearly 600 hours creating algorithms to assemble the documents, which were shredded into more than 10,000 pieces. The team developed algorithms to suggest fragment pairings and then manually verified the pairings to piece together the documents--which in the end turned out to have a common theme (PDF).

[DARPA is trying a number of unusual tactics. Read DARPA Investigates Storytelling As Security Science..]

The theme running throughout the puzzles was Antonio Prohias, creator of a comic strip that debuted in Mad Magazine in 1961 called "Spy vs. Spy." The strip spawned a television show and other commercial paraphernalia.

Given the difficult nature of the challenges, DARPA organizers said they were surprised not only that all of the puzzles were solved, but at the relatively short time it took to solve them.

"Lots of experts were skeptical that a solution could be produced at all let alone within the short time frame," said Dan Kaufman, director, DARPA Information Innovation Office, in a press statement.

He said that the most effective approaches to solving the puzzles in the end were a combination of computational tools, crowd-sourcing, and "clever detective work."

"We are impressed by the ingenuity this type of competition elicits," Kaufman said.

DARPA introduced the challenge Oct . 27, with the goal of reassembling five shredded documents of increasing difficulty. The first two problems contained 224 and 373 pieces, respectively; puzzle three had 1,115 pieces; puzzle four had 2,340 pieces; and puzzle five had 6,068 pieces.

The practical aim of the challenge was to develop ways to reconstruct shredded documents that U.S. soldiers come across to use to gather intelligence information. The Department of Defense (DOD) also wants to try to figure out how enemies might be reassembling U.S. documents by crowdsourcing document unscrambling.

The Obama administration has turned to crowdsourcing and challenges to help the feds solve technological and other problems. The administration has even launched a website called Challenge.gov on which agencies can post challenges for people to solve for a range of cash prizes.

Our annual Federal Government IT Priorities Survey shows how agencies are managing the many mandates competing for their limited resources. Also in the new issue of InformationWeek Government: NASA veterans launch cloud startups, and U.S. Marshals Service completes tech revamp. Download the issue now. (Free registration required.)

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
AI Is Everywhere, but Don't Ignore the Basics
Howie Xu, Vice President of AI and Machine Learning at Zscaler,  9/10/2019
Fed Kaspersky Ban Made Permanent by New Rules
Dark Reading Staff 9/11/2019
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Current Issue
7 Threats & Disruptive Forces Changing the Face of Cybersecurity
This Dark Reading Tech Digest gives an in-depth look at the biggest emerging threats and disruptive forces that are changing the face of cybersecurity today.
Flash Poll
The State of IT Operations and Cybersecurity Operations
The State of IT Operations and Cybersecurity Operations
Your enterprise's cyber risk may depend upon the relationship between the IT team and the security team. Heres some insight on what's working and what isn't in the data center.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2019-4147
PUBLISHED: 2019-09-16
IBM Sterling File Gateway 2.2.0.0 through 6.0.1.0 is vulnerable to SQL injection. A remote attacker could send specially-crafted SQL statements, which could allow the attacker to view, add, modify or delete information in the back-end database. IBM X-Force ID: 158413.
CVE-2019-5481
PUBLISHED: 2019-09-16
Double-free vulnerability in the FTP-kerberos code in cURL 7.52.0 to 7.65.3.
CVE-2019-5482
PUBLISHED: 2019-09-16
Heap buffer overflow in the TFTP protocol handler in cURL 7.19.4 to 7.65.3.
CVE-2019-15741
PUBLISHED: 2019-09-16
An issue was discovered in GitLab Omnibus 7.4 through 12.2.1. An unsafe interaction with logrotate could result in a privilege escalation
CVE-2019-16370
PUBLISHED: 2019-09-16
The PGP signing plugin in Gradle before 6.0 relies on the SHA-1 algorithm, which might allow an attacker to replace an artifact with a different one that has the same SHA-1 message digest, a related issue to CVE-2005-4900.