Dark Reading is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.


05:00 PM
Connect Directly

Lessons Learned In San Francisco Hack Job

An IT administrator with the city of San Francisco is alleged to have created a private administrative account on systems within the city's FiberWAN project.

At one time or another, it happens in almost every IT shop: A handful of people, or even one person, has the sole responsibility for and knowledge of critical systems. So much so that if any one of them were hit by a bus, your IT department would be severely hampered. Virtually every IT manager recognizes this problem, but far fewer do anything about it. San Francisco is now learning its lesson the hard way.

Terry Childs, an IT administrator with the city of San Francisco, whom the city had tried to fire in recent months, is alleged to have created a private administrative account on systems within the city's FiberWAN project. According to prosecutors, he's keeping the password a secret. In so doing, he's locked everyone else out of the system's networking gear and landed himself in jail, with bail set at $5 million. The city is trying to regain access to its network and has brought in experts from Cisco to help break into the compromised systems. The details are murky but also not vital to learning from this painful incident. Simply put, a trusted employee is accused of using that trust to hose his employer.

Organizations must trust employees to act honestly and ethically while at the same time acknowledge that employees pose one of the greatest threats. Employees must have access to systems, and that means they can do damage. InformationWeek's 2008 Strategic Security study found that 53% of respondents considered authorized users/employees one of the greatest threats, and 48% of respondents considered all employees one of the greatest threats. While most employees are ethical, all it takes is one disgruntled person to cause you headache and misery.

No technology or process can fully stop an insider, especially a knowledgeable insider like Childs, from causing harm--but what can be managed, and what's shocking about this incident, is its apparent magnitude. Technology can help. Strong authentication systems could have made creating unique credentials more difficult, and change management products might have alerted someone to Childs' activities. But technology alone isn't the solution; good management plays a part, too.

Jonathan Feldman, director of IT for Asheville, N.C., says problems like these can crop up when the IT department relies on heroes versus using a team approach. He describes the IT hero as a lone wolf, a go-to person who is solely responsible for critical systems. IT heroes often don't like to give up control over their systems, Feldman points out. These employees pose a real risk to the organization because if they leave the job, are unable to work, or simply decide to strike back, no one else has the knowledge to work around them.

What's At Stake
Childs changed router and switch administrator passwords

The network serves 60% of the city's needs, including some police systems

Childs is suspended with pay while he sits in jail
The solution is to cross-train IT staff so that no one person alone understands and controls key systems; spread responsibility for systems over several people; and adopt a practical change management process. By doing those three things, the harm that any one person can inflict on your IT department is lessened because there are redundant skills and knowledge in play.

Building an IT team rather than relying on lone wizards requires management discipline and may seem a more costly approach; IT heroes are an easy shortcut for even the best-intentioned managers. However, the payoff in building a team is a more resilient IT department. "You know you are successful when you can let IT personnel go on vacation without having to ask for their cell phone and hotel numbers in case something comes up," says Feldman.

Rogue employees can still wreak havoc if they want. The best you can do is to take steps to minimize the damage.


Recommended Reading:

Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
COVID-19: Latest Security News & Commentary
Dark Reading Staff 7/9/2020
4 Security Tips as the July 15 Tax-Day Extension Draws Near
Shane Buckley, President & Chief Operating Officer, Gigamon,  7/10/2020
Russian Cyber Gang 'Cosmic Lynx' Focuses on Email Fraud
Kelly Sheridan, Staff Editor, Dark Reading,  7/7/2020
Register for Dark Reading Newsletters
White Papers
Current Issue
Special Report: Computing's New Normal, a Dark Reading Perspective
This special report examines how IT security organizations have adapted to the "new normal" of computing and what the long-term effects will be. Read it and get a unique set of perspectives on issues ranging from new threats & vulnerabilities as a result of remote working to how enterprise security strategy will be affected long term.
Flash Poll
The Threat from the Internetand What Your Organization Can Do About It
The Threat from the Internetand What Your Organization Can Do About It
This report describes some of the latest attacks and threats emanating from the Internet, as well as advice and tips on how your organization can mitigate those threats before they affect your business. Download it today!
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
PUBLISHED: 2020-07-10
Django Two-Factor Authentication before 1.12, stores the user's password in clear text in the user session (base64-encoded). The password is stored in the session when the user submits their username and password, and is removed once they complete authentication by entering a two-factor authenticati...
PUBLISHED: 2020-07-10
In Bareos Director less than or equal to 16.2.10, 17.2.9, 18.2.8, and 19.2.7, a heap overflow allows a malicious client to corrupt the director's memory via oversized digest strings sent during initialization of a verify job. Disabling verify jobs mitigates the problem. This issue is also patched in...
PUBLISHED: 2020-07-10
Bareos before version 19.2.8 and earlier allows a malicious client to communicate with the director without knowledge of the shared secret if the director allows client initiated connection and connects to the client itself. The malicious client can replay the Bareos director's cram-md5 challenge to...
PUBLISHED: 2020-07-10
osquery before version 4.4.0 enables a priviledge escalation vulnerability. If a Window system is configured with a PATH that contains a user-writable directory then a local user may write a zlib1.dll DLL, which osquery will attempt to load. Since osquery runs with elevated privileges this enables l...
PUBLISHED: 2020-07-10
An exploitable SQL injection vulnerability exists in the Admin Reports functionality of Glacies IceHRM v26.6.0.OS (Commit bb274de1751ffb9d09482fd2538f9950a94c510a) . A specially crafted HTTP request can cause SQL injection. An attacker can make an authenticated HTTP request to trigger this vulnerabi...