Number-driven risk metrics 'fundamentally broken'

Article

Number-driven risk metrics 'fundamentally broken'

Michael S. Mimoso, Editor, Information Security magazine

BOSTON -- The traditional models used by organizations to calculate risk are fundamentally broken, said a former national cybersecurity czar today at the SOURCE Boston conference.

    Requires Free Membership to View

    SearchSecurity.com members gain immediate and unlimited access to breaking industry news, virus alerts, new hacker threats, highly focused security newsletters, and more -- all at no cost. Join me on SearchSecurity.com today!

    Michael S. Mimoso, Editorial Director

    By submitting your registration information to SearchSecurity.com you agree to receive email communications from TechTarget and TechTarget partners. We encourage you to read our Privacy Policy which contains important disclosures about how we collect and use your registration and other information. If you reside outside of the United States, by submitting this registration information you consent to having your personal data transferred to and processed in the United States. Your use of SearchSecurity.com is governed by our Terms of Use. You may contact us at webmaster@TechTarget.com.

SearchSecurity.com:
To get security news and tips delivered to your inbox, click here to sign up for our free newsletter.

Amit Yoran, CEO of consultancy NetWitness Corp. and former National Cyber Security Division director, said security resources are often misaligned and misallocated because organizations are driven to present number-driven metrics based on some combination of threats, vulnerabilities and asset value to management—and that doesn't work.

"When you try to boil down complex network traffic into a traffic light or some number to present to management--which understands only traffic lights--you're driving organizations toward bad metrics versus the task at hand," Yoran said. "We're struggling to present number-driven metrics to people who struggle to understand all this complexity."

Amit Yoran podcast:
Amit Yoran on DHS, federal cybersecurity: In this podcast recorded Dec. 5, 2008, Amit Yoran, former cybersecurity czar at DHS and a veteran security pro, discusses the Obama admin's security priorities and why information sharing hasn't worked.

Instead, Yoran suggests rather than trying to quantify threats, they should be assumed as fact. For example, he said there is tremendous variance among vulnerability scanners, and scanning the same system with three scanners will render three different sets of results. Also, these tools rely largely on known vulnerabilities and exploits. Therefore, it becomes difficult to present an accurate number that reflects threats to an organization.

"The vulnerabilities and exploits that matter are [zero-days]. That's what nation states and advanced hackers are after. They use their rootkits that quietly keep them in systems," Yoran said. "They shy away from known exploits and target unpublished vulnerabilities."

Yoran would like organizations to refocus their energy, and determine the impact of loss of data, rather than concentrate on system or infrastructure security. For too long, he said, security has focused on availability of service rather than focusing on the value of data and keeping it confidential.

Now he stresses that organizations need to understand how data flows in and out of their organization, where it's stored, who has access to it and subsequently classify it. Only then is a company able to understand the impact of data, whether it's personally identifiable data, intellectual property or other business critical data.

SearchSecurity radio:

Yoran recognizes this can be monumentally challenging, but said vigilance around three areas will minimize exposure: