Cloud Compliance Blog

Identity and Access Assessment (IdAA)

Ronald Reagan famously said "Trust, but verify". He could very well have been talking about entitlement management systems, which manage authorization to critical applications and other IT resources. Such systems are trusted to maintain control over entitlements (also called privileges or access rights). However, the systems themselves rarely have verification or assessment capabilities. This may be adequate for smaller organizations or enterprises where roles change infrequently. But the dynamic nature of most enterprises -- with layoffs, restructurings, aggressive use of contractors and other service providers -- makes assessment not only prudent, but necessary to ensure effective access controls and audit compliance.

Entitlements

Deloitte, in The 6th Annual Global Security Survey, reports that excessive entitlements, also known as excessive access rights, was the top audit finding over the past year -- for the second year in a row! In other words, a fundamental access control that represents a compliance exposure and security vulnerability was the top audit finding in 2007 and, despite all the attention that garnered, was also the top audit finding in 2008 (the latest year for which survey data exist).

Since all major regulatory frameworks, including SOX, PCI DSS, GLBA, NERC and HIPAA, require access controls, many thousands of companies are obligated to prevent excessive access rights and yet, according to the Deloitte survey, have failed to effectively do so.

Not only is excessive access rights the top audit finding, but IDC states that such vulnerabilities result in major financial exposure -- and that up to 60% of rights on most systems are expired and therefore dormant. The problem is that IT and security staff at most companies don't know that dormant accounts exist -- or more precisely, they suspect they exist but don't know how to find or remediate them.

Why is this a hard problem to solve?

Access Controls in the Real World

A paper written by a team at Dartmouth describes observations from field study research of both retail and investment banks. The study was more in-depth than most surveys we hear about; for example, the study team was embedded for three weeks in the security group of an investment bank. The report focuses primarily on internal access controls and the risks of over-entitlement, and they directly address the challenge of effectively managing access controls.

What they found was that the frequent shifting of staff may from one department or role to another often results in users accumulating entitlements over time. Part of the problem is this: Entitlement management systems assume that an employee's direct supervisor can make informed decisions about what entitlements are required to do their job. But as the Dartmouth team points out:

"As more organizations take on a matrix structure, it becomes less evident who reports to whom and who is responsible for permitting and terminating data access."

This leads to ambiguous and unwieldy structures for assigning entitlements, or privileges, as shown in Figure 1:

Figure 1: Privileging in traditional hierarchical corporate structures (left) vs. in dynamically, "matrixed" organizations (right). An arrow represents a supervising relationship (directed graph). Note that on the left, each person has exactly one direct supervisor, whereas on the right, each may have two or more.

 

And even if the corporate structure and reporting relationship is clear in all cases, the degree of scale and complexity makes entitlement management a big problem as shown in Figure 2: 

Figure 2: Complexity and dynamicism in entitlement systems. The number of applications, entitlements and users make it a large-scale problem, and the number of daily modifications makes it a fast-moving target.

 

The biggest challenge isn't the massive number of entitlements and users, however, but the highly dynamic nature of employees and organizational structure within the firm.

Conventional wisdom holds that role-based access control (RBAC) systems are the answer. By allowing organizations to segregate the massive numbers of employees and entitlements into work groups, RBAC systems make the entitlement management process more effective. But the size, complexity and dynamic nature of many large enterprises make role-based access control challenging, to say the least. Quoting from the Dartmouth study:

"At one very large retail bank that we interviewed, the CISO had recently completed an RBAC project creating 11,000 roles across the firm to control access to nearly 22,000 applications. Developing the roles took a team two years and the ongoing review process was expected to be significant."

In the real world, access rights are constantly changing, for legitimate reasons: employees are hired and terminated; contractors come and go; service providers and outsource firms require access on a project basis with often unclear timelines; federated identity management systems expand the concept of trusted user beyond the enterprise boundary; departments and whole companies undergo reorganizations; mergers and acquisitions result in major restructurings; layoffs lead to rapid and sometime undocumented role changes; and employees transferring within a company inevitably have to overlap responsibilities (and access) between their old and new jobs. Unclear and imperfect communications between HR, line-of-business (LOB) staff, and IT exacerbate the problem.

Managing Entitlements

Andrew Jaquith, an analyst at Forrester, in his book Security Metrics states:

"Today's information security battleground is all about entitlements-who's got them, whether they were granted properly, and how to enforce them."

Companies large and small employ different approaches to entitlement management, with equal lack of success. Mostly, they do manual reviews of entitlements prior to audits by going through HR records, reviewing application logs, and interviewing LOB managers-a process inevitably referred to as a fire drill. Other approaches to entitlement management include development of custom reports for SEIM and log management systems, network-based user activity monitoring, and RBAC systems.

The management challenge is to determine what's a reasonable target level of excessive access rights in terms of percentage of overall rights granted, and then ensure that solutions are in place to consistently keep actual excessive access rights on or below the target. It's more expensive to establish an excessive access rights target of 2% than of 4%, for example. Therefore, management must determine what level constitutes "enough" security, doesn't break the budget or put an undue burden on IT or line-of-business staff, and yet meets the compliance requirements as measured by auditors. What auditors are looking for is a sustainable, measureable process that demonstrates visibility (can the company detect when and where it has excessive access rights?) and the ability to remediate problems when they occur (can the company eliminate excessive access rights within a reasonable amount of time from their detection?).

Top Audit Findings

As the Deloitte survey reports, current approaches have failed to achieve the desired and necessary level of compliance -- not just for excessive access rights, but for access controls in general.

Figure 3: Top internal and external findings for 2007 and 2008, ranked by percentage of respondents citing findings in each category, taken from the Deloitte survey.

 

Here's an explanation of each of the findings:

Excessive access rights. Note that despite the improvement from 2007, excessive access rights remained the top audit finding in 2008 as noted above. Part of the reason that excessive access rights has been the top finding for the past two years is that auditors have raised the standard, from evidence of the existence of a process to evidence that the process is effective.

Segregation of duties. Segregation of duties, also referred to as separation of duties and abbreviated SoD, is one of the most fundamental concepts of security and control, and also one of the most difficult to achieve.

Access control compliance with procedures. This audit issue is closely related to excessive access rights; access control is required to prevent users without appropriate rights from accessing audited resources.

Lack of audit trails/logging, lack of documentation of controls, and lack of review of audit trails. These three top findings are grouped together because they represent the facet of access audit where technology and process come together. Application logs, which represent the most effective way to determine user access activity, are an essential tool for ensuring that access controls are compliant. And reports that list who has access to what, along with who should have access to what, become critical components of how access controls are documented.

Excessive developers' access to production systems and data. This audit finding is challenging to address, because it's unrealistic in most operating environments to completely block developers from accessing production systems for troubleshooting and critical maintenance operations. The objective, then, is not to prevent such access but to note when it's risen to an "excessive" level.

Lack of clean-up of access rules following a transfer or termination. Few if any organizations effectively manage rights and access rules in a real-world environment with re-org, restructurings, layoffs, role re-definitions and transfers-especially transfers. Because transfers are not a discrete event so much as a process where an employee has overlapping responsibilities between new job and old job-and therefore must maintain access rights for both jobs.

It's clear from the Deloitte survey that access controls are problematic. While organizations are reasonably effective in ensuring that only authorized users may log in to critical resources, they fail to consistently determine which users should be authorized to access those resources. Meanwhile, auditors have learned where to look in order to find users with excessive access rights and other access control violations; hence, an increasingly high rate of audit findings.

Is Perfect Access Control Possible?

The well-known security guru, Bruce Schneier, in a recent article entitled Is Perfect Access Control Possible?, discusses many of these same points and concludes:

"In the end, a perfect access control system just isn't possible; organizations are simply too chaotic for it to work."

Schneier refers to the Dartmouth study's finding that 50-90% of users are over-entitled in large organizations. Over-entitlement leads to risk, and therefore attracts the attention of auditors as explained in the Dartmouth study:

"It may not seem problematic for employees to have access to systems they never use or are unaware of. However, such access introduces risk. The root of the problem is that unnecessary or uncontrolled access can lead to unintended data editing, accidental disclosure, or internal misuse. That is why Sarbanes-Oxley auditors will flag unnecessary access as a weakness."

Auditors have learned in recent years how to find and flag excessive access rights, which is the top cause of audit findings. And not only is audit compliance an issue, but as noted above in the IDC report excess entitlements represent a huge financial liability. Thus, imperfect access controls represent a security vulnerability, a financial liability, and a compliance exposure. Despite these compelling motivations, we find from research by Deloitte, IDC, Forrester, Dartmouth and Bruce Schneier that present-day access controls are largely ineffective, especially in highly dynamic organizations.

What does the future hold for access control? New technologies are on the horizon that, by taking an approach referred to as Identity and Access Assessment (IdAA), enable visibility into the effectiveness of access controls. Such solutions perform data mining to analyze access activity over time and thus identify access control issues for remediation.

Cloud Compliance

Cloud Compliance is developing an IdAA solution to improve the efficacy of compliance solutions and reduce the cost of achieving compliance. We combine the economies of cloud computing with fundamental performance management principles to provide easy, low cost analysis of access rights to prevent audit findings and ensure access control compliance with regulations such as SOX, GLBA, PCI DSS, HIPAA and NERC. Our solution enables customers to identify access audit deficiencies before auditors arrive, and without manual process costs that otherwise dominate. 

Here's how it works: Cloud Compliance employs SaaS-based data mining analytics that examines users' access activity to identify and report on excessive access rights and other access controls. The Cloud Compliance solution can assess your organization's identity and access controls in five simple steps:

1.      Point your browser to the Cloud Compliance SaaS site

2.      Using Cloud Compliance's automatic wizard, select which resources and applications you wish to assess. This is a matter of identifying the SSO system, SIEM, MSSP (if you have a log retention service), or the targeted application servers' log files and entitlements data.

3.      Upload entitlements info and log data to the Cloud Compliance SaaS site.

4.      Review the graphical analytics to determine performance versus benchmarks, and to remediate any policy violations

5.      Repeat steps 3 and 4 periodically. The amount of time between assessments represents the maximum lag time between when a violation occurs and when it's identified.

It's that easy!

Our innovative ability to measure, report and ultimately remediate potential audit findings enables our customers to resolve compliance problems prior to an audit. In addition, Cloud Compliance's graphical analytics highlight trends and identify root causes to compliance issues, by audited application, or by business unit, providing valuable insight into potential security vulnerabilities. Furthermore, due to our global visibility as a cloud-based SaaS solution, we capture statistics industry-wide that our customers can access for setting their own policy benchmarks. Finally, the Cloud Compliance SaaS solution requires no software to install, maintain and operate, no appliances to deploy, no consultants, advisors or professional services to deploy, and no huge upfront capital expense to incur.

For further information, see the Cloud Compliance use case demo at http://www.cloud-compliance.com/product/demo/.

Cloud Compliance Security

As with all cloud-based services, security can be a concern. That's especially true for services that address compliance issues and access vulnerabilities. Cloud Compliance employs the Amazon EC2 (Elastic Compute Cloud) service which has extensive and comprehensive physical and logical controls, including:

§         State of the art intrusion detection systems

§         Authorized staff must pass two-factor authentication at least twice

§         Immediate deprovisioning of admin when no longer has business need

§         Extensive background check of staff with potential access to customer data

§         All admin access logged and audited

§         Network security: DDoS, MITM, and firewall

§         Firewall requires customer's X.509 certificate and key to authorize changes

§         API calls to launch and terminate instances and perform other functions require X.509 certificate

§         S3 (storage) read permissions controlled by ACL

§         S3 authentication using HMAC-SHA1 signatures

§         Storage device decommission based on NIST 800-88 (media sanitation)

§         AWS recurring SAS-70 Type II certification

Cloud Compliance encrypts data in transit as well as data at rest (there's also an option that precludes the need to store any log or entitlement data at all). And it's worthwhile pointing out that the Cloud Compliance solution does not require access to personal identifying information (PII); only a non-sensitive subset of entitlement data and log records are required.

Compliance Made Easy

Cloud Compliance's Identity and Access Assessment service is easy to adopt and provides immediate results. We solve access control issues that go by many names: excessive access rights; least privilege policy violations; excessive privileges; dormant accounts; and excessive entitlements. These access control issues have been identified, studied and reported on by major audit firms such as Deloitte, analysts such as Forrester and IDC, academic research teams such as from Dartmouth, and enterprises around the world. Yet, until Cloud Compliance, there was no effective solution available. Now, with our SaaS-based IdAA, achieving access audit compliance is not only possible -- it's easy.

 

Note: A PDF of this post can be found here.

Field Study: Entitlements, Privileges and Information Risk

I came across a paper written by a team at Dartmouth (hat tip to Bruce Schneier) that describes observations from field study research of both retail and investment banks. The study was more in-depth than most surveys we hear about; for example, the study team was embedded for 3 weeks in the security group of an investment bank. The report focuses primarily on internal access controls and the risks of over-entitlement - a topic we've delved into on many occasions including here and here.

Due to the dynamic nature of large banks - and many other organizations - it is quite common for people to move between internal organizations and be transferred across information boundaries.

The frequent shifting of staff may result in information users collecting system entitlements over time if the system access is not actively managed, resulting in a toxic combination of privileges.

We knew about the gradual accumulation of entitlements over time. But a toxic combination of privileges? What's that?

A toxic combination is a conflict of system access that allows a user to break the law, violate rules of ethics, damage customers' trust, or even create the appearance of impropriety.

How did we get from over-entitlements to toxic combinations?

Part of the problem is this: Entitlement management systems assume that an employee's direct supervisor can make informed decisions about what entitlements are required to do their job. But as the Dartmouth team points out

As more organizations take on a matrix structure, it becomes less evident who reports to whom and who is responsible for permitting and terminating data access.

This leads to ambiguous and unwieldy structures for assigning entitlements, or privileges, as shown in Figure 1:

And even if the corporate structure and reporting relationship is clear in all cases, the degree of scale and complexity makes entitlement management a big problem as shown in Figure 2: 

 

The biggest challenge isn't the massive number of entitlements and users, however, but the highly dynamic nature of employees and organizational structure within the firm.

Conventional wisdom holds that role-based access control (RBAC) systems are the answer. By allowing organizations to segregate the massive numbers of employees and entitlements into work groups, RBAC systems make the entitlement management process easier to manage. But the size, complexity and dynamic nature of many large enterprises make role-based access control challenging, to say the least:

At one very large retail bank that we interviewed, the CISO had recently completed an RBAC project creating 11,000 roles across the firm to control access to nearly 22,000 applications. Developing the roles took a team two years and the ongoing review process was expected to be significant.

We explored in an earlier post whether perfect access control was possible. Unfortunately, the answer is no. So if over-entitlement is the norm, leading to toxic combinations of privileges or entitlements, and access control systems - which are so costly to deploy and manage - aren't able to fully solve the problem, then what's an organization to do? Especially an organization that is highly regulated by SOX, FFIEC and FINRA?

Cloud Compliance is developing an Identity and Access Control (IdAA) solution to manage entitlements (also called privileges, or access rights). We identify users with excess entitlements, and provide tools for isolating high levels of over-entitlement by group, business unit or by application. Such tools enable root cause identification, and provide the necessary insight for remediation and process improvement. Furthermore, due to our global visibility as a cloud-based SaaS solution, we capture statistics industry-wide that our customers can access for setting their own policy benchmarks. Finally, in contrast to role-based access control systems, the Cloud Compliance SaaS solution requires no software to install, maintain and operate, no appliances to deploy, no consultants, advisors or professional services to deploy, and no huge upfront capital expense to incur.

Identity and Access Assessment

Deloitte reports that excessive access rights was the top audit finding for the most recent two years surveyed. Not only is it the top audit finding, but IDC states that excessive access rights result in the biggest financial exposure for organizations—and up to 60% of rights on most systems are expired and therefore dormant. The problem is that IT and security staff at most companies don’t know that this condition exists—or more precisely, they suspect it exists but don’t know where.

Compounding the problem for these companies is that auditors have in recent years learned that by spot-checking recent transfers and terminations, they are more than likely to uncover excessive access rights. This has contributed to the high rate of audit findings in recent years.

Conventional wisdom holds that the solution to this issue is better Identity Management (IdM) systems with role-based access control (RBAC) capabilities and a user interface that can be understood by line-of-business managers, who could then be counted on to keep access rights current and accurate. Unfortunately LOB managers are often reluctant partners in this enterprise; the path of least resistance for them is to keep existing rights when in doubt. And the high rate of audit findings suggests the weakness of this approach.

Whether companies have an IdM system or not, they most likely prepare for audits by manually analyzing HR records and job descriptions in conjunction with role definitions and entitlements. This quarterly or annual process is invariably referred to by customers as a fire drill. In many cases, contractors or temp workers are brought in for this task—adding to the expense but rarely improving the outcome as measured by audit findings.

In the real world, access rights or entitlements are constantly changing, for legitimate reasons: employees are hired and terminated; contractors come and go; service providers and outsource firms require access on a project basis with often unclear timelines; federated identity management systems expand the concept of trusted user beyond the enterprise boundary; departments and whole companies undergo reorganizations; mergers and acquisitions result in major restructurings; layoffs lead to rapid and sometime undocumented role changes; and employees transferring within a company inevitably have to overlap responsibilities (and access) between their old and new jobs. Unclear and imperfect communications between HR, line-of-business staff, and IT exacerbate the problem.

There is no perfect IdM system and there’s no foolproof rights management process. Since the systems and processes for managing rights inevitably fall short of 100% accuracy, some kind of feedback or assessment mechanism is required to achieve least privilege objectives and improve IT audit performance. That’s why Cloud Compliance is developing the industry’s first Identity and Access Assessment (IdAA) system—to provide feedback that identifies, reports on and helps remediate excessive access rights and other access audit issues.

Cloud Compliance will address the IdAA challenge with a unique, innovative SaaS solution. Our cloud-based analytics assesses log-based access activity for selected applications, typically those that are audited or that access sensitive data such as personal identifying information (PII). We identify dormant (aka zombie) accounts, and provide tools for isolating high rates of dormancy by group, business unit or by application. Such tools enable root cause identification, and provide the necessary insight for remediation and process improvement. Furthermore, due to our global visibility as a multi-tenant SaaS solution, we capture statistics industry-wide that our customers can access for setting their own policy benchmarks. Finally, in contrast to software-based IdM solutions, the Cloud Compliance SaaS solution requires no software to install, maintain and operate, no appliances to deploy, no consultants,  advisors or professional services to deploy, and no huge upfront capital expense to incur.

Ronald Reagan famously said “Trust, but verify”.  Many IdM systems are trusted to maintain entitlement and access rights.  But the systems themselves rarely have verification capabilities.  They would benefit greatly from an Identity and Access Assessment solution that provided verification, and in doing so improved audit performance and regulatory compliance.

Visualizing Security Metrics

This is the third and final post in my series discussing Security Metrics: Replacing Fear, Uncertainty and Doubt by Andrew Jaquith. As I noted, Jaquith makes some intriguing and vital points about the need for "good" metrics and "serious analytic scrutiny" to inform executive decision-making on issues of security, compliance, and risk governance. This is an especially important topic today, with organizations everywhere trying to figure out how to stay secure and improve compliance while cutting their expense budget.

Most organizations, when considering appropriate investment levels to deal with risk, are not lacking for data. But lots of data does not equate to relevant information required for sound decision-making. Jaquith's point is that information in the form of metrics -- good metrics, which he defines -- is lacking in many enterprises.

But once good metrics have been defined, how are they communicated to stakeholders? Jaquith dedicates an entire chapter to visualization. He starts by listing his six design principles for visualization of metrics:

1. It is about the data, not the design (resist urges to "dress up" the data)
2. Just say no to three-dimensional graphics and cutesy chart junk (it obscures your data)
3. Don't go off to meet the wizard (or talking paperclips)
4. Erase, erase, erase (removing tick marks and grid lines results in a crisp chart with few distracting lines)
5. Reconsider Technicolor (default colors are far too saturated, and should be muted. Consider a monochromatic palette)
6. Label honestly and without contortions (pick a meaningful title, label units of measure, don't abbreviate to the point where the meaning is not clear)

Like me, Jaquith is an admirer of Edward Tufte, author of several books about information visualization including the classic The Visual Display of Quantitative Information (1983, Cheshire, CT: Graphics Press). According to Tufte, a key to effective visual displays is understanding the goal of your presentation. In Tufte's own words:

At the heart of quantitative reasoning is a single question: Compared to what? Small multiple designs, multivariate and data bountiful, answer directly by visually enforcing comparisons of changes, of the differences among objects, of the scope of alternatives. For a wide range of problems in data presentation, small multiples are the best design solution.

Hence, we have small multiples as a visualization strategy. Here's an example:

From this display, one can look at different categories (in this case, departments) to view comparative performance over time. Once can readily imagine security/compliance applications for this approach, such as dormant accounts by resource, or excessive access rights by department.

In his book Beautiful Evidence (2006, Cheshire, CT: Graphics Press) Tufte introduces a refinement to this concept called the sparkline, which he defines as "small, intense, simple datawords". The example Tufte uses to explain the sparkline concept is a patient's medical data, taken from Beautiful Evidence:

Besides Tufte's small multiples and sparklines, Jaquith's visualization suggestions include indexed and quartile time series charts, bivariate charts, period-share charts, treemaps, and Pareto charts. The key point is that there's not a single graphic approach that works in all cases; one needs to determine the essence of what is being conveyed. The audience almost always consists of busy people, often executives, who need to have information presented clearly and in context. It doesn't do anyone any good to be able to point out after a security event that the "smoking gun" data had been seen, but it was either lost in the noise of too much data, or its significance was not clear.

P.S. It's not necessarily relevant to this post, but my favorite graphical display of quantitative information is an advertisement for one of Tufte's books that regularly appears in Scientific American and The Economist:

More Security Metrics

Although I wrote about Security Metrics: Replacing Fear, Uncertainty and Doubt by Andrew Jaquith earlier, a single post doesn't do this important topic justice. The key theme as expressed by Jaquith is

...information security is one of the few management disciplines that has yet to submit itself to serious analytic scrutiny.

This lack of analytic scrutiny in the form of security metrics makes risk management especially difficult for executive understanding and guidance, especially when discussing the necessary level of investment required. Executives ideally want their security and compliance metrics to answer the following questions:

• How effective are my security processes?
• Am I better off than I was this time last year?
• How do I compare with my peers?
• Am I spending the right amount of money?
• What are my risk transfer options?

As previously discussed, most functions within an enterprise-HR, finance, manufacturing, supply chain, call center, e-commerce and operations-have the ability to measure their performance by tracking key metrics, and comparing with other companies in a peer group. Such metrics share the characteristics of being simple to explain, readily lending themselves to benchmarking, and being consistently and automatically collected.

Without such metrics, we're doomed to reactive rather than proactive risk management. Or, as Jaquith calls it, we're on the hamster wheel of pain:

 

 

Here are Jaquith's suggested questions for management when measuring audit and compliance processes and their related investments:

1. How much time and effort are security staff spending on audit-related activities? (Metrics: # regulatory audits completed, time/cost of audit activities)
2. Have audits uncovered serious weaknesses in existing controls? (Metrics: % security compliance reviews with material weaknesses, % key external requirements compliant per external audit)
3. How much time and effort are security staff spending fixing problems uncovered by audits? (Metrics: # pending deficiencies and estimated time/cost to complete, time/cost spent on remediation activities)
4. Have audit activities uncovered problems with controls that would affect customer trust or privacy? (Metric: # pending customer-related deficiencies and estimated time/cost to complete)

Only by employing security metrics and submitting to serious analytic scrutiny can an enterprise get security and compliance risk management off of the hamster wheel of pain and onto a level playing field with other disciplines.

I agree with Andrew Jaquith when he says that today's information security battleground is all about entitlements-who's got them, whether they were granted properly, and how to enforce them. The way to prevail on this "entitlements battleground" is to be well-armed with security metrics. Cloud Compliance will be arming their customers with entitlement assessment solutions whose metrics are based on the principles espoused by Jaquith in his book.

Security Metrics

Andrew Jaquith, in his book Security Metrics: Replacing Fear, Uncertainty and Doubt, describes the value of metrics in general and in doing so identifies one of the key challenges in ensuring system security:

Today's information security battleground is all about entitlements -- who's got them, whether they were granted properly, and how to enforce them.

The book describes how metrics can be applied in managing security systems in general, and in entitlements/access rights in particular. Jaquith, a senior analyst at Forrester, cites examples of how other disciplines and industries use key metrics to compare their operations to peer companies. For example, freight companies know their freight cost per mile and loading factors-as well as those of their competitors. Management can therefore set meaningful objectives and measure themselves against comparable companies. Choosing to be above, on, or below an industry average is a question of strategy as well as operational efficiency. For example, a freight company may be willing to have a lower load factor than its peers if that's the tradeoff required to offer faster delivery times (for which it presumably charges a premium).

Similarly, warehousing firms measure and compare their cost/square foot and inventory turns, and e-commerce companies measure their website conversion rates. And of course financial metrics have been standardized and reported on for years. Companies can therefore compare relevant metrics to those of their peers in order to better evaluate their internal performance.

Could such a use of metrics apply to security? And can metrics be of use in the "entitlements battleground"?

First, let's look at Jacquith's definition of a good metric:

1. consistently measured, without subjective criteria;
2. cheap to gather, preferably in an automated way;
3. expressed as a cardinal number or percentage, not with qualitative labels such as high, medium and low;
4. expressed using at least one unit of measure, such as "defects" or "dormant accounts"; and
5. contextually specific -- relevant enough to decision-makers so that they can take action.

So what about the "information security battleground", namely entitlements and access rights? What metrics are relevant to that? Jaquith lists pertinent questions and the metrics that can guide management actions, for example: Does the organization review employee entitlements? An example metric would be % accounts dormant. (The complete discussion starts on page 117 of Jaquith's book under the heading Ensuring System Security.)

Cloud Compliance's solution includes the key metric "% accounts dormant". Is it a good metric? According to Jaquith's five criteria above it is: consistently measured; cheap to gather; expressed objectively as a percentage; expressed using a clear unit of measure (dormant accounts); and relevant enough to management so that they can take action. In addition, our solution provides a threshold percentage so that management can readily tell when action is required.

Finally, one of the advantages of a SaaS solution such as that offered by Cloud Compliance is the global statistical perspective that can be provided, which allows customers to compare their performance to that of their peers. By knowing, for example, industry averages for key metrics such as % accounts dormant Cloud Compliance's customers can benchmark their internal performance and security objectives to those of comparable organizations. What better way to arm oneself for the information security battleground known as entitlements management?

The definition and application of security metrics is ongoing. One resource I recommend is Securitymetrics.org, which provides empirical strategies for decision-makers and security practitioners and which includes links to digests, presentations, and handouts from past Metricon Workshops.