Stay current on changes and developments in corporate law with a wide variety of resources and tools.
By Hui Chen
Hui Chen was the Justice Department’s first-ever compliance counsel expert before leaving in June to start her own private compliance consulting service. Before she joined the DOJ, Hui served in global senior compliance lead positions at Microsoft, Pfizer, and Standard Chartered Bank.
A few years ago, a close family member was to have a major surgery. In our search for surgeons and hospitals, one important factor we considered was safety records. The Leapfrog Group, a U.S. national nonprofit organization focused on measuring hospitals’ patient safety record, compiles data from nearly 2,000 hospitals. Hospitals are graded on their safety performance based on a composite of metrics, for both process and outcome. Process measurements relate to the efforts hospitals make to enhance safety: handwashing practices, systems for preventing medication mistakes, communication among medical staff, etc. Outcome measures actual safety events: infections, surgical errors, patient falls, etc. As family members of a patient, we realized that outcome was much more important to us than process: We were far more concerned about the risk of infection than about how the hospital gets its staff to wash their hands.
The focus on outcome is what typically drives performance: Athletes do not win medals for their hours of training, but for their performance at races; marketing departments are not credited for how many mailers they send, but on the amount of incremental sales increase resulting from the campaigns; recovery from addiction is not measured by the number of therapy sessions, but by the continuity of sobriety.
In the area of corporate compliance, however, the focus has remained on process, not outcome.
“We trained 95 percent of our employees on compliance.” (But we didn’t know if they learned anything.)
“Our CEO always says ‘do the right thing’!” (But we don’t know if anyone believes him/her, or understands what “do the right thing” even means.)
“We conduct due diligence checks on third parties.” (But we do not monitor their activities to know what they are doing on our behalf.)
The Evaluation of Corporate Compliance Programs, published by the Fraud Section in the Criminal Division of the Department of Justice, has taken the first steps toward asking outcome-based questions: How has the company measured the effectiveness of the training? Has the third-party due diligence ever identified red flags? How has the compliance program been audited and tested? The journey toward true outcome-based measurements, however, still very much continues ahead for corporate compliance professionals. Below are some next steps we might be able take.
The outcome of interest here is the tone—culture—of the organization, and the mention of the “top” is based on the belief in the leadership’s role in setting that tone. The prevailing measurements of the number and types of pro-compliance messages uttered by management is somewhat akin to measuring calorie intake by counting calories only when one eats vegetables. At best, such measurements reflect a biased view of tone at the top. An outcome measure, instead, would focus on measuring the culture of the organization, including how leadership commitments are perceived and understood. Credible culture and perception measurements, however, would require much greater rigor than most of the surveys I have seen, which often suffer from vagueness, leading questions, and common self-reporting biases.
There has been some shift from measuring attendance rate to measuring how “engaged” the training is. While this is a step in the right direction, “engaged” is often confused with “entertained.” As one practitioner has astutely noted: “[P]eople do not need to do anything differently after consuming entertainment…Compliance training, on the other hand, is a waste of time unless people do something differently afterwards.”
Training is about teaching skills and changing behavior: What needs to be measured, then, are the use of skills and change in behavior.
I have seen many companies count how many financial or process controls they have, but few count how many control failures there are. Financial and process controls act as filters: Their purpose is to block out the prohibited transactions. When I buy a water filter system, I am less interested in what mechanisms go into the filter system than I am in how many contaminants slip through the system. The outcome measure for the effectiveness of controls, therefore, is the percentage of contaminated transactions that have evaded the controls. Rigorous and continuous audits and monitoring, therefore, are likely the most appropriate measurements.
Ultimately, the outcome of any corporate compliance program is its ability to prevent and detect specific types of misconducts. In that, it is no different from other prevention and detection industries and professions such as public health, safety, and crime prevention. Each of those industries have developed outcome metrics to measure their performance, and may offer valuable lessons for corporate compliance to guide us on our journey towards outcome-based measurements.
Hui Chen ( www.HuiChenEthics.com) was the Justice Department’s first-ever compliance counsel expert before leaving in June 2017 to start her own private compliance consulting service. Before she joined the DOJ, Hui served in global senior compliance lead positions at Microsoft, Pfizer, and Standard Chartered Bank.
Copyright © 2018 The Bureau of National Affairs, Inc. All Rights Reserved.
All Bloomberg BNA treatises are available on standing order, which ensures you will always receive the most current edition of the book or supplement of the title you have ordered from Bloomberg BNA’s book division. As soon as a new supplement or edition is published (usually annually) for a title you’ve previously purchased and requested to be placed on standing order, we’ll ship it to you to review for 30 days without any obligation. During this period, you can either (a) honor the invoice and receive a 5% discount (in addition to any other discounts you may qualify for) off the then-current price of the update, plus shipping and handling or (b) return the book(s), in which case, your invoice will be cancelled upon receipt of the book(s). Call us for a prepaid UPS label for your return. It’s as simple and easy as that. Most importantly, standing orders mean you will never have to worry about the timeliness of the information you’re relying on. And, you may discontinue standing orders at any time by contacting us at 1.800.960.1220 or by sending an email to email@example.com.
Put me on standing order at a 5% discount off list price of all future updates, in addition to any other discounts I may quality for. (Returnable within 30 days.)
Notify me when updates are available (No standing order will be created).
This Bloomberg BNA report is available on standing order, which ensures you will all receive the latest edition. This report is updated annually and we will send you the latest edition once it has been published. By signing up for standing order you will never have to worry about the timeliness of the information you need. And, you may discontinue standing orders at any time by contacting us at 1.800.372.1033, option 5, or by sending us an email to firstname.lastname@example.org.
Put me on standing order
Notify me when new releases are available (no standing order will be created)