The Law of Cheating

Let’s suppose that you’re the manager of a factory that manufactures automotive bumpers. When the fourth quarter rolls around you see that you aren’t on track to meet your quota by your year-end deadline. Failure to meet either the quota or the deadline will mean that you won’t be getting any bonus or stock options; in fact your job might be at risk. So you decide to put off regularly scheduled maintenance and repairs for the quarter and produce bumpers at full capacity—a practice called “storming.” You meet your quota and deadline but catching up with maintenance and repairs during the first quarter of the following year reduces your production capacity for three months. Down the line of course you’ll be facing yet another quota and another deadline and in to recoup the resulting loss in production you’ll have to resort to “storming” once again. Obviously it won’t be long before your operations are completely out of control. Not fair you say: Your job is constantly on the line because the quotas and deadlines that you have to meet are too demanding. Unfortunately as any social scientist could tell you you are a victim of Campbell’s Law. In 1976 Donald T. Campbell a social psychologist specializing in research methodology came to the following conclusion: The more any quantitative social indicator is used for social decision making the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes that it is intended to monitor. In other words: Once a measurement (or metric) is specified as a key criterion for the success of a process or project its ability to measure what it’s supposed to will almost inevitably be compromised. Why? If the stakes and the cost of failure are too high people tend to cheat. Campbell’s Law predicted for example what actually happened in Atlanta schools beginning in 2005 and culminating in 2015 when 11 former educators were convicted of racketeering charges stemming from a conspiracy to alter student test scores. The original investigation had extended to nearly 180 principals and teachers at more than 40 schools and had resulted in 35 indictments. The educators it seems were motivated by increasing pressure to meet official performance standards on which bonuses and even employment status depended and adherents of Campbell’s Law argue that the episode reflects the failure of a misguided control process designed to measure student performance too narrowly. According to one report on the Atlanta episode the dilemma fostered by high-stakes educational standards is an all-too-clear demonstration of Campbell’s original formula for control failure: School districts are increasingly tying teacher pay to performance and there’s no consensus on the best way to measure student proficiency so high test scores are starting to look a lot like money. What emerges is bad news: a carrot-and-stick approach to a sector of the workforce that many consider to be underpaid. We shouldn’t be surprised by such responses to impractical performance measures says Robert D. Behn of Harvard University’s Kennedy School of Government: After all we have put significant pressure on schools and teachers to improve test scores. … When the pressure becomes personal—when a person’s job and income are on the line—some people may resort to cheating. Why do you think all of those professional baseball players used steroids? Behn distinguishes between “honest cheating” and “dishonest cheating.” Like the tactics used by certain educators in Atlanta “dishonest cheating is illegal and you can go to jail for it” (the convicted principals and teachers are facing prison sentences of five to 20 years). On the other hand such practices as “teaching to the test”—focusing one’s efforts on standardized testing to the detriment of other educational activities—are merely “honest cheating”: “There is nothing illegal about it. No one goes to jail for it. Still it illustrates how putting pressure on schools principals and teachers to improve on very specific performance measures can produce the distortions about which Campbell worried.” According to Behn and other analysts of the impulse to cheat a common denominator in both types of “honesty” is the imposition of “very specific performance measures.” In business such measures are often called KPIs—quantifiable metrics that show how well an organization is achieving its goals. KPIs can help an organization focus on its most effective strategies but if they aren’t conceived or executed properly KPIs can be misleading. Campbell himself offered the example of a city that sets a strategy to reduce crime designating the crime rate as a KPI. If the crime rate goes down can city officials be sure that has crime actually been reduced? Not necessarily: What if police in to push down the rate had adopted new criteria for crimes that must be formally reported or systematically downgraded certain crimes to less serious classifications? When enforced by such counter strategic employee behavior Campbell’s Law can sabotage the best-laid plans—as you did when you gamed the process of meeting your quotas and deadlines. You were given a certain amount of discretion in the way you both achieved and reported your results and you made your decision based on the fact that the stakes and the cost of failure were too high. Ironically your employer also gave you incentives to make the decision that you did—literally: In addition to protecting your job you acted to secure your bonus and stock options. According to Ethical Systems a nonprofit that compiles research on ethical leadership conflicts of interest cheating and other related issues extensive research shows that decisions like yours “are frequently distorted by incentives.” An example suggests James Freis Jr. an attorney specializing in financial-industry regulation “might be a contractor who knows his bonus depends on the fulfillment of certain contracts and so may be tempted to offer a bribe to a foreign official who is responsible for signing off on a license customs duty or shipment.” Freis may well have been thinking about the case of Acatel-Lucent SA the world’s largest supplier of landline phone networks. In 2010 the company agreed to pay $137 million to settle criminal and civil charges stemming from violations of the U.S. Foreign Corrupt Practices Act. According to the Securities and Exchange Commission “Alcatel and its subsidiaries failed to detect or investigate numerous red flags suggesting that employees were directing sham consultants to provide gifts and payments to foreign government officials to illegally win business.” Managers at Alcatel received the bulk of their pay in the form of stock incentives and bonuses tied to short-term profitability. The problem suggests Harvard’s Behn is the practice of pegging high-stakes incentives to narrow win-or-lose KPIs. As Campbell’s Law shows cheating—including the violation of an organization’s ethics rules—will probably occur under such circumstances. “So get over it” Behn advises organizational strategists. “Don’t go looking for the perfect performance measure. It doesn’t exist. Don’t waste countless meetings debating whose measure is without defects. All measures have them.” Instead he suggests start with a good measure (or two). Not great not perfect just good. From the beginning try to identify its inadequacies. Recognize what problems the measure might create; then as you implement your performance strategy be alert for the emergence of flaws and distortions. When suggesting adopting or employing a performance measure all [managers] should be aware of—and beware of—Campbell’s Law. Must include a summary of the case above. Requirements: 1-2 paragraphs per questions; answer all bullet points | .doc file What about you? Put yourself in the position of the Atlanta educators whose dilemma is described in the case. If there was a real possibility that you’d lose your job because your students performed badly how would you assess your situation and your options? What if there were a real possibility that you’d lose a pay raise and promotion? How about the possibility that you’d be reassigned to a much less desirable school? Be prepared to argue either side of your case. Think about a class that you’re taking now or have taken in the past. What KPI played the most important role in the instructor’s evaluation of your performance? What did it tell you about your instructor’s strategy for teaching the course? Do you think that it was too narrowly focused or otherwise unreasonable? If so how do you think your instructor could have improved his performance-evaluation strategy? Again what about you? After having read this case have you reconsidered your attitude toward how much control or accountability you’d like to have in a job? If for example you’re studying to be a teacher how do you feel about a career goal such as moving up to principal or even multischool administrator? How does your concept of an ideal work/life relationship affect your thinking on the subject? As we saw in Chapter 10 incentives “represent special compensation opportunities that are usually tied to performance”—that is to a certain form of workplace behavior. They can also be tied to other forms of workplace behavior—such as complying with an employer’s policies regarding legal and ethical conduct (its so-called compliance & ethics or C&E program). Incentives can be either “soft” (consisting of nontangible encouragement or recognition) or “hard” (typically consisting of tangible often monetary rewards). What “C&E” incentives affect the way you conduct yourself whether at work or at school? How do they stack up against the incentives to behave in accord with Campbell’s Law? Is there any tension between the two sets of incentives? What do you do—or can you do—to resolve any tension as you make decisions affecting your behavior? What about you? Put yourself in the position of the Atlanta educators whose dilemma is described in the case. If there was a real possibility that you’d lose your job because your students performed badly how would you assess your situation and your options? What if there were a real possibility that you’d lose a pay raise and promotion? How about the possibility that you’d be reassigned to a much less desirable school? Be prepared to argue either side of your case.Think about a class that you’re taking now or have taken in the past. What KPI played the most important role in the instructor’s evaluation of your performance? What did it tell you about your instructor’s strategy for teaching the course? Do you think that it was too narrowly focused or otherwise unreasonable? If so how do you think your instructor could have improved his performance-evaluation strategy?Again what about you? After having read this case have you reconsidered your attitude toward how much control or accountability you’d like to have in a job? If for example you’re studying to be a teacher how do you feel about a career goal such as moving up to principal or even multischool administrator? How does your concept of an ideal work/life relationship affect your thinking on the subject?As we saw in Chapter 10 incentives “represent special compensation opportunities that are usually tied to performance”—that is to a certain form of workplace behavior. They can also be tied to other forms of workplace behavior—such as complying with an employer’s policies regarding legal and ethical conduct (its so-called compliance & ethics or C&E program). Incentives can be either “soft” (consisting of nontangible encouragement or recognition) or “hard” (typically consisting of tangible often monetary rewards). What “C&E” incentives affect the way you conduct yourself whether at work or at school? How do they stack up against the incentives to behave in accord with Campbell’s Law? Is there any tension between the two sets of incentives? What do you do—or can you do—to resolve any tension as you make decisions affecting your behavior?