Some Good News and Bad News About Transparency International’s Interpretation of its Latest Corruption Perceptions Index

In my post last week, I fired off a knee-jerk reaction to Transparency International’s latest Corruption Perceptions Index (CPI). My message of that post was simple and straightforward: We shouldn’t attach much (or perhaps any) importance to short-term changes in any individual country or region’s CPI score, and the bad habit of journalists—and to some extent TI itself—of focusing on such changes is both misleading and counterproductive.

Since I was trying to get that post out quickly, so as to coincide with the release of the CPI, I published it before I’d had a chance to read carefully all of the material TI published along with the new CPI, and I promised that once I’d had a chance to look at those other materials, I would follow up if I had anything else to say. I’ve now had that chance, and I do have a few additional thoughts. The short version is that the way TI itself chose to present and discuss the implications of the 2018 CPI, in the accompanying materials, is both better and worse than I’d originally thought.

So, first, the bad news: Continue reading

A Reminder: Year-to-Year CPI Comparisons for Individual Countries are Meaningless, Misleading, and Should Be Avoided

Today, Transparency International released its new Corruption Perceptions Index (CPI) for 2018. At some point, hopefully soon, I’ll have time to look closely at the new data and accompanying materials, and if I have something to say about it, I’ll post it here. But that will probably take a while, and since the media coverage of the CPI is usually pretty intense in the first few days after the release, and dissipates in a week or two, I wanted to get out at least one post right now, on the day of the release, with a plea to everyone out there–especially journalists, but civil society activists and others as well:

DO NOT COMPARE ANY GIVEN COUNTRY’S CPI SCORE TO LAST YEAR’S SCORE TO MAKE CLAIMS ABOUT WHAT’S HAPPENING IN THE FIGHT AGAINST CORRUPTION.

Just don’t do it. Don’t. I know the temptation can seem overwhelming. Who’s up? Who’s down? Things are getting better! Things are getting worse! Nothing is changing! So many stories can be written based on these changes (or non-changes).

But these sorts of comparisons are virtually all completely useless, and probably counterproductive. Continue reading

The Persistence of Phony Statistics in Anticorruption Discourse

Early last month, UN Secretary General António Guterres delivered some brief opening remarks to the Security Council at a meeting on the relationship between corruption and conflict. In these remarks, Secretary General Guterres cited a couple of statistics about the economic costs of corruption: an estimate, attributed to the World Economic Forum (WEF), that the global cost of corruption is $2.6 trillion (or 5% of global GDP), as well as another estimate, attributed to the World Bank, that individuals and businesses cumulatively pay over $1 trillion in bribes each year. And last week, in her opening remarks at the International Anti-Corruption Conference, former Transparency International chair Huguette Labelle repeated these same figures.

Those statistics, as I’ve explained in prior posts (see here and here) are bogus. I realize that Secretary General Guterres’ invocation of those numbers shouldn’t bother me so much, since these figures had no substantive importance in his speech, and the speech itself was just the usual collection of platitudes and bromides about how corruption is bad, how the international community needs to do more to fight it, that the UN is a key player in the global effort against corruption, blah blah blah. Ditto for Ms. Labelle–her speech used these numbers kind of like a rhetorical garnish, to underscore the point that corruption is widespread and harmful, a point with which I very much agree. But just on principle, I feel like it’s important to set the right tone for evidence-based policymaking by eschewing impressive-sounding numbers that do not stand up to even mild scrutiny. Just to recap: Continue reading

Guest Post–Assessing Corruption with Big Data

Today’s guest post is from Enestor Dos Santos, principal economist at BBVA Research.

Ascertaining the actual level of corruption is not easy, given that it is usually a clandestine activity, and much of the available data is not comparable across countries or across time. Survey data on corruption experience can be helpful, but it is often limited to very specific kinds of corruption (such as petty bribery). Researchers and analysts have therefore, quite reasonably, tended to rely on subjective corruption perception data, such as Transparency International’s well-known Corruption Perceptions Index (CPI). (The CPI aggregates corruption perception data from a variety of other sources, mostly expert assessments.) But conventional corruption perception measures (including those use to construct the CPI) have well-known problems, including limited coverage (with respect to both years and countries) and relatively low frequency (usually annual). And they rely on the perceptions of a handful of experts, which may not necessarily be representative. These limitations mean that while traditional perception measures like the CPI may be useful for some purposes, they are not as helpful for others, such as measuring the impact of individual events or news reports on corruption perceptions, or how changes in corruption perceptions affect government approval ratings.

To address these concerns, a recent study by BBVA Research, entitled Assessing Corruption with Big Data, offered an alternative, complementary type of corruption perceptions measure, based on Google web searches about corruption. To construct this index, we examined all web searches classified by Google Trends in the “Law and Government” category for individual countries, and calculated the proportion of those searches that contain the word “corruption” (in any language and including its misspellings and synonyms). Our index, which begins in 2004, covers more than 190 countries and, unlike traditional corruption indicators, is available in real-time and with high-frequency (monthly). Moreover, it can be reproduced very easily and at very low cost.

Here are some of our main findings: Continue reading

On the Political Subtext of Definition Debates, Part 2: Measurement or Moralism?

In my last post, I conjectured that a great deal of what would seem like a dry methodological question—How should we define and measure corruption?—is actually shot through with political-ideological considerations. The reason, I further conjectured, is that “corruption” is both (1) a descriptive sociological term, used to categorize a set of related behaviors, and (2) an evaluative moral term, used to characterize certain behaviors (or people or governments or institutions or countries) as “bad” or “blameworthy.” The fact that the same term has these different functions, coupled with the fact that the word “corruption” is particularly (though not uniquely) ambiguous and open-ended, means that attempts to come up with definitions and measurements that are appropriate for some purposes may seem to others wrongheaded, even offensive.

My illustration of this difficulty in the my last post concerned debates over whether “corruption” should be defined (say, by advocacy organizations or researchers) principally as “the abuse of public power for private gain,” or instead should be defined to include purely private sector corruption (“abuse of entrusted power for private gain”). My admittedly speculative conjecture was that many (not all) who argue for the latter position do so not so much because of (plausible) arguments for analytical equivalence, but rather due to an implicit—and in my view incorrect—belief that focusing on public sector corruption suggests a neoliberal/libertarian skepticism of activist government.

Here I want to suggest a similar sort of ideological subtext in debates over whether the definition of corruption (and the sorts of corruption that the leading indicators should seek to capture) ought to be limited to what we might think of as the “direct” or “first-order” dishonest acts by the responsible officials (such as taking bribes or embezzling funds), or whether measures of corruption should also incorporate the activities that facilitate corruption (such as providing safe havens for stolen assets), as well as the ways in which the rich and powerful seek to influence public policy through legal means (such as lobbying and campaign donations). This has come up more than a couple of times in the last few months at various conferences and roundtable discussions I’ve attended. The context is typically a criticism—often impassioned—of Transparency International’s Corruption Perceptions Index (CPI) and the associated graphics (such as the color-coded country map) that are used to illustrate the index results. The criticism usually runs as follows (and here I’m paraphrasing, but I think fairly and accurately): Continue reading

On the Political Subtext of Definition Debates, Part 1: Public vs. Private Sector Corruption

Since I started working in the anticorruption field a few years back, I’ve noticed that a substantial amount of the discussion in this field—at conferences, in journals, on blogs like this one, etc.—is given over to debates about definition and measurement. This is something I’ve discussed, and complained about, before (see here, here, and here)—though I concede that every time I bring this up, I’m contributing to the very problem I’m complaining about.

Now, one of the reasons there’s so much debate about definition and measurement in this field is because corruption is, relative to other concepts, particularly difficult to define and measure. Another reason—in my mind the main one—is that while “corruption” is sometimes used as a purely descriptive term (that is, to describe certain conduct, which we can try to measure empirically), it is also an evaluative/normative term—one that connotes “bad” behavior of a certain sort. So any attempt to define corruption (for purposes of positive analysis or empirical research) will often, perhaps inevitably, suggest a normative position on the sorts of conduct, people, or institutions that ought to be condemned.

That’s not an original point, nor even a terribly interesting one. But the more of these “what is corruption” conversations I’ve been a part of, the more I get the sense that there’s a more specific political/ideological subtext to some of the arguments about how corruption should be defined. Nobody ever articulates these ideas in so many words, and so I may be way off base, but I’m going to offer up some conjectures, in this post and in the next one, about what I sense is the ideological subtext of some of these definitional debates.

Here I’ll focus on a fairly narrow issue: Should those organizations that focus on (and sometimes try to measure) “corruption” emphasize forms of corruption that involve the public sector (government, or entities with a sufficiently close connection with government to be considered essentially public instrumentalities), or should the “anticorruption agenda”—as well as the definition and measurement of corruption—also include purely private sector corruption? Continue reading

Two Essential Volumes on Corruption

The study of corruption and what to do about it is no longer an academic or policy-studies backwater.  Matthew’s bibliography of corruption-related publications now lists over 6,000 books, articles, and reports and, as his regular updates show (thank you Matthew), the list continues to grow at the rate of some 50 plus per month.  That is the good news.  It is also of the course the bad news.  Few practitioners, and I suspect even academics, can claim to have absorbed the learning in the 6,000 current documents let alone keep up with the outpouring of new works.

For those who can’t , I recommend two recent books: Dan Hough’s Analysing Corruption and Alina Mungui-Pippidi and Michael Johnston’s Transitions to Good Governance: Creating Virtuous Circles of Anti-Corruption.  Both do an excellent job of synthesizing and extending recent scholarship on corruption issues, and both do so in a sophisticated but accessible manner.  Both have the added virtue of being available in reasonably priced paperback editions. Continue reading