Guest Post–Assessing Corruption with Big Data

Today’s guest post is from Enestor Dos Santos, principal economist at BBVA Research.

Ascertaining the actual level of corruption is not easy, given that it is usually a clandestine activity, and much of the available data is not comparable across countries or across time. Survey data on corruption experience can be helpful, but it is often limited to very specific kinds of corruption (such as petty bribery). Researchers and analysts have therefore, quite reasonably, tended to rely on subjective corruption perception data, such as Transparency International’s well-known Corruption Perceptions Index (CPI). (The CPI aggregates corruption perception data from a variety of other sources, mostly expert assessments.) But conventional corruption perception measures (including those use to construct the CPI) have well-known problems, including limited coverage (with respect to both years and countries) and relatively low frequency (usually annual). And they rely on the perceptions of a handful of experts, which may not necessarily be representative. These limitations mean that while traditional perception measures like the CPI may be useful for some purposes, they are not as helpful for others, such as measuring the impact of individual events or news reports on corruption perceptions, or how changes in corruption perceptions affect government approval ratings.

To address these concerns, a recent study by BBVA Research, entitled Assessing Corruption with Big Data, offered an alternative, complementary type of corruption perceptions measure, based on Google web searches about corruption. To construct this index, we examined all web searches classified by Google Trends in the “Law and Government” category for individual countries, and calculated the proportion of those searches that contain the word “corruption” (in any language and including its misspellings and synonyms). Our index, which begins in 2004, covers more than 190 countries and, unlike traditional corruption indicators, is available in real-time and with high-frequency (monthly). Moreover, it can be reproduced very easily and at very low cost.

Here are some of our main findings: Continue reading

Do People Care More About Corruption Than They Used To? Evidence from the US and Germany

Sometimes it feels like corruption has become the topic of the year: We’ve heard repeatedly that it is (the perception of) corrupt elites that has fueled the rise of populists, nationalists, and new socialist parties and politicians. The most prominently of these, though not the only one, is Donald Trump, who promised in his campaign to take back power from the corrupt elites (see here and here).

But has the topic of corruption actually become increasingly prominent in popular and media discourse over the last two years? To investigate this question, I did a simple search on the Factiva database within the eight most widely-circulated American newspapers (USA Today, the New York Times, the Wall Street Journal, the Los Angeles Times, the New York Post, the Chicago Tribune, the Washington Post, and Newsday) for the term “corruption.” I did a similar search for Germany, using the term “Korruption” and the eight most widely-circulated German newspapers (BILD, BILD am Sonntag, Süddeutsche Zeitung, Frankfurter Allgemeine Zeitung, Die Zeit, Westdeutsche Allgemeine Zeitung, Rheinische Post, Welt am Sonntag and Rheinische Post). Surprisingly (at least to me), over the last two years there was no growth in U.S. newspaper reporting on corruption. As the following graph shows, reporting on corruption in the U.S. has been rather stable over this period, with between 500 and 750 articles a month. A slightly different picture emerges for Germany, where newspaper reports on corruption, which were substantially less frequent than in the U.S. to begin with, have actually declined over the past two years. (A side note, though perhaps an interesting one: The most reported corruption topic in both countries, with about 2.5 times more stories than the next-most-mentioned topic, was FIFA.): Continue reading