In May 2016, at the London Anticorruption Summit sponsored by then-Prime Minister David Cameron, participating countries issued declarations announcing a variety of commitments—some new, some continuations of existing policies—to further the fight against international corruption. Of course, all too often governments fail to follow through on their grandiose promises, so I was heartened by Transparency International’s announcement, in September 2016, that it had gone through all the country declarations, compiled a spreadsheet identifying each country’s specific promises, and would be monitoring how well each country was following through on its commitments.

Last month, a year after TI published the spreadsheet documenting the list of summit commitments, TI released a report and an interactive website that purport to track whether countries have followed through on those commitments. So what do we learn from this tracking exercise?

Alas, the answer is “almost nothing.” TI’s “Anti-Corruption Pledge Tracker,” in its current form, is a catastrophic failure—a slapdash, amateurish collection of arbitrary, often inconsistent judgments, unsupported by anything that resembles serious research, and (ironically) non-transparent. This is all the more surprising—and disappointing—given the fact that TI has done so much better in producing similar assessment tools in other contexts. Indeed, at least one such recent tool—TI’s Government Defense Anti-Corruption Index—provides a model for what the Pledge Tracker could and should have looked like. Given the importance of tracking countries’ fulfillment of their summit pledges, and TI’s natural position as a leader on that effort, I dearly hope that TI will scrap the Pledge Tracker in its current form, go back to the drawing board, and do a new version.

I know that sounds harsh, and perhaps it seems excessive. But let me explain why I don’t find the Pledge Tracker, in its current form, worthy of credence. Continue reading →