Guest Post: Transparency International UK’s Pledge Tracker–Amateur Research or Different Objectives?

Last week, GAB Editor-in-Chief Matthew Stephenson published a post sharply criticizing Transparency International UK’s new “Pledge Tracker,” which evaluates how well countries are living up to the pledges they made at the May 2016 London Anti-Corruption Summit. GAB is delighted to have the opportunity to publish the following reply from Robert Barrington, the Executive Director of Transparency International UK:

“A slapdash, amateurish collection of arbitrary, often inconsistent judgements, unsupported by anything that resembles serious research.” Not since I was taken to task over an undergraduate essay by an eminent professor at Oxford have I had work for which I was responsible receive quite such a stinging critique.  On that occasion, I could not escape a sense that my world view differed from that of the professor, and that—irrespective of the detail—was the root of our misunderstanding.

So is Professor Stephenson’s assessment of TI-UK’s Pledge Tracker merited? Here is my overall assessment: he is right on some but not all of the detail; he is wrong on most but not all of the big picture. At the root of the difference is the question of whether this is an index in which countries are compared with each other according to a consistent global standard, or whether it is the presentation of individual country assessments by local civil society organizations of their own country’s progress against their own country’s commitments. Continue reading

Transparency International’s Anti-Corruption Pledge Tracker Is Badly Flawed. It Needs To Be Redone from Scratch.

In May 2016, at the London Anticorruption Summit sponsored by then-Prime Minister David Cameron, participating countries issued declarations announcing a variety of commitments—some new, some continuations of existing policies—to further the fight against international corruption. Of course, all too often governments fail to follow through on their grandiose promises, so I was heartened by Transparency International’s announcement, in September 2016, that it had gone through all the country declarations, compiled a spreadsheet identifying each country’s specific promises, and would be monitoring how well each country was following through on its commitments.

Last month, a year after TI published the spreadsheet documenting the list of summit commitments, TI released a report and an interactive website that purport to track whether countries have followed through on those commitments. So what do we learn from this tracking exercise?

Alas, the answer is “almost nothing.” TI’s “Anti-Corruption Pledge Tracker,” in its current form, is a catastrophic failure—a slapdash, amateurish collection of arbitrary, often inconsistent judgments, unsupported by anything that resembles serious research, and (ironically) non-transparent. This is all the more surprising—and disappointing—given the fact that TI has done so much better in producing similar assessment tools in other contexts. Indeed, at least one such recent tool—TI’s Government Defense Anti-Corruption Index—provides a model for what the Pledge Tracker could and should have looked like. Given the importance of tracking countries’ fulfillment of their summit pledges, and TI’s natural position as a leader on that effort, I dearly hope that TI will scrap the Pledge Tracker in its current form, go back to the drawing board, and do a new version.

I know that sounds harsh, and perhaps it seems excessive. But let me explain why I don’t find the Pledge Tracker, in its current form, worthy of credence. Continue reading