Guest Post: More Transparency Is Needed to Fight Grand Corruption in the Pharmaceutical Sector

Today’s guest post is from Till Bruckner, the founder of TranspariMED:

In the pharmaceutical sector, public agencies are routinely handing over billions in public money to private companies for products whose value they cannot accurately assess, because the vendors control the flow of information generated by clinical trials. (Even the purchasing price is often kept secret, but that is another story.) If we observed this sort of opacity in the public procurement sector, it would immediately raise red flags. If public contractors were taking billions from governments in exchange for products of dubious quality that the governments cannot assess, the anticorruption community would be–rightly–up in arms. But for the pharmaceutical industry, this is business as usual.

Consider, as one particularly egregious example, what can only be described as an $18 billion heist of public money by a pharma company. In 2006, governments around the world began stockpiling Tamiflu, an anti-retroviral drug, due to fears that outbreaks of bird flu (and later swine flu) could turn into a lethal global pandemic. The evidence available at the time suggested that the drug was safe and effective at reducing the symptoms of influenza. In total, 96 counties accumulated enough Tamiflu to treat 350 million people. Then, in 2009, a doctor noticed that the results of eight clinical trials of Tamiflu were missing from the public record. (Worldwide, around half of all clinical trials have never reported their results.) After a struggle lasting four years, independent scientists finally got the company to turn over the relevant data from these trials—and concluded that the drug did little, if anything, to help patients.

This example is especially egregious, but it is not otherwise exceptional. Amazingly, comprehensive information on the safety and effectiveness of drugs is not only inaccessible to independent scientists, but also to government agencies. When a drug company applies for a marketing license, it has to submit detailed documentation from every relevant trial to regulatory agencies such as the U.S. Food and Drug Administration (FDA). Regulators review these submissions, called Clinical Study Reports (CSRs) – and then promptly lock them away in their confidential archives. This is especially frustrating for scientists working for health technology agencies, who are tasked with assessing the cost-effectiveness of different drugs but are often unable to access CSRs. To date, only the European Medicines Agency systematically releases (some) CSRs.

Politicians have tried to bring transparency into the sector, but the laws they pass often remain unenforced. In the United States, the 2007 FDA Amendment Act made it compulsory for companies and universities to publish the summary results of some clinical trials on public registries. (Summary results are a kind of “executive summary” of a clinical trial; they are far shorter and less detailed than CSRs, but still better than nothing). In 2015, an investigation by STAT News found that pharmaceutical companies routinely violated the law. The law stipulates a fine of up to $10,000 for every day a result is overdue. In theory, Big Pharma has already racked up over $25 billion in fines. In practice, the FDA has yet to collect a single cent. In the European Union, a similar regulation exists, but there too it remains unenforced by national agencies. In Britain, a 2013 parliamentary inquiry called for greater transparency, but its recommendations were largely ignored.

Last December, a coalition of four health integrity organisations issuing a wake-up call for governments to finally get serious about clinical trial transparency. Transparency International Pharmaceuticals & Healthcare (PHP), TranspariMED, Cochrane, and the Collaboration for Research Integrity and Transparency (CRIT) released a study that documents in detail how opacity in the sector harms patients, prevents public health agencies from making informed decisions, wastes public health funds, slows down medical progress, and exposes shareholders to substantial risks. The study also shows that clinical trials can be made significantly more transparent without introducing new legislation. Public research funders could demand that grantees report the results of publicly funded trials. Regulators could make continued market access conditional on companies agreeing to make CSRs publicly available. And in many cases, simply enforcing the rules already on the book could make a huge difference – and the costs of enforcement could easily be covered by imposing fines for noncompliance.

The medical research community has long called for greater transparency in medical research. The AllTrials campaign, which calls for all clinical trials to be registered and fully reported, has attracted the support of over 700 groups, including the American Medical Association and dozens of patient groups, and TranspariMED is currently building a broader coalition to push for greater transparency in the sector. It’s high time for the wider anticorruption community to join the fray.

Public Beneficial Ownership Registries: A Response To Recent Criticisms

Anticorruption activists and other advocates for greater corporate and financial transparency scored a big win earlier this month when the UK announced that it would require the 14 British Overseas Territories (such as the British Virgin Islands (BVI) and the Cayman Islands) to create public beneficial ownership registers for all corporations and other legal entities registered in those jurisdictions. Many in the pro-transparency community believe that such registers are critical for fighting corruption and money laundering, as they make it harder to use anonymous companies to engage in unlawful transactions and hide the proceeds of crime by requiring information on the actual human beings (the ultimate “beneficial owners”) who own or control these artificial legal entities. At the very least, beneficial ownership information should be verified and kept on file so that it will be available to law enforcement in the event of an investigation, but many in the pro-transparency community believe that public beneficial ownership registers would be even more effective, as they would provide open data that civil society groups, the media, and others could scrutinize and analyze in order to unearth shady transactions and make it harder for kleptocrats and others to hide their loot. The British Overseas Territories are not the only or even the worse offenders when it comes to corporate secrecy—the United States is still struggling to enact laws that would provide for a non-public register, which the BVI and some other Overseas Territories already have—but there’s no doubt that these jurisdictions are often a preferred destination for dirty money.

So when the UK announced that it would require the Overseas Territories to adopt public beneficial ownership registers, many cheered. But not everybody. A couple weeks back, over at the FCPA Blog, Martin Kenney, a lawyer based in the BVI, published an intemperate denunciation of the new policy, lambasting the so-called “transparency brigade” for having a “mob mentality,” for being “naïve,” “hypocritical,” and neo-imperialist (and possibly racist), and of taking advantage of the devastation that many of the Caribbean Islands suffered in Hurricanes Irma and Maria to push their agenda at a time when “they perceive their prey to be weakened.” Indeed, the ad hominem invective in the post is so thick that it’s sometimes hard to discern the serious, substantive objections underneath all the vitriol. Which is a pity, because Kenney actually does advance at least one or two arguments that, while in my view likely incorrect, are worth taking seriously.

Last week, Rick offered a thoughtful, measured response to Mr. Kenney’s piece that got at some, but perhaps not all, of the core issues. I want to pick up where Rick left off, to lay out what I think are the most sensible concerns about the new UK policy (and about public beneficial ownership registers more generally). And, following Rick’s lead, I’ll try to turn the rhetorical temperature down a few notches, as there’s little to be gained in a (virtual) shouting match on a complicated issue like this. Continue reading

More on the 2017 Corruption Perceptions Index, and the Relationship Between Media/Civil Society Freedom and Corruption

The rest of the anticorruption commentariat (and the mainstream media) may have already moved on from the publication of Transparency International’s 2017 Corruption Perception Index (CPI), but I wanted to follow up on my other posts from earlier this month (here and here) to discuss one other aspect of the new CPI. The general overview, press release, and other supporting materials that accompanied the latest CPI stress as their main theme the importance of a free press and a robust, independent civil society in the fight against corruption. As TI states succinctly in the overview page for the 2017 CPI, “[A]nalysis of the [CPI] results indicates that countries with the least protection for press and non-governmental organisations (NGOs) also tend to have the worst rates of corruption.” And from this observation, TI argues that in order to make progress in the fight against corruption, governments should “do more to encourage free speech, independent media, political dissent and an open an engaged civil society,” and should “minimize regulations on media … and ensure that journalists can work without fear of repression or violence.” (TI also suggests that international donors should consider press freedom relevant to development aid or access to international organizations, a provocative suggestion that deserves fuller exploration elsewhere.)

Speaking in broad terms, I agree with TI’s position, and I’m heartened to see TI making an effort to use the publicity associated with the release of the CPI to push for concrete improvements on a particular area of importance, rather than simply stressing the bad effects of corruption (such as the alleged adverse impacts on inequality and poverty), or devoting undue attention to (statistically meaningless) movements in country scores from previous years. Whether TI succeeded in leveraging the CPI’s publicity into more attention to the freedom of the media and civil society is another story, but the effort is commendable.

That said, I spent a bit of time digging into the supporting research documents that TI provided on this issue, and I find myself in the uncomfortable position of finding the proffered evidentiary basis for the link between a free press/civil society and progress in the fight against corruption problematic, to put it mildly—even though my own reading of the larger academic literature on the topic makes me think the ultimate conclusion is likely correct, at least in broad terms. That latter fact, coupled with my recognition that the materials I’m evaluating are advocacy documents rather than academic research papers, makes me reluctant to criticize too harshly. Nonetheless, on the logic that it’s important to hold even our friends and allies accountable, and that in the long term promoting more careful and rigorous analysis will produce both more suitable policy prescriptions and better advocacy, I’m going to lay out my main difficulties with TI’s data analysis on the press freedom-corruption connection: Continue reading

Adjusting Corruption Perception Index Scores for National Wealth

My post two weeks ago discussed Transparency International’s newly-released 2017 Corruption Perceptions Index (CPI), focusing in particular on an old hobby-horse of mine: the hazards of trying to draw substantive conclusions from year-to-year changes in any individual country’s CPI score. Today I want to continue to discuss the 2017 CPI, with attention to a different issue: the relationship between a country’s wealth and its CPI score. It’s no secret that these variables are highly correlated. Indeed, per capita GDP remains the single strongest predictor of a country’s perceived corruption level, leading some critics to suggest that the CPI doesn’t really measure perceived corruption so much as it measures wealth—penalizing poor countries by portraying them as more corrupt, when in fact their corruption may be due more to their poverty than to deficiencies in their cultures, policies, and institutions.

This criticism isn’t entirely fair. Per capita income is a strong predictor of CPI scores, but they’re far from perfectly correlated. Furthermore, even if it’s true that worse (perceived) corruption is in large measure a product of worse economic conditions, that doesn’t mean there’s a problem with the CPI as such, any more than a measure of infant mortality is flawed because it is highly correlated with per capita income. (And of course because corruption may worsen economic outcomes, the correlation between wealth and CPI scores may be a partial reflection of corruption’s impact, though I doubt there are many who think that this relationship is so strong that the causal arrow runs predominantly from corruption to national wealth rather than from national wealth to perceived corruption.)

Yet the critics do have a point: When we look at the CPI results table, we see a lot of very rich countries clustered at the top, and a lot of very poor countries clustered at the bottom. That’s fine for some purposes, but we might also be interested in seeing which countries have notably higher or lower levels of perceived corruption than we would expect, given their per capita incomes. As a crude first cut at looking into this, I merged the 2017 CPI data table with data from the World Bank on 2016 purchasing-power-adjusted per capita GDP. After dropping the countries that appeared in one dataset but not the other, I had a 167 countries. I then ran a simple regression using CPI as the outcome variable and the natural log of per capita GDP as the sole explanatory variable. (I used the natural log partly to reduce the influence of extreme income outliers, and partly on the logic that the impact of GDP on perceived corruption likely declines at very high levels of income. But I admit it’s something of an arbitrary choice and I encourage others who are interested to play around with the data using alternative functional forms and specifications.)

This single variable, ln per capita GDP, explained about half of the total variance in the data (for stats nerds, the R2 value was about 0.51), meaning that while ln per capita GDP is a very powerful explanatory variable, there’s a lot of variation in the CPI that it doesn’t explain. The more interesting question, to my mind, concerns the countries that notably outperform or underperform the CPI score that one would predict given national wealth. To look into this, I simply ranked the 167 countries in my data by the size of the residuals from the simple regression described above. Here are some of the things that I found: Continue reading

The New Corruption Perceptions Index Identifies Countries with Statistically Significant Changes in Perceived Corruption–Should We Credit the Results?

As most readers of this blog are likely aware, last month Transparency International (TI) released the 2017 edition of its important and influential Corruption Perceptions Index (CPI). As usual, the publication of the CPI triggered a fair bit of media coverage, much of it focused on how various countries ranked, and how individual country scores had changed from one year to the next (see, for example, here, here, here, and here).

There’s a lot to say about the most recent CPI—I may devote a post at some point to TI’s interesting decision to focus the press release accompanying the publication of the 2017 CPI less on the index itself than on the connection between (perceived) corruption and a lack of adequate freedom and protections for the media and civil society. But in this preliminary post, I want to take up an issue that regular GAB readers will know has been something of a fixation of mine in past years: the emphasis—in my view mostly misplaced—on how individual country CPI scores have changed from year to year.

In prior posts, I’ve raised a number of related but distinct concerns about the tendency of some commentators—and, more disturbingly, of some policymakers—to attach great significance to whether a country’s CPI score has gone up or down relative to previous years. For one thing, the sources used to construct the CPI for any given country may change from year to year—and adding or dropping an idiosyncratic source can have a substantial effect on the aggregate CPI score. For another, even when the underlying sources don’t change, we don’t know whether those sources are on the same implicit scale from year to year. And even if we put these problems to one side, a focus on changes in the final CPI score can sometimes obscure the statistical uncertainty associated with the estimated CPI—these scores can be noisy enough that changes in scores, even those that seem large, may not be statistically meaningful according to the conventional tests. Although TI always calculates statistical confidence intervals, in prior years these intervals have been buried in hard-to-find Excel spreadsheets, and the changes in CPI scores that TI highlights in its annual press releases haven’t always been statistically significant by TI’s own calculations. In an earlier post, I suggested that at the very least, TI should provide an easy-to-find, easy-to-read table assessing which changes in country scores are statistically significant at conventional levels, preferably over a 4-year period (as 1-year changes are both harder to detect if trends are gradual, and less interesting).

Apparently some folks within TI were thinking along similar lines, and I was pleased to see that in the 2017 CPI includes a reasonably prominent link to a spreadsheet showing those countries for which the 2017 CPI score showed a “statistically significant difference” from that country’s CPI score in each of five comparison years (2012, 2013, 2014, 2015, and 2016).

I’ve still got some criticisms and concerns, which—in the spirit of constructive engagement—I’ll turn to in just a moment. But before getting to that, let me pause to note my admiration for TI as an organization, and in this case its research department in particular, for constantly working to improve both the CPI itself and how it is presented and interpreted. It’s easy for folks like me to criticize—and I’ll continue to do so, in the interests of pushing for further improvements—but it’s much more challenging to absorb the raft of criticisms from so many quarters, sift through them, and invest the necessary time and resources to adapt and adjust from year to year. So, in case any folks at TI are reading this, let me first acknowledge and express my appreciation for how much work (often thankless) goes into the creation and continued improvement of this valuable tool.

Having said that, let me now proceed to raising some comments, questions, and concerns about TI’s claims about countries that appear to have experienced statistically meaningful changes in their CPI scores over the last five years. Continue reading

“Petty” Corruption Isn’t Petty

Grand corruption attracts plenty of attention—from activists, the mainstream media, and other commentators (including on this blog)—and for good reason. While the media may simply be riveted by the decadent lifestyles of corrupt actors, the anticorruption community has increasingly recognized the devastating impact that kleptocrats and their cronies can have. No doubt, this attention to grand corruption is welcome and recent successes in fighting it are laudable. At the same time, though, this increased focus on grand corruption carries with it the risk of making smaller, more everyday forms of corruption—sometimes called “petty” corruption—seem less consequential.

Yet so-called “petty” corruption remains widespread, and its aggregate impact should not be underestimated. By way of example, consider the most recent results from the Transparency International (TI) Global Corruption Barometer (GCB) survey of citizens in Latin America and the Caribbean, which found that one-third of people who used a public service paid a bribe in order to do so. In other words, for these 90 million people, their ability to access a government service to which they were entitled was conditioned upon an extralegal payment—and that’s just accounting for this one region.

Even as the anticorruption community rightly focuses attention on combatting grand corruption, we can’t forget the real havoc wreaked by smaller-scale corruption. So-called “petty” corruption is not a petty concern. Rather, it’s a serious, pervasive problem that deserves just as much sustained attention as does politicians buying collector cars and oceanfront properties with assets from their secret offshore bank accounts. At the risk of repeating familiar points, it’s worth reviewing the ways in which small-scale corruption has, cumulatively, a range of incredibly destructive effects:

Continue reading

Dispatches from the UNCAC Conference of States Parties, Part 1: Revisiting the Jakarta Principles of Anti-Corruption Agencies

Last month, the UN Convention Against Corruption (UNCAC) Conference of States Parties (COSP) was held in Vienna, Austria. In addition to the formal meetings of government representatives, the COSP also featured a number of panels, speeches, and other side events, at which leading experts discussed and debated a range of anticorruption topics. GAB is delighted that Northwestern Pritzker School of Law Professor Juliet Sorensen and her student Kobby Lartey, who attended the COSP, have offered to share highlights of some of the most interesting sessions in a series of guest posts. Today’s post is the first in that series.

Though specialized anticorruption agencies (ACAs) are dismissed by some as redundant or ineffective, last month’s COSP panel on “Revisiting the Jakarta Principles: Strengthening Anti-Corruption Agencies’ Independence and Effectiveness” made a strong case for ACA’s importance to the fight against corruption. (The Jakarta Principles are drawn from a 2012 statement drafted by anticorruption practitioners and experts from around the world; these broad, aspirational principles help anticorruption to protect themselves, and to offer inspiration for their work.) The panel, which included ACA commissioners from Indonesia, France, Romania, and Burkina Faso, as well as representatives from Transparency International, the UNODC, and UNDP, the panel highlighted the diverse struggles and successes of member states’ ACAs. Continue reading

Guest Post: Going Beyond Bribery? Improving the Global Corruption Barometer

Coralie Pring, Research Expert at Transparency International, contributes today’s guest post:

Transparency International has been running the Global Corruption Barometer (GCB) – a general population survey on corruption experience and perception – for a decade and a half now. Before moving ahead with plans for the next round of the survey, we decided to review the survey to see if we can improve it and make it more relevant to the current corruption discourse. In particular, we wanted to know whether it would be worthwhile to add extra questions on topics like grand corruption, nepotism, revolving doors, lobbying, and so forth. To that end, we invited 25 academics and representatives from some of Transparency International’s national chapters to a workshop last October to discuss plans for improving the GCB. We initially planned to focus on what we thought would be a simple question: Should we expand the GCB survey to include questions about grand corruption and political corruption?

In fact, this question was nowhere near simple to answer and it really divided the group. (Perhaps this should have been expected when you get 25 researchers in one room!) Moreover, the discussion ended up focusing less on our initial query about whether or how to expand the GCB, and more on two more basic questions: First, are citizen perceptions of corruption reflective of reality? And second, can information about citizen corruption perceptions still be useful even if they are not accurate?

Because these debates may be of interest to many of this blog’s readers, and because TI is still hoping to get input from a broader set of experts on these and related questions, we would like to share a brief summary of the workshop exchange on these core questions. Continue reading

Guest Post: Transparency International UK’s Pledge Tracker–Amateur Research or Different Objectives?

Last week, GAB Editor-in-Chief Matthew Stephenson published a post sharply criticizing Transparency International UK’s new “Pledge Tracker,” which evaluates how well countries are living up to the pledges they made at the May 2016 London Anti-Corruption Summit. GAB is delighted to have the opportunity to publish the following reply from Robert Barrington, the Executive Director of Transparency International UK:

“A slapdash, amateurish collection of arbitrary, often inconsistent judgements, unsupported by anything that resembles serious research.” Not since I was taken to task over an undergraduate essay by an eminent professor at Oxford have I had work for which I was responsible receive quite such a stinging critique.  On that occasion, I could not escape a sense that my world view differed from that of the professor, and that—irrespective of the detail—was the root of our misunderstanding.

So is Professor Stephenson’s assessment of TI-UK’s Pledge Tracker merited? Here is my overall assessment: he is right on some but not all of the detail; he is wrong on most but not all of the big picture. At the root of the difference is the question of whether this is an index in which countries are compared with each other according to a consistent global standard, or whether it is the presentation of individual country assessments by local civil society organizations of their own country’s progress against their own country’s commitments. Continue reading

Transparency International’s Anti-Corruption Pledge Tracker Is Badly Flawed. It Needs To Be Redone from Scratch.

In May 2016, at the London Anticorruption Summit sponsored by then-Prime Minister David Cameron, participating countries issued declarations announcing a variety of commitments—some new, some continuations of existing policies—to further the fight against international corruption. Of course, all too often governments fail to follow through on their grandiose promises, so I was heartened by Transparency International’s announcement, in September 2016, that it had gone through all the country declarations, compiled a spreadsheet identifying each country’s specific promises, and would be monitoring how well each country was following through on its commitments.

Last month, a year after TI published the spreadsheet documenting the list of summit commitments, TI released a report and an interactive website that purport to track whether countries have followed through on those commitments. So what do we learn from this tracking exercise?

Alas, the answer is “almost nothing.” TI’s “Anti-Corruption Pledge Tracker,” in its current form, is a catastrophic failure—a slapdash, amateurish collection of arbitrary, often inconsistent judgments, unsupported by anything that resembles serious research, and (ironically) non-transparent. This is all the more surprising—and disappointing—given the fact that TI has done so much better in producing similar assessment tools in other contexts. Indeed, at least one such recent tool—TI’s Government Defense Anti-Corruption Index—provides a model for what the Pledge Tracker could and should have looked like. Given the importance of tracking countries’ fulfillment of their summit pledges, and TI’s natural position as a leader on that effort, I dearly hope that TI will scrap the Pledge Tracker in its current form, go back to the drawing board, and do a new version.

I know that sounds harsh, and perhaps it seems excessive. But let me explain why I don’t find the Pledge Tracker, in its current form, worthy of credence. Continue reading