The Lisbon Council’s 2015 Intellectual Property and Economic Growth Index: A Showcase of Methodological Blunder

  • Lawrence Spiwak profile
    Lawrence Spiwak
    30 June 2015 - updated 4 years ago
    Total votes: 0
Author(s): 
George S. Ford, PhD
Year of publication: 
2014

The European Commission recently unveiled its much-anticipated framework to create a “Digital Single Market.”  Presumably intending to influence this process, the Lisbon Council, a Brussels-based think tank, released in March 2015 (with a revision in May 2015) a study entitled The 2015 Intellectual Property and Economic Growth Index:  Measuring the Impact of Exceptions and Limitations in Copyright on Growth, Jobs, and Prosperity.  In this analysis, the Lisbon Council purports to show that weaker copyright protections are good for the economy and, as such, encourages European policymakers to expand exceptions and limitations to copyright laws to promote economic growth.  However, in a new report entitled The Lisbon Council’s 2015 Intellectual Property and Economic Growth Index:  A Showcase of Methodological Blunder, Phoenix Center Chief Economist Dr. George S. Ford demonstrates that the Lisbon Council’s analysis is ”a showcase of methodological blunder”  and points to a troubling disregard for the most basic of scientific methods.

As Dr. Ford highlights:

  • The Lisbon Council’s strong claims are based on nothing more than “cherry-picking” results from hundreds of simple correlation coefficients computed by using no more than 8 and as few as 5 observations. 
  • Out of 462 statistical tests conducted, the Lisbon Council’s conclusions are based on the statistical significance of less than 5% of tests.  Such a small number of “successes” is readily explained by random variation (at a significance level of 5%), thereby providing reasonably strong evidence that there is no relationship between copyright flexibility and economic outcomes.
  • Even worse, the economic activity variables for the eight non-randomly selected countries are measured as an average of nearly twenty-years of nominal (not inflation adjusted) time-series data that is expressed in five different currencies
  • Finally, while the Lisbon Council casually asserts that for the May revision of its IP Index Report “correlations tests have all been re-run [] and no significant variations were found,” the Lisbon Council’s claim is patently false.  The statistical results from the revision are very much different and weaker than the original version and for the Lisbon Council to claim otherwise is disingenuous.