Bad Economics: Confusing Correlation And Causation When It Comes To Patents And Innovation

from the don't-go-there dept

This is unfortunate. Despite plenty of research showing that patents do not, in fact, lead to increased innovation (but rather increased patenting), many still assume that there’s a direct linkage. Of course, it is true that many successful industries see high rates of patents, but there is evidence that patents tend to lag the actual innovation, rather than predate it. That is, once an area or industry is innovative and successful then everyone rushes in to get patents and try to extract their piece of the pie, often slowing down the pace of innovation.

So it’s fairly disappointing that the Brookings Institution, which normally does pretty good work on these kinds of things has put out a study about patents and innovation, and appears to be confusing correlation and causation in saying that patents lead to innovation and even (more ridiculously) that areas that aren’t doing enough patenting need to beef up their patents to increase innovation:

Metro areas that produce a lot of patents—and the inventiveness that that implies—are more likely to see above-average gains in population, productivity, jobs, and education, according to a report from the Brookings Institution, a nonprofit research and policy think tank. And the bottom fourth of metro areas, the ones that produce the fewest patents, could gain as much as $4,300 per worker over a decade if they amped up their patent production to match the top fourth.

“If we were able to get the roughly 250 metropolitan areas that do very little patenting up to the level of the 100 that do a great deal of patenting, we’d be richer in an extraordinary way,” says Jonathan Rothwell, a lead researcher on the study. “It would make really a huge difference to economic development.”

Since the report focuses on successful metro areas, it seems that there are many, many other factors that may have resulted in the successful economic situations in those areas, and those other factors may also have led to the increase in patenting. Assuming a causal relationship and (worse) suggesting that all other regions need to do is up their patenting, is a dangerously ill-informed suggestion. While the report claims to account for “reverse” causation, it appears to make little to no effort to really account for the many, many variables that are easy to observe in every day life that lead to a correlation between patents and economic output.

I’d been working on a response to some of the many methodological problems I spotted in the report, and it was growing ever longer and longer… and then I saw that Eli Dourado did a much better and more concise job of it in explaining why the report is bogus. Dourado points to two possible explanations for the correlation, neither of which are accounted for by the paper:

These conclusions are unwarranted given the model and findings expressed in the paper. To see that this is the case, assume temporarily that patents do nothing to incentivize real innovation, and that they merely transfer wealth from consumers at large to the patent holder through firm profits. If this were the case, then we would find that measured output per worker was higher in metropolitan areas with more patents—exactly what the authors found!—because they are gaining profits at the expense of consumers in metropolitan areas with fewer patents. In other words, the authors could be laboring under a fallacy of composition. Just because patents enrich the MSAs that generate them doesn’t mean that they are a source of prosperity for the nation as a whole or that they increase social welfare.

Alternatively, assume temporarily that patents do nothing to incentivize real innovation, but that firms that produce valuable innovations must defensively patent them to avoid being taken to court for using their own inventions. If this were the case, then patents would correlate with real innovation, and therefore with output per worker, but they would not cause an increase in productivity. In addition, at least some of the measured increase in output would come from an influx of highly-paid intellectual property attorneys, which by assumption does not represent real added productivity. Note that the top-patenting MSA in the study is Silicon Valley, the part of the country where people are most concerned about defensive patenting. But the word “defensive” does not appear even one time in the report, the appendix, or the working paper.

The authors have done nothing to identify the effect of patents on productivity, which is to say, nothing to rule out either of the possible assumptions above. They are simply relying on the assumption that more patents means more innovation.

This is a major major flaw in the paper. It seems to assume that a whole bunch of things that simply aren’t seen by folks who actually work in the industry, and makes little to no attempt to account for those other variables. In the comments, the lead researcher on the paper, Jonathan Rothwell, tries to defend the paper, by saying (in part) that they’re just using patents as a proxy on inventiveness, and the paper should not be seen as supporting patents or the patent system itself:

Right up front, I think it is important to keep in mind that our study aimed to examine the effects of invention rather than the effects of patents themselves. Hundreds of economic papers have been written that use patents as a proxy measure of invention (based on detailed firm and industry level analysis), so I think that is fairly uncontroversial.

Just because lots of folks do it, it doesn’t mean it’s right. But the bigger issue is that while he claims that the paper is not an endorsement of patents specifically or increasingly patenting activity, that’s not what he’s telling the press. Just look at the quote we have above from what he told the National Journal. He specifically is saying that we should boost patenting in other metropolitan areas, suggesting that it would make “a huge difference to economic development.” In other words, contrary to his claims in the blog comments, when talking to the press, he’s pretty clear that he believes there’s a direct causal relationship between patents and economic development. Furthermore, if he really believed that, he should have disclaimed, publicly, the title of that National Journal article, which explicitly says that patents (not “inventiveness”) “matters to economic and job growth.”

Also… if the report really is about “inventiveness” and not “patents,” perhaps the paper should not have been called “Patenting Prosperity.” Just saying.

Brookings, of course, is quite well-established and respected, and you can bet that pro-patent-system folks will be using this report to claim that “more patents are better” and that any reforms that are designed to push back on bad patents or to start limiting the number of patents we issue, would be a bad thing. Even though the report does, in fact, contain some arguments in favor of limiting certain types of patents and patent system abuse, those nuances will undoubtedly be lost. This report is going to get cited repeatedly as “evidence” that we need more patents and stronger patents, despite the fact that the actual evidence says no such thing.

Filed Under: , , ,
Companies: brookings

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “Bad Economics: Confusing Correlation And Causation When It Comes To Patents And Innovation”

Subscribe: RSS Leave a comment
Anonymous Coward says:

the ones that produce the fewest patents, could gain as much as $4,300 per worker over a decade if they amped up their patent production to match the top fourth.

Spelling r/amped/ramped/

Ramping up patent production means more employment for The statement of increased income per worker can, and if patents are used, will probably be due to increased selling price because of reduced competition, rather than increased efficiency of production. also increased income does not necessary equal increased profit, ot may be absorbed by ibcreased costs, such as lawyers bills.

Paraquat (profile) says:

cause and effect

The Brookings Institution ought to consider this:

In China, people eat with chopsticks. Chinese industrial production is the highest in the world. So good, in fact, that the USA has moved most of its manufacturing industries to China.

Therefore, one must conclude: eating with chopsticks makes workers more productive. Obviously, that’s the cause of their success – I mean, what else could it be? The Chinese don’t have software patents.

Now if China would just patent chopsticks, they’d take over the entire world. Let’s just hope the Chinese don’t catch on.

Anonymous Coward says:

Spain is known for its lax IP laws, whoever how could Spain come up with a cure for the plague of our times? at least for rats and dogs.

Billions of dollars are expent on research for “treatments”, but nobody expend that money on actual cures.

The reason is simple, treatment means continues income, cure means a one off and thus there is lesser incentives to innovate and find cures but to waste time and resources trying to just treat it.

Current patent system may provide incentives to a lot of “innovations” but in what direction?

Was it the direction that is best for us, or just best for some?

Adam_Smith (user link) says:

Correlation of Patents and Innovation

While Anonymous Coward complains that Tech Dirt does not “actually refute any of their conclusions with actual data”, that was not the point of the article. It was addressing the validity of the Brookings researchers methodology. It also points to a serious discrepancy in what a defense of the study now claims and what was previously claimed to the press. These objections to the Brookings study seem credible and I believe the onus is on Brookings to seriously examine these objections and, if necessary, to publicly repudiate its study or, at least, some of the claims made about it.

relghuar says:

Great work

Excellent study! Now I finally know what’s wrong in my country, and how to fix it! And all it took was just a minor extrapolation of the original idea:

Bratislava, the capital of Slovakia has the highest real estate prices and rents in the whole country – just about 35% above all-country average, but actually almost 100% above the average of all other regions beside Bratislava. It can’t be a coincidence that Bratislava is also considered most developed and prospering city in Slovakia!
Thus I propose raising real estate prices and rents in the whole country to the levels comparable to Bratislava! This will definitely cause unimaginable economic growth in all of Slovakia, as finally the whole country will be able to benefit from this clear cause of prosperity!!

I have to write our politicians right away, just in case they missed this key issue hindering our country’s true potential.

staff (user link) says:

more dissembling by Masnick

“patents do not, in fact, lead to increased innovation”

Fact?? How would you know? Have you ever invented anything? Have you ever filed a patent application, prosecuted it, attempted to commercialize it, had to enforce it in the courts?

It is not innovation that patents hinder, but the theft of.

In Federalist No. 43, James Madison wrote regarding constitutional rights of inventors, “The utility of the clause will scarcely be questioned. The copyright of authors has been solemnly adjudged, in Great Britain, to be a right of common law. The right to useful inventions seems with equal reason to belong to the inventors. The public good fully coincides in both cases with the claims of the individuals.”

It?s about property rights. They should not only be for the rich and powerful. Show me a country with weak or ineffective property rights and I?ll show you a weak economy with high unemployment. Does that remind you of any present day country?

Masnick and his monkeys have an unreported conflict of interest-

They sell blog filler and “insights” to major corporations including MS, HP, IBM etc. who just happen to be some of the world?s most frequent patent suit defendants. Obviously, he has failed to report his conflicts as any reputable reporter would. But then Masnick and his monkeys are not reporters. They are hacks representing themselves as legitimate journalists receiving funding from huge corporate infringers. They cannot be trusted and have no credibility. All they know about patents is they don?t have any.

Gene Cavanaugh (profile) says:

Cause and effect in patenting

This article, as Mike points out, is badly flawed. As a patent attorney (well, IP attorney, since I do other than patents), I can say with complete confidence that heavy patenting is an effect, not a causation.
Further, the usual reason is business method, specifically discouraging other disruptive business models or products from forming.
There are benefits to patenting in some cases, almost entirely in protecting embryonic business while they are in the process of being born, but at this time, the USPTO is doing all they can to kill any useful forms.

Zeissmann (profile) says:

Patent production

I find the language in those quotations exceptionally amusing. They’re actually talking about ?patent production?. This implies they really view patents as products, which can be produced and sold. In this way patents really do stimulate innovation — they stimulate people to invent whole new ways to abuse the patent law and exploit it to get richer in an ?extraordinary way?. Very creative indeed.

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Deals
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Older Stuff
09:00 Awesome Stuff: Monitor Everything (5)
09:00 Awesome Stuff: Cool Components (1)
12:42 Tech Companies Ask European Commission Not To Wreck The Internet -- And You Can Too (4)
09:00 Awesome Stuff: Play & Listen (1)
09:00 Awesome Stuff: Beyond Chiptunes (12)
09:00 Awesome Stuff: Updated Classics (3)
09:00 Awesome Stuff: Celebrating Cities (1)
09:00 Awesome Stuff: Crafts Of All Kinds (5)
09:00 Awesome Stuff: One Great Knob (13)
09:00 Awesome Stuff: Simple Geeky Toys (2)
09:00 Awesome Stuff: Gadgets For The New Year (18)
09:00 Awesome Stuff: A Post-Holiday Grab Bag (0)
13:34 How Private-Sector Innovation Can Help Those Most In Need (21)
09:00 Awesome Stuff: Towards The Future Of Drones (17)
09:00 Awesome Stuff: Artisanal Handheld Games (5)
09:00 Awesome Stuff: A New Approach To Smartphone VR (5)
09:00 Awesome Stuff: Let's Bore The Censors (37)
09:00 Awesome Stuff: Open Source For Your Brain (2)
09:00 Awesome Stuff: The Final Piece Of The VR Puzzle? (6)
09:00 Awesome Stuff: The Internet... Who Needs It? (15)
09:00 Awesome Stuff: The Light Non-Switch (18)
09:00 Awesome Stuff: 3D Printing And Way, Way More (7)
13:00 Techdirt Reading List: Learning By Doing (5)
12:43 The Stagnation Of eBooks Due To Closed Platforms And DRM (89)
09:00 Awesome Stuff: A Modular Phone For Makers (5)
09:00 Awesome Stuff: Everything On One Display (4)
09:00 Awesome Stuff: Everything Is Still A Remix (13)
09:00 Awesome Stuff: Great Desk Toy, Or Greatest Desk Toy? (6)
09:00 Awesome Stuff: Sleep Hacking (12)
09:00 Awesome Stuff: A Voice-Operated Household Assistant (19)
More arrow