News Publishers Admit They Get Value From Search Traffic, Even As They Demand Extra Compensation For It

from the revealing-their-true-beliefs dept

In recent years, major media organizations have been lobbying Congress to enact legislation, the “Journalism Competition and Preservation Act,” requiring search engine providers to engage in a form of collective bargaining about the tax they would pay to media publishers for the privilege of providing links to their news articles, backed up by mandatory interest arbitration in which the thumb would be placed on the scales by simply assuming that the search engine companies could not refuse to provide links and would be required to pay something. The contention of the “News Media Alliance”  has been that the search engines take value (access to news reporting that is expensive to produce) and provide nothing in return.

I have never been persuaded by the arguments for this bill, so I have long argued against it (and Public Citizen has never taken a position). Yes, news is expensive to produce (especially quality news), and the pervasiveness of online advertising has destroyed a major source of the media’s former revenue stream. Moreover, journalism is a social good that is vital to our democracy, at the local level as well as nationally, and it needs to be supported somehow (I put my money where my mouth is – our own family gets two newspapers in the dead tree edition every morning, and we subscribe to other publications).

But it always seemed to me that search engines provide value to the media – traffic to media websites,. Beyond that I am troubled by the First Amendment implications of creating a modern version of the tort of “hot news misappropriation,” not to speak of the “compelled speech” implications of requiring search engine companies to provide links and payments to speakers whose content they might abhor.  (The proposed statute would make it illegal for search engines to deny links to any entity represented in the collective bargaining process).

And it is easy to see through the news media’s economic argument. Such simple devices as robots.txt, “noindex,” and password protection could wall off any news media web page from search engines. But no media companies were doing that, because they WANT the traffic delivered by search engines. So it has always been clear that the media recognized the value of being seen by search engines.

The Ugly Truth

And now they admit it.

Now that the media feel threatened by new AI Search tools, which would deliver whole paragraphs in answer to search engine queries, the media industry’s lies about the economics of their relationship with search engines have been revealed.

The New York Times carries a story this morning, “Publishers Gird for Threat from A.I.” that includes these revealing admissions.

“Content publishers have an uneven but largely reciprocal relationship with search engines. The search sites benefit from having trusted sources of information in the results, and the publishers benefit from the traffic to their sites that the search engines generate.

“Search traffic from Google accounts for half of overall visits, or more, to many sites, said Brian Morrissey, who writes The Rebooting, a media business newsletter.

‘Search has been the mainstay of the publishing business on the internet,’ he said.”

And then there is this

“Kyle Sutton, director of search and product at the newspaper publisher Gannett, said the relationship had, until now, been mutually beneficial.

‘While all search results are taking from our data and, from our perspective, crawling our content, aggregating our content, there is the return there of them driving traffic to our site,’ Mr. Sutton said. ‘So I think that relationship is kind of first and foremost what we want to see maintained.’”

It would be worth looking to past hearings on the JCPA to see whether Sutton (or anybody else from Gannett) has testified under oath in contradiction to these startling admissions.

Legislation for the Future

The Times story indicates that the longtime sponsors of the JCPA plan to reintroduce that bill this week, but why? The news media now admit that they like the status quo; the JCPA would disrupt it. Of course, members of Congress love their media endorsements, so their willingness to truckle to local media should not be underestimated. But it makes sense to put a hold on the JCPA and think about a different kind of legislation.

Unlike search snippets, the delivery of entire paragraphs implicates copyright, without any need to create a new cause of action. And either an economic or a statutory compromise may be needed to avoid years of litigation over whether the replication of entire paragraphs of copyrighted text qualifies as fair use. Those considerations can only be resolved after years of high-stakes litigation and damages awards, as lower courts decide cases, legal tests develop, circuits disagree, and the Supreme Court weighs in, perhaps more than once.

Search engine operators and media groupings may want to enter into negotiations about the forms of payment that are required when entire paragraphs are being copied. A statute embodying such standards might take the form of compulsory licensing and some system of assessing appropriate payments for use, not just to the news media but to other sources of substantial online content.

The standards that are set by such discussions could well influence the fair use analysis as applied to non-participants, comparable to the models that the “Best Practices” initiatives  pioneered by Peter Jaszi and his colleagues in American University’s Program on Information Justice and Intellectual Property  have set in several areas of the law. The compensation systems set by such negotiations might also establish a market standard for lost license fees to be awarded in copyright litigation.

Paul Alan Levy is an attorney for Public Citizen Litigation Group. This post originally appeared on its Consumer Law & Policy blog, and is reposted here with permission.

Filed Under: , , , ,
Companies: gannett

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “News Publishers Admit They Get Value From Search Traffic, Even As They Demand Extra Compensation For It”

Subscribe: RSS Leave a comment
17 Comments
This comment has been deemed insightful by the community.
PaulT (profile) says:

“The search sites benefit from having trusted sources of information in the results, and the publishers benefit from the traffic to their sites that the search engines generate.”

…and it’s a simple task to stop Google from indexing if they feel it’s not a fair deal. Yet, they go to the courts to demand money instead of stopping Google from getting a cut with the tools they themselves provide.

“Search traffic from Google accounts for half of overall visits, or more, to many sites”

So, why are they not able to monetise the traffic sent to them for no additional cost? If Google are sending so much traffic, it can’t be a case of people reading snippets instead of going to the site, so what is it?

Vikarti Anatra (profile) says:

Is there rules who can be “any entity represented in the collective bargaining process” ?
Only pre-approved companies with specific owners? Looks like censorship to me.
ANYBODY? What about official goverment news services? No, not Russian or even Chinese ones. ISIL ones.
Only U.S.-based entities? What about other countries saying it’s censorship and trying to retaliate?

TaboToka (profile) says:

Simple solution (for Google)

Scrape every news site’s pages, then have tell Chat GPG to summarizes them in its own words. No linking necessary. Let them go down in flames.

If they haven’t bothered to adapt in the 30 fricking years they’ve known their subscription numbers have been falling (starting in 1991 for weekday editions, 1995 for Sunday’s), then they can die in a fire already.

Anonymous Coward says:

Confusing approach. You acknowledge that Google and other online search services are using content created by media companies to grab a large share of available advertising revenue. But then you seem to argue (and write a headline essentially saying) they shouldn’t be paid for their content because they get the benefit of additional traffic from Google and other search services. It doesn’t actually make a very good argument. Why is it that the additional traffic with lower ad revenues somehow justifies the financial losses overall to media companies.

As for free speech issues, you’re concerned that requiring search services to pay even a modest amount for the right to sell ads against the content might somehow impinge on freedom of speech. But there are also free speech implications of allowing search companies free use of content belonging to other organizations to sell ad revenue against.

Google, Facebook/Instagram (Meta) and other services make huge profits out of selling ads against distribution content others create. There’s not an infinite potential pool of ad revenue. Newspapers and other publishers who create much of this content are disappearing. Certainly this is a matter of balancing interests rather than maintaining a legal rule of free linking. Free is a price, actually, just one that is harmful to companies trying to create high quality content and maximizes revenues to search companies who continue to grab ever more share of ad dollars.

Just look at Google search — very helpful tool for finding stuff that is now buried in ever more paid links, that is, that finds ever more effective ways to grab money from content providers. It’s a system that favors publishers that spend lots of money on SEO and paid advertising links, and less money on content quality. There’s a free speech issue you’re missing here which is how this system financially undermines publishers’ ability to generate content and encourages inexpensive low quality information, you know, like that mountains of flimsy opinions that passes for our political dialog any more.

Anonymous Coward says:

Re:

Congress could have passed legislation to resolve this and chose not to.

Google doesn’t have to exist: we could have human-edited link farms or intelligent portals run by experts in a given field but we didn’t go that route (might have been better to spread the wealth and increase competition).

Search engines have an implied license to use what they find on the internet, until someone sets a precedent that says otherwise. Now we have Congress trying to legislate a carve-out for news, but why stop there? They also profit every time a celebrity’s name is searched.

Since there is a way to opt out with robots.txt that would make the implied-license argument stronger. I’d side with the search engines on this one but wouldn’t mind seeing laws written to change that.

Rocky says:

Re:

Confusing approach. You acknowledge that Google and other online search services are using content created by media companies to grab a large share of available advertising revenue. But then you seem to argue (and write a headline essentially saying) they shouldn’t be paid for their content because they get the benefit of additional traffic from Google and other search services. It doesn’t actually make a very good argument.

Now substitute “Goggle and other online search services” with “Yellow Pages and other phonebooks” and see if it makes sense.

Why is it that the additional traffic with lower ad revenues somehow justifies the financial losses overall to media companies.

What financial loss? And compared to what? And what do you think would happen to media companies ad revenue if all search traffic suddenly disappeared? If you want a real world example how that would look, just check out what happened in Spain.

As for free speech issues, you’re concerned that requiring search services to pay even a modest amount for the right to sell ads against the content might somehow impinge on freedom of speech. But there are also free speech implications of allowing search companies free use of content belonging to other organizations to sell ad revenue against.

Because forcing someone to pay for “saying” something unrelated but adjacent to a descriptive link is certainly a free speech issue. If the media company doesn’t like what the search engines are doing they can’t stop it at any time they want by adding robots.txt to their sites.

Google, Facebook/Instagram (Meta) and other services make huge profits out of selling ads against distribution content others create. There’s not an infinite potential pool of ad revenue. Newspapers and other publishers who create much of this content are disappearing. Certainly this is a matter of balancing interests rather than maintaining a legal rule of free linking. Free is a price, actually, just one that is harmful to companies trying to create high quality content and maximizes revenues to search companies who continue to grab ever more share of ad dollars.

My answer is the same as above: robots.txt
And if they aren’t happy about that, they can damn well start their own search engine and get all the ad revenue for themselves.

Just look at Google search — very helpful tool for finding stuff that is now buried in ever more paid links, that is, that finds ever more effective ways to grab money from content providers. It’s a system that favors publishers that spend lots of money on SEO and paid advertising links, and less money on content quality. There’s a free speech issue you’re missing here which is how this system financially undermines publishers’ ability to generate content and encourages inexpensive low quality information, you know, like that mountains of flimsy opinions that passes for our political dialog any more.

The free market at play I say. But asking Google et al for money when the alternative is earning less money without them is a funny stance to take. There are lots of businesses who earn money by providing value added services on top of other businesses but I don’t hear anyone asking them to pay for that privilege. If you can draw a line saying “these types of value added services must pay for the privilege” I’m certain that I can come up with a counter example which invalidates it.

Vikarti Anatra (profile) says:

Re:

Except that there is way to opt out.
Also, companies many countries tried to get money out of Google for it’s “abuse” (robots.txt wasn’t enough for them) but started to whine when Google just..stopped said abuse by stopped linking/using content from newspapers at all. More recent attempts at such legislation prevents google from choosing not to use materials from newspapers at all. So newpapers want traffic from Google AND money from Google.

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Subscribe to Our Newsletter

Get all our posts in your inbox with the Techdirt Daily Newsletter!

We don’t spam. Read our privacy policy for more info.

Ctrl-Alt-Speech

A weekly news podcast from
Mike Masnick & Ben Whitelaw

Subscribe now to Ctrl-Alt-Speech »
Techdirt Deals
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Loading...