Academic Paper Shows How Badly The Mainstream Media Misled You About Section 230
from the proving-the-media-distortion-field dept
We’ve had to publish many, many articles highlighting just how badly the mainstream media has misrepresented Section 230, with two of the worst culprits being the NY Times and the Wall Street Journal. Professor Eric Goldman now points us to an incredible 200 page masters thesis by a journalism student at UNC named Kathryn Alexandria Johnson, who did an analysis entirely about how badly both the NYT and the WSJ flubbed their reporting on Section 230.
The paper is actually more than just that, though. It includes a really useful description of Section 230 itself, along with its history, and some of the often confused nuances around the law. Johnson clearly did her homework here, and it actually is one of the best summaries of the issues around 230 I’ve seen. The paper is worth reading for just that section (the first half of the paper) alone.
But then we get to the analysis. Johnson notes that the Times and the Journal are basically the most powerful “agenda setting” newspapers in the US, so how they cover issues like Section 230 can have a huge impact on actual policy. And they failed. Badly.
The thesis explores the data in multiple ways, but one chart stands out: when talking about the impact of 230, both newspapers almost always frame the law as having a negative impact. They almost never describe it as having a positive impact.

That is, out of 116 articles in the NY Times that talk about the impact of Section 230, 107 described it negatively. Another six gave a combination of negative and positive, and only two (two!) described the impact positively. For the WSJ, it’s basically the same story: 88 articles discussing the impact of Section 230, 80 of them purely negative. Another four with a combination of negative and positive, and just three describing the law’s impact positively. That means, grand total, 91.7% of the articles in these two agenda-setting newspapers described the law’s impact as negative, with another 4.9% describing both negative and positive impacts, and just 2.5% describing the impact positively.
That’s pretty amazing. Now, some may argue that if you truly believe that the impact of Section 230 is negative, then these two publications are only being accurate in their descriptions. But, for those of us who have studied Section 230, and understand its broadly positive aspects, the whole thing seems crazy.
I’ve had many people argue over the years that the big newspapers like the Times and the Journal have an institutional interest in trashing social media and the internet, because it takes away from their gatekeeping powers. And I’ve always brushed that aside as an exaggeration. But the numbers here are pretty damn stark.
The paper also explores how these newspapers sought to frame Section 230, and found that they did a very poor job explaining how it has multiple functions, often choosing to focus on one framing — rather than a more accurate framing of how Section 230 is structured to encourage multiple things. It protects websites from being held liable as a publisher of third party content, which encourages more websites to allow for more speech, and it protects them from content moderation decisions creating liability, enabling them to cultivate their communities in the way they see fit. Understanding both of these is kind of important to understanding Section 230, but it appears that these papers rarely gave a complete description. Also, perhaps oddly (or perhaps because they’re just super confused themselves), they often used the publisher framing, even though they were really talking about the content moderation function — which may very well be why so many others, including politicians, are so confused about 230.
As previously discussed, the majority of definitions including only the “publisher” frame. Interestingly, despite a majority of definitions referencing only platforms’ protection from liability for the content posted by third-parties (59.5%), a large majority of articles were focused on the societal impacts of censorship and deplatforming. Such issues most closely map to the “content moderation” frame. And despite many of the articles’ focus on censorship and deplatforming, very few articles included definitions with only the “content moderation” frame.
For the purposes of creating the most informed electorate, the most helpful definitions are those that present both of Section 230’s functions. These articles were coded as “Both” when discussed above. Only a third of the definitions of Section 230 included both the publisher and content moderation frame, indicating a weakness in journalists’ reporting on this issue. Coverage in The Wall Street Journal more frequently defined Section 230 in terms of both publisher activity and content moderation activity than The New York Times, but coverage in The Wall Street Journal still mentioned both legal frames less than half the time. Journalists could improve coverage could be improved by including definitions that explain both legal frames associated with Section 230, regardless of the focus of the article.
Then there’s the question of how often these two famed newspapers just flat out got things wrong about Section 230. The data may be lower than you might expect, as Johnson found it happened 16.2% of the time, but that’s still kind of astounding. This is a fundamental issue that has gotten a ton of attention and to still get it wrong in about one out of every six articles is indefensible.

It is interesting, though, to note that the WSJ misrepresented the law at nearly double the rate of the NY Times. Again, people have pointed out that Rupert Murdoch, who owns the WSJ, has more or less declared war on the entire internet, and noted that could impact the coverage of things like Section 230. I always assumed that would be a stretch, but the data here is, once again, noteworthy.
As Johnson notes in her paper, many of the misrepresentations were not necessarily outright falsehoods (though there were some of those), but “rather statements lacking enough important context or requiring clarification.”
Then there’s this:
Every misrepresentation identified in the entire sample could be credited to an unattributed source. Therefore, journalists themselves were the source of each misrepresentation. This finding suggests that either journalists themselves do not fully understand the nuance of how Section 230 is applied or that journalists do understand how Section 230 functions but are not accurately conveying that knowledge to the reader
For what it’s worth, it may also be the fault of the editors, rather than the journalists. I am familiar with at least one situation in which a major newspaper misrepresented Section 230, and the journalist later explained to me that they had fought for the correct representation, but their editor insisted on running a misleading one.
Johnson’s paper also highlights how these misrepresentations can lead to further misunderstanding of Section 230.
Understanding that the First Amendment, and not Section 230, enables platforms to moderate content is important to social understanding regarding how platforms would function if Section 230 was reformed or repealed. Without the portion of Section 230 that precludes publisher liability, platforms would still be able to remove content, that for example violated their community standards; however, platforms would be less likely to do so because they would once again, be liable for any unlawful content that they did not remove.
Johnson also, correctly, summarizes what would actually happen with the removal of Section 230: there would be fewer places to speak online.
In fact, Australia’s high court recently ruled that news media outlets are to be treated as “publishers” of the unlawful content that is posted in comments sections on social media. In response, news media outlets began disabling their comments sections due to their inability to constantly moderate all comments. Removing the comments section was the easiest way to protect themselves from legal liability. This anecdote suggests that if Section 230 was changed and platforms were treated as publishers of third-party content, platforms would begin restricting users’ ability to post on their sites—severely stifling the ability of the public to share content and ideas online. Limiting the public’s ability to communicate online has negative implication for self-governance beyond just debate and discussion regarding Section 230. The internet provides a forum for citizens to ask questions, seek answers, and engage in debate about important policy issues. As a “vast democratic forum[ ]” the internet has democratized speech by lowering the barrier of entry for individuals to speak, be heard, and engage in debates about important issues facing society. In this way, Section 230 creates a causality dilemma. Section 230 is necessary to create the speech environment online that is required for individuals to debate and discuss issues related to Section 230.
Johnson’s paper also highlights how many stories about 230 inaccurately refer to it as a “safe harbor” rather than an “immunity.” As it notes, this is an important distinction. DMCA 512 is a safe harbor, and in order to make use of it, you need to meet a bunch of qualifications. This is why there is a long history of case law involving extensive litigation about a bunch of different factors to determine if a site qualifies for the DMCA safe harbor or if it “loses” the safe harbor. But 230 is an immunity, which is different. You can’t lose an immunity. You don’t have to take any steps to get the immunity. And one of the biggest misconceptions about 230 is that sites can take some sort of action that loses them the protections. That’s not true, but when news organizations report on it as a safe harbor, they support that misconception.
There’s much, much more in the paper, but it’s quite an excellent thesis, incredibly detailed, including getting a lot of very nuanced and complex topics correct that (as the paper itself shows) journalists often get very, very wrong. And it also adds clear data to the discussion. Just an all around excellent piece of scholarship.
Filed Under: 1st amendment, immunity, kathryn johnson, misleading, narrative, reporting, safe harbor, section 230
Companies: ny times, wall street journal, wsj


Comments on “Academic Paper Shows How Badly The Mainstream Media Misled You About Section 230”
Once upon a time media would have enough integrity to report the news accurately.
Nowdays there is spin from all sides and people still think its mostly truthful.
While 230 isn’t the same as Trumps ‘Big Lie’, looking at the reporting its really hard to see where the outlets actually differ.
They promote things that aren’t actually true that they seem to have a stake in the outcome of.
Its a pity to see those that once had good reputations take a speed run to being on the level of Faux News.
Re:
I guess if you’re going to tell us a fairy tale, you may as well start it off with the traditional opening.
Re: Re: I guess...
What wold that line be, Snoopy’s famous “It was a dark and stormy night”? I’d make it more like “It was a dark and stormy two decades at the beginning of the century”.
Indeed, I can’t pinpoint the precipitous moment with any feeling of confidence that I’d be accurate, but somewhere along the past 22 years, I perceive that the general news media did indeed execute a hard 180 away from reporting the news, and started spewing Kool-Aid all over the place. (Yeah, yeah, it was actually Flavor-Aid, but just how many people are at all familiar with that brand?) My personal bet? I’d nominate R. Murdock as the primary cause. But then again, I’ve been wrong ere now, so who knows?
Re: Re: Re:
Hindsight says always, but it only got worse when Murdoch showed that transnational lying and info control could be profitable.
Re: Re:
So why don’t you start us off, then?
Once upon a time, the mainstream press was never known for accurate reporting* about anything.
*Please note that “accurate” isn’t the same thing as “nonbiased”.
Pedantic comment
Wonderful article and I hope the paper gets a lot of attention.
But I couldn’t help but notice the percentages in the charts didn’t add up. 107 out of 116 is 92.2%, not 52.5% in the first chart.
They were correct for the total but not for each of the sources. Minor quibble with a great paper. I hope this error isn’t used to discredit it.
Re:
But 107 out of 204 is 52.5% …
Re:
No, the percentages are correct – look at the note below the chart, N = 204, which the absolute number columns refer to as n.
So, 107 out of 204 is ~52.5%
The chart could have been made much better to avoid confusion and misinterpretation you just experienced.
Re: Re:
Or they could have just calculated the percentages for each paper because that would be the more interesting and relevant number than “stories that treat the impacts of 230 negatively in the Wall Street Journal as a percentage of stories talking about the impact of 230 across both papers”.
Re: Re: Re:
The way the chart is organized it looks like it is supposed to be calculated for each paper with a total calculation at the end.
It looks sloppy, and again, I hope that doesn’t open the paper up to undue criticism.
Misconceptions
I don’t want to read all 200 pages to find out but I wonder if they found where the misconception arose that there is a difference between a publisher and a platform in section 230. I would be interested to find out where that one came from.
Re:
I strongly suspect it emerged from a professional propaganda firm given its sudden ‘full court press’ appearance. Even after Eternal September’s beginning people’s understanding wasn’t regressing like it did then. Even among the ‘chain email curse’ weak critical thinking crowds. A dip in understanding is to be expected with more new users but it was never that bad even when people feared Y2K would lead to the end of the world instead of decreased earnings or bankruptcy at worst from incompetent companies.
Companies did some very shitty things like deliberately banning all child abuse survivor’s forums. Everyone pretty much called them stupid assholes in various tones but they recognized that they were the company’s systems.
This is just a suspicion, noting that PR firms and lobbyists tend to operate silent then go loud and widespread. Lack of a trail is circumstantial evidence at best admittedly. as opposed to the memetic fermentation that occurs with other bad ideas and myths growing like when 4Chan managed to accidentally brainwash themselves with their own hoaxes.
These are all suspicions. For all I know it could all have come from some circle we don’t follow at all, like some US State Senator on Talk Radio or something.
This comment has been flagged by the community. Click here to show it.
Google just lost a defamation case in Australia for 515,000 from a guy defamed on yt videos.
No section 230 yet they still exist in Australia.
Re:
Google still exists because they’re large enough so they can afford the liability. If it were a startup, that would be the end of them.
Strangely, this hasn’t occurred to you.
Re:
And your comment solidifies why we need §230 here in the US.
Although the big-tech companies can easily handle a $500k fine (and big-tech makes up a VERY SMALL PERCENTAGE of internet companies), almost every other company that has an internet presence can not afford that (I would guess that includes over 90% of business operating on the internet).
That is why §230 is so important, it protects the smaller companies from frivolous lawsuits that would otherwise bankrupt them.
This comment has been flagged by the community. Click here to show it.
Re: Re:
So Section 230 (which allows harm to politicians like this) is NOT vital to a tech company’s existence. In that case, it would seem that individual reputations are not “acceptable harm” that can be justified.
Those who can’t set up their own YT or Twitch or whatever can operate fine within their framework. How much did PewDiePie make again?
230 needs to be tweaked so that it doesn’t harm individual reputations.
Re: Re: Re:
Talk about a dishonest argument. You are basing your conclusion that it’s not vital by using one of the largest company’s financial resources to deal with lawsuits – but what about a company that is a startup? Do you think they have a horde of lawyers and the resources to deal with a lawsuit costing hundred of thousands of dollars? Because the whole point of section 230 is to pre-empt frivolous lawsuits, its kind of analogous to anti-SLAPP laws but I don’t hear anyone sane complaining about those.
And here you make it clear that you are actually a Google-shill by sheer stupidity, because your whole argument is essentially making sure they will always be the dominant platform.
Which has zero relevance since he isn’t a competitor in any way.
A law can’t harm reputations, only people can do that.
Re: Re: Re:
Remember: Section 230 poses no obstacle whatsoever to any lawsuit that has even the smallest bit of merit to it.
Re: Re: Re:2
Circular logic: 230 precludes many meritorious claims, like the one that just cost Google 515k.
Americans can sue over there anyway. Maybe some will.
Re: Re: Re:3
If everybody who took offense sued social media companies, social media would not exists, and only letters to the editor would be allowed. Even the mighty Google can be bled dry of money if sued often enough.
Re: Re: Re:3
For someone who boasts having a lot of meritorious claims, it is very strange you’ve never put your credentials to an actual lawsuit against a person you loathe with every fiber of your being.
Re: Re: Re:3
Said npbody with any capacity for logic, ever.
You’ve never demonstrated a single one, because “Sue over first-amendment-protected speech” and “sue party B for something party A wrote” are wholly fraudulent claims with zero merit whatsoever in any law-abiding US court.
Re: Re: Re:4
(Note: those claims were also not in any way meritorious Before Section 230, and would not magically become so in its absence. Contrary to illogical false narratives, 230 has zero influence on whether a claim has merit or not; is sole function is to expedite the dismissal of those without.)
Re: Re: Re: tiny *and* impotent
Hey John Boi how much did you make off all those lawsuits you promised?
Re:
Are you seriously this dense, or are you just acting really well?
That fine is 0.0006% of Alphabet’s profits last year. They couldn’t give less of a fuck about the existence of section 230.
Re: The fat lady hasn't yet sung
Should they wish to do so, Google can still appeal to the High Court, the highest in the country. Federal Courts are one level below.
And if that doesn’t work, I’m not so sure that the recent Legislature findings of platform culpability (meaning that platforms are indeed publishers of 3rd party content and not just providers of tools) will continue being attractive to big businesses like Google. Even for the levels of ad money involved here, there will eventually have to be a hard look at the bottom line, and just how much of that ad money is going to lawyers instead of personal yachts, condos in the Bahamas, and such like.
Upstarts that threaten/promise to fill the void, should Google disappear, are going to have an even tougher time of it, as they realize that the law applies to them as well (and if it doesn’t, it will be modified to suit Murdock’s greed). Trust me, Wall Street will have a hand in these decisions, and Google/Alphabet is not big enough to tell them to go take a hike.
This comment has been flagged by the community. Click here to show it.
Re: Re:
“Sorry we can’t do business in your country because the individuals whose lives would be ruined through our site would sue us into bankruptcy.”
The harm to the individuals is clear while the justification for this harm is not. Spreading defamation (distributing it) is as or more harmful than speaking it.
A smaller site would have removed the videos and faced no liability. People have no problem censoring “disinformation” about major issues will libel is disinformation about an individual.
Some of the lawyers whose names have appeared on this site have gone to bat for sites which exist primarily to destroy someone’s reputation or even drive them to suicide, and the owner(s) of said sites say they’d have to shut down without Section 230.
Might want to check a major network’s investigative journalist shows in five or six months.
Re: Re: Re:
You’ve got nothing, John Smith. How’s that mailing list coming along?
Re: Re: Re:
Only in your befuddled head, because you have no clue about what being consistent means.
Oh, it’s you – the looser who comes up with vague threats about police investigations and other shit and how we’ll all rue the day blah blah blah. It’s just plain sad how you desperately seek validation of your perceived importance.
Re: Re: Re:2
u mad? LOL
Re: Re: Re:3
U mad? LOL
Re: Re: Re:3 Remeber when you tried to fight me in NYC?
If by mad you mean still laughing at all your empty and impotent threats after all these years, then yes, we mad.
Re: Re: Re: How many women did you harass? Or was it boys?
“Might want to check a major network’s investigative journalist shows in five or six months.’
Oh they gonna do a story on all the online reputation fixing scams you run?
230 is important for any company that hosts user content but especially important for small websites forums that appeal to minoritys and provide a venue for free speech and political discussion . If websites can’t moderate to their own standards and block trolls and Spammers they will become unusable for ordinary users
Facebook and Google have the resources to survive if section 230 is weakened other small websites would probably shut down to avoid expensive lawsuits
If new York Times gets the basic facts about 230 wrong one wonders can a reader rely on the truth and accuracy about its reporting on other subjects that are more complex and hard to report on.
Re:
Small “websites” can exist under the umbrella of larger tech companies. PewDiePie never needed a website.
Re: Re:
Pewdiepie isn’t a website, talk about conflating things to the extreme in an effort to make some absurd argument that ignores factual reality.
Re: Re:
PewDiePie never needed a website.
Right, because YouTube isn’t a website. *double checks address of https://www.youtube.com* Oh, wait…
Re: 'Not the briar patch, anything but that...'
Facebook and Google have the resources to survive if section 230 is weakened other small websites would probably shut down to avoid expensive lawsuits
Which is why the larger companies have jumped on board the ‘cripple or revoke 230’ bandwagon, something which should get those believing that gutting 230 is the way to ‘punish’ those companies to rethink their position because when your ‘enemy’ is pushing for the same thing you are you might not be threatening them after all.