How California’s ‘Transparency’ Bills Will Only Make It Impossible To Deal With Bad Actors: Propagandists, Disinfo Peddlers, Rejoice

from the why-california,-why? dept

It is bizarre that the California legislature, in a state that has produced most of the biggest internet companies out there, has apparently decided it wants to destroy them all in a flood of purely vexatious litigation. There are a whole series of bills that the legislature is reviewing, and so many of them are terrible — yet seem very likely to be passed by the legislature and signed into law by Governor Gavin Newsom. While bills like AB 2408 (with its ridiculously impossible “don’t addict kids”) language have received more attention, I want to talk about a pair of bills (slightly conflicting bills!) that seem likely to pass and have received somewhat less scrutiny, in part because of the myth that these are “merely” about “transparency.” The bills in question are AB 587 and SB 1018.

Most of this post will focus on 587, and I’ll fill in some details on 1018 at the end, but I will note that as far as I can tell, the California legislature currently seems completely oblivious to the fact that these two bills that are both rushing forward at breakneck speed, appear to claim to do the same thing… in ways that would conflict with one another. This would be hilarious if it weren’t so stupid.

So, AB 587. We already had a long and detailed breakdown of the many, many, many technical problems with the bill by Professor Eric Goldman. I highly recommend reading that post, though I warn you that if you believe in supporting an open internet, and you have any hair, you may tear it out by the end.

Instead of picking through the many, many problems of the bill, I wanted to explain why the bill is totally unworkable from the perspective of someone who lives in reality and understands how the internet works. Because it’s clear that the authors of this bill have no clue.

The bill is framed as being about “transparency.” And, transparency is good. Promoting and encouraging more transparency, especially from internet services is a theme that we’ve pushed here at Techdirt for over two decades.

But there’s a big difference between encouraging more transparency, and mandating transparency in a manner where it can (and will) be weaponized to attack companies for anything they do that you dislike. And AB 587 is very much a version of the latter.

In short (and, again, I encourage you to carefully read through Eric Goldman’s careful dismantling of every part of the drafting of the law), the law requires decently large internet companies to “publish” their terms of service (loosely defined), and send them to the California Attorney General every quarter. It also requires that those terms include a bunch of things about how they deal with certain types of content (including so-called “lawful, but awful” content, as judged by the California government). It also requires descriptions of processes and remedies for dealing with user complaints.

And some of that sounds good… if you have basically zero experience with running a website, but have the chutzpah to think you know how it all works. Running a website that allows third party content of any kind is a constant battle against those with malicious intent, to create a workable, useful, and safe environment for the users you’re actually trying to serve. The malicious entities you’re battling while running a website vary and change at all times. It can include spammers. It can include hackers. It can include garden variety trolls. It can include political operatives seeking to spread propaganda. It can include nation states. It can include scammers and extortionists. It can include grifters. And that’s just a sampling. The list is ridiculously long.

Almost all of these transparency proposals assume that all users (and all consumers of the transparency reports and readers of the terms of service) are there in good faith. But they’re not. As we’ve discussed recently (in a different context) regarding Twitter and its bot/spam situation, there are a lot of malicious users.

And they don’t stand still.

They don’t use the same techniques. It’s a dynamic situation, in which they are constantly probing and evaluating.

And that means that social media platforms have to constantly be adapting as well. And AB 587 makes that effectively impossible. Because sites need to publish very specific terms and it opens them up to facing a legal challenge if they fail to live up to their terms, you’ve now created two problems for online services — and two lovely openings for malicious actors.

First, thanks to these publicly revealed policies, malicious actors now have more ability to figure out how to game the rules. We already see bad faith actors (usually in the political realm) whine and complain about how they are treated unfairly and try to “litigate” publicly how whatever sketchy thing they did did not technically violate the rules (or to claim that they were treated differently than someone else, usually ignoring important contextual differences). And now, companies will be required to publish a much more clear blueprint for how to tiptoe around the rules, and still be a bad actor, but without tripping the officially declared rules.

Second, while the California assembly removed the private right of action part of the bill that would allow anyone to sue (which would have been even more ridiculous), it still allows a wide range of government officials to sue any company that they deem somehow did not live up to their terms of service.

Actions for relief pursuant to this chapter shall be prosecuted exclusively in a court of competent jurisdiction by the Attorney General or a district attorney or by a county counsel authorized by agreement with the district attorney in actions involving violation of a county ordinance, or by a city attorney of a city having a population in excess of 750,000, or by a city attorney in a city and county or, with the consent of the district attorney, by a city prosecutor in a city having a full-time city prosecutor in the name of the people of the State of California upon their own complaint or upon the complaint of a board, officer, person, corporation, or association.

That’s… a decently big list. And local prosecutors are kinda known for loving the limelight. And what better limelight is there than suing Twitter or Facebook or Google because someone in your town claims that they were unfairly banned from social media?

Even worse, the bill incentivizes local government officials to file these kinds of suits by giving them a cut of the proceeds.

If the action is brought by a district attorney or county counsel, the penalty collected shall be paid to the treasurer of the county in which the judgment was entered. If the action is brought by a city attorney or city prosecutor, one-half of the penalty collected shall be paid to the treasurer of the city in which the judgment was entered, and one-half to the treasurer of the county in which the judgment was entered.

The idea that this won’t be abused is laughable.

So, now you’ve both given bad actors a roadmap, and there are political and financial incentives for local prosecutors to go after these companies for any attempt to stop bad actors that was not clearly laid out in the terms of service. That’s a terrible combination, and one that simply enables more bad actors. And that’s somewhat hilarious, because many of the politicians pushing AB 587 claim they’re doing it to encourage websites to do a better job stopping bad actors. It will do the opposite.

There’s one other aspect that is important to call out here. Requiring companies to file reports on their terms of service and enforcement efforts almost certainly guarantees less activity on that front. Because now, every change in the terms and every enforcement action is a regulatory matter. That means it often (always?) may need to be reviewed by legal. And that greatly limits the freedom of these companies to adapt in real time to very serious and dynamic threats.

At a more fundamental level, this entire thing would seem somewhat crazy in almost any other context. Imagine the same kind of bill written for cable news, telling them they need to publicly reveal and file with the state their editorial policies, including what kinds of stories they’ll publish, and what they won’t, and if they violate that policy they could face massive fines in cases brought by government officials at basically any level.

Most people would immediately recognize the obvious 1st Amendment concerns.

But for whatever reason, the California legislature seems oblivious to it.

Speaking of obliviousness of the legislature… that brings us to SB 1018. As mentioned earlier, this bill seems to be doing the same thing. Perhaps because an earlier version of this bill did a hell of a lot more, no one in the California legislature has realized that these are two conflicting bills that both seem to be targeting the same issue in different ways.

SB 1018 was originally a dangerously unconstitutional bill trying to force websites to pull down COVID misinformation. Perhaps because actual lawyers who actually understand this stuff explained to the legislature that the 1st Amendment doesn’t allow that kind of thing, the bill was amended and revised until… it’s now just another transparency bill. Just slightly different from AB 587.

SB 1018 requires a social media platform to disclose the following information on a regular basis:

statistics regarding the extent to which, in the preceding 12-month period, items of content that the platform determined violated its policies were recommended or otherwise amplified by platform algorithms before and after those items were identified as in violation of the platform’s policies, disaggregated by category of policy violated.

This is a different level of transparency reporting from AB 587, and because the bills come from different places in different ways, SB1018 involves a different kind of reporting process of different kinds of content. But, it’s also demanding information that is confusing and difficult to keep track of. What does it mean to “recommend” or “otherwise amplify” content here? Neither term is defined in the law, and it seems like both could be subject to extensive (ridiculous) litigation.

It does appear that one of the more recent amendments to this bill was to try to align it with AB 587… but they did so by importing many of the problems of AB 587 into this bill — enabling the identical local prosecutors to sue over failure to abide by this law, and the hugely problematic definition (and exemptions) for a “public or semipublic internet-based service or application.”

Once again: transparency is a good thing. We should all strive for having more transparency in general. But having the government mandate a pointless type of transparency — one that only serves to help enable more bad acts from more bad actors — while enabling local prosecutors to make a name for themselves (and help fill the local coffers) by filing frivolous lawsuits under this bill, you’re not helping solve the problems of modern internet services.

You’re making them much, much worse.

Filed Under: , , , , , , , ,

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “How California’s ‘Transparency’ Bills Will Only Make It Impossible To Deal With Bad Actors: Propagandists, Disinfo Peddlers, Rejoice”

Subscribe: RSS Leave a comment
Naughty Autie says:

It is bizarre that the California legislature, in a state that has produced most of the biggest internet companies out there, has apparently decided it wants to destroy them all in a flood of purely vexatious litigation.

This is also the state that voted Arnie the Octopus in as State Governer, so writing horrible bills wouldn’t be amongst its first stupid decisions.

Ehud Gavron (profile) says:

Local politicians craving the limelight

Great writeup. Hats off to Eric Goldman and Techdirt for daring to touch this nuclear pile of ***t.

And local prosecutors are kinda known for loving the limelight.

Local prosecutors can do disastrous damage that will last for centuries if the crap they pull becomes precedent law.


2016 – CA DA Kamala Harris testifies under oath to Congress that she can’t stop “sex trafficking” (catchall term for anything she doesn’t like) because of CDA Section 230.

2018 – Despite that, Kamala issues arrest warrant for Backpage.COM owners and then has servers seized and those owners arrested. $500M/yr business becomes $0/yr business with millions of dollars in lawyer fees for the owners, and millions of dollars of fees in taxpayer burdens. Again, not only was there no “sex trafficking” but Backpage gave LEOs lots of leads on people who were TRYING to post advertisements that would have violated CSAM online.

2021 – Mistrial declared. There was no evidence of “sex trafficking” and it was only used in introductory paragraphs to prejudice the jury.

2022 – Trial set for February is on hold pending an appeal on double jeopardy to the Ninth Circuit. Those hearings aren’t going to start until September 2022.

So this small-minded local politician who is now the vice-president of the United States, either lied under oath to Congress or acted unlawfully in arresting the Backpage owners and seizing their servers. Pick one. She has not been charged with either perjury or of violating her oath of office. It’s not “just” DJT that gets away with doing WTF he wants. Kamala is in on it too.

This small-minded local politician brought forth an incompetent prosecution that quickly ended up in a mistrial. Here we are six years later.

Local politicians craving the limelight can do much collateral damage.,force%2C%20fraud%2C%20or%20coercion.

There are a lot more links, but these are summaries that don’t overlap too much and cover all the high ground.

Can you [the reader] imagine ruining the lives of these owners and the many people they employed for SIX YEARS without an end in sight, and a constant financial drain to keep lawyers happy? If YOU were the target of such a malicious and unlawful (see “Pick one” above) prosecution, at what point would you no longer put it as “Local politician craving the limelight” and more like “Local politician going rogue, ignores the law, gets away with it, pretends to be a force of good.”


This comment has been flagged by the community. Click here to show it.

This comment has been deemed insightful by the community.
Anonymous Coward says:

These aren't about transparency

These bills really have nothing to do with transparency.
They are nearly impossible to comply with by design. The goal of these bills is obviously to give state officials the ability to punish companies for hosting content they don’t like or for refusing to host content they do like. And they will be selectively enforced against smaller companies based on what content they host. Larger companies who can fight back will be targeted for political grandstanding purposes whenever it helps a political campaign. Suppression of free speech in the first case, and waste of taxpayer resources in the latter.

Anonymous Coward says:

…. hugely problematic definition (and exemptions) for a “public or semipublic internet-based service or application.

Well, that solves the issue right there – with the exception of a single class of sites, virtually all sites, services and/or applications are private, and that comes from no less than SCOTUS itself. The only public (and what constitutes “semi-public”?) sites all have a TLD of .gov.

I have to wonder, how long will these big tech companies remain in the state, if perforce the definitions are amended to fix my above assertion. I think it would be a toss-up – would it be cheaper to move, or to simply sue the state in a federal court for enacting such a blatantly un-Constitutional law.(1) Might be interesting to see how that plays out.

1 – Check out the legal term ultra vires, whereby an act is performed without proper authority.

Lostinlodos (profile) says:

Dear Mr Mike.

Like that?
As I’ve said before, you know who I am. We’ve butt heads online off site. And offline.

We agree that these bills are shite for very different reasons. But I must, as always, call out my disagreement on lack of detailed rules!

…constant battle against those with malicious intent

And I’ve always said that’s the very job of a moderator.
If content exceeds ability, hire more mods! My four years at SB as LostOne, I’ve learned that nothing can be done to not be worked around and stay within the rules.
And you know how they deal with that as they just shove all the crap into the sandbox.

I have a serious problem with sites not being specific.
As you know, that stems from my political Libertarian view that you can not/should not be prosecuted for violation of law that is not explicitly stated.
Which breaks down to my land, my law. But we must know what the rules are before we’re punished for them.

But what we have here is the opposite end of Texas and Florida.
Ca is trying to shut down speech. Fl and Ty are trying to force it.

What I can’t wrap my brain around is how any of these states intend do do anything to the targeted companies.
The vast majority of US internet options are registered in Delaware!
If in the US at all.
History shows 9 in 10: a lawyer say wrong state and the case is either tossed or transferred.

These laws are pointless long before getting into 1A issues!

What is California going to do? (Fl, TX, ++)
You can’t shut down a Delaware company. You can’t raid/seize servers in Canada or Virginia!

Apple’s terror-phone case proved you can’t even use local law against local residents if none of the data source is non-local!

The best case for the states here is a law to punish resident users.
The worst, a series of state level end-user filters. Easily bypassed by a vpn.
And no: not knowing a vpn is not going to stop anyone. Everyone knows anonymouse. Hide my ass.

These laws are signs of stupid people with stupid ideas doing stupid things for stupid reasons.



Nice. Millions in tax dollars make users completely untraceable. Good job stupid.
Not that untraceable is bad—or good. But definitely not what these laws intend.

On the plus, for liberal minded people: bills like this will send large chunks of the population into untraceable internet use. Where CAL goes, NY follows. And that’s a major chunk of the entirety of the country’s population.

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Deals
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...