No, Google Isn't Hiding Elizabeth Warren's Emails To Promote Mayor Pete

from the not-how-it-works dept

Content moderation at scale is impossible. This time, it’s email content moderation. This week a new publication called The Markup launched. It’s a super smart group of folks who are doing deep data-driven investigative reporting of companies in and around the tech space — and I’m very excited to see what they do. I was going to write about the project overall and its goals, but instead I’m going to write about one of its first stories, done in partnership with the Guardian, entitled Swinging the Vote?, and which looks at Gmail’s filtering system, specifically as it regards political emails from Presidential candidates.

A few years back, Google added the “Promotions” tab to Gmail, as a way of hopefully, automagically sorting not-quite-spam emails, but general promotional emails that you probably don’t want cluttering up your inbox. Personally, I don’t use it, as I use a different filtering setup entirely that overrides Gmail’s defaults. However, for many people it’s proven to be quite useful. The reporters at The Markup conducted a worthwhile experiment:

The Markup set up a new Gmail account to find out how the company filters political email from candidates, think tanks, advocacy groups, and nonprofits.

We found that few of the emails we?d signed up to receive ?11 percent?made it to the primary inbox, the first one a user sees when opening Gmail and the one the company says is ?for the mail you really, really want.?

Half of all emails landed in a tab called ?promotions,? which Gmail says is for ?deals, offers, and other marketing emails.? Gmail sent another 40 percent to spam.

Very interesting! What was perhaps even more interesting was the chart — which quickly rocketed around social media — showing that some candidates had their emails go into the Primary Inbox at a much, much higher rate than others:

You’ll notice a few standouts. 63% of Pete Buttigieg’s emails made it to the Inbox, as did 47% of Andrew Yang’s. Everyone else was much closer to 0% with quite a few — including both Elizabeth Warren and Joe Biden — at 0%.

The reporters at The Markup also published a companion piece that gives the details of how they went about doing this research and (yes!) they even provide the data and the code on Github. This is a fantastic and transparent way of doing such journalism — and I applaud them for that.

However, the very framing of the original story itself… is problematic. It’s one thing to be open about how you conducted the research. But starting with a title like “Swinging the vote” and highlighting the chart above almost immediately resulted in lots of people on Twitter assuming (or suggesting) that Google was doing this deliberately, and that they were purposely making the decision to tilt the playing field towards Buttigieg. This includes vocal big tech critic Roger McNamee, who declared this was evidence that “Gmail has its thumb in the scale.” Another Google critic, who is fond of misleading conspiracy theories about the company, called it “election meddling” and claims that Google was giving certain candidates “special treatment.”

Except… that’s almost certainly not the case. No one at Google on the Gmail spam team is thinking about promoting one Presidential candidate over another. Instead, this is just yet another example of Masnick’s Impossibility Theorem, but applied to email moderation, rather than social media. Content moderation at scale is impossible to do well and will always piss off some people.

Indeed, looking over the data, the most obvious and most likely solution is simply this: Buttigieg and Yang hired competent email marketers who know how to craft emails that are (1) less likely to trigger the algorithm, and (2) less likely to be clicked on as spam by users (an important signal that feeds back into the algorithm). The rest of the candidates… did not. And thus, their emails went to the promotions and spam folder because they had characteristics that are more closely associated with promotions and spam. And, yet, The Markup story doesn’t bother to get into any of that — and thus leaves the speculation wide open, allowing plenty of folks to leap in.

Again, I’m super excited about The Markup as a project and believe it will put out plenty of important and impactful journalism in the days, weeks, months and years to come. I recommend people read over The President’s Letter from the site’s President Nabiha Syed (a past podcast guest) and Editor’s Letter from Julia Angwin — both of which present a compelling vision of what The Markup will be.

But this story shows how important context is in presenting a story. This is a data driven story — which is great. But if the necessary context is not provided, especially on a topic so fraught with speculation, people are going to rush in and jump to conclusions. The Markup itself did not directly say that Google was doing this deliberately, but its total failure to suggest why this might be happening, along with a cringe-worthy headline, opened the door for others to jump in and assume as much — and that’s a shame.

Filed Under: , , , , , , , , ,
Companies: google

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “No, Google Isn't Hiding Elizabeth Warren's Emails To Promote Mayor Pete”

Subscribe: RSS Leave a comment
Anonymous Coward says:

Deeper problem than moderation at scale

Really these attitudes are far worse than trying to moderate a large collection automatically and consistently without errors. It is worse – entitled politicians and plebs who believe that if you do not promote their world view you are conspiring against them. This is Roko’s Basilisk but with a millions of different insane intelligences whom wish to punish you for not doing the impossible which you had no way of knowinf instead of one.

Federico (profile) says:

Simpler explanations

The rest of the candidates… did not. And thus, their emails went to the promotions and spam folder because they had characteristics that are more closely associated with promotions and spam.

That was my guess before looking at the data, but after looking briefly at it I’d question whether this is really the case. The content and features of the emails might actually be rather similar; maybe Yang and Buttigieg used less popular software, not as well known to Gmail’s filter as NationBuilder and ActBlue which are used by many of the others.

Scary Devil Monastery (profile) says:

Re: Re: Simpler explanations

"Yang and Buttigieg developed emails that 1) are less likely to trigger the algorithm…"

That’s what occam’s razor provides for an answer.

Now if I designed an anti-spam filter the very first thing i’d put in it was some of the key statements usually found in political boilerplate. If Yang and Buttigieg ended up NOT drawing on established campaign procedure their campaign emails are far more likely to not contain the specific trigger phrases the anti-spam algorithm has been programmed to register as "junk".

This comment has been flagged by the community. Click here to show it.

That Anonymous Coward (profile) says:


The problem is not all campaign emails are the same.

Some follow a "tried & true" pattern that they have always used & OMG those get flagged as promotions b/c it looks like 5000 other promotion emails.

Sometimes the "tried & true" pattern is adopted by scammers to look more legit. (Side note 45 emails about my apple account sent to an email I rarely use… some look convincing).

Everyone wants to find a pattern of abuse to tie together all of the crazy ideas & make them be true… and not just unrelated things that sometimes happen.

People believe stupid things.
When the No Call List was suggested, they quickly moved to make sure political calls didn’t get stopped…. because everyone loves politicians so much. I’m sure there were evil thoughts about how 1 party would block the other.
Why did they never consider making political calls opt-in?
Why not let people who don’t want 300 surveys & campagin calls not get them??
If politics is so beloved of course people would opt-in!!
Oh and we need to keep those robocallers in business, even if in doing this we cleared the path for bad actors to get confirmed lists of numbers to abuse.

This comment has been flagged by the community. Click here to show it.

Anonymous Coward says:

Cool experiment, Crappy journalism based on a Shitty assumption

Yes, MM. Nice article (by you) and cool experiment (by them).

But the journalism is sensational rubbish. What fraction of a fraction of a percentage of US voters will make their voting decision from the subscribed emails?

Eh? Batshit crazy.

And the crazier bit is that people are actually taking this seriously. Its like RussiaGate (another hot tub of rubbish) has blown peoples minds apart.

Add Your Comment

Your email address will not be published.

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Deals
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...