Confirmed: TSA's Behavioral Detection Program Is Useless, Biased, And Based On Junk Science

from the come-fly-the-discriminatory-skies dept

Thanks to FOIA requests (and lawsuits), the ACLU has gathered enough documents to provide a comprehensive report [PDF] on the worthlessness of the TSA’s “Behavioral Detection” program. Meant to give the agency a better way of proactively thwarting acts of terrorism, the program instead opts for lazy profiling, dubious readings of behavioral cues, and junk science.

The documents show the evolution of the behavior detection program and make clear the extent to which it is a program of surveillance of unsuspecting travelers based on unreliable indicators. “Behavior detection officers,” some of them dressed in plain clothes, scrutinize travelers at airports for over 90 behaviors that the TSA associates with stress, fear, or deception, looking for what the TSA calls signs of “mal-intent.” The reliability of these so-called indicators is not supported by the scientific studies in the TSA files. The behavior detection officers may then engage travelers in “casual conversation” that is actually an effort to probe the basis for any purported signs of deception. When the officers think they perceive those behaviors, they follow the travelers, subject them to additional screening, and at times bring in law enforcement officers who can investigate them further.

The TSA has repeatedly claimed that the behavior detection program is grounded in valid science, but the records that the ACLU obtained show that the TSA has in its possession a significant body of research that contradicts those claims. The records include numerous academic studies and articles that directly undermine the premise of the program: the notion that TSA officers can identify threats to aviation security with some reliability based on specific behaviors in an airport setting. In fact, the scientific literature in the TSA’s own files reinforces that deception detection is inherently unreliable, and that many of the behaviors the TSA is apparently relying on are actually useless in detecting deception. The documents further show that the TSA either overstated the scientific validity of behavior detection techniques in communications with members of Congress and government auditors, or did not disclose information that discredited the program’s scientific validity.

There’s nothing good in the ACLU’s findings. In addition to the contradictory lists of “behavioral indicators” that would make pretty much every traveler suspicious, the documents also include a “Behavioral Detection” presentation [PDF] that shows the compiler’s inherent bias. For no appropriate reason, the presentation includes the following images:

Right above these questionable images is something just as questionable: a profile of “female suicide bombers” that pretty much encompasses the entirety of the female gender.

If you can’t read/see the picture, the female suicide bomber profiles reads as follows:

Single, married, mothers or grandmothers

High school and college students

Working professionals such as lawyers, journalists, or medical practitioners

Devout or non-devout in religious beliefs

Intelligent, charming, and attractive

Very active in their cause

The cost of this program — which simultaneously caters to biases while providing little in the way of useful targeting — runs in the billions. In exchange, US taxpayers have received almost nothing that makes air travel safer. What they have obtained is the “opportunity” to be questioned without being detained, as TSA agents attempt to apply contradictory non-science to “casual” conversations most travelers feel compelled to engage in.

Engaging in mock-casual conversation with TSA agents is guaranteed to result in some level of suspicion, as it would be almost impossible not to.

The TSA’s list of behavioral indicators—long held secret but leaked to the press in March 2015—deepens our concerns about the program and calls into question whether it could ever be implemented neutrally and objectively. The list includes conduct as commonplace as being late for a flight, yawning, whistling, or rubbing one’s hands together. Other “indicators” are unavoidably subjective: appearing confused, “wearing improper attire,” “appearing not to understand questions,” or displaying “exaggerated emotions.”

In some cases, the TSA indicators place travelers in the difficult position of seeming deceptive to the TSA no matter what they do—whether they “give[] non-answers” to questions or they are “overly specific with answers”; whether they are “gazing down” or “constantly looking at other travelers or associates”; whether they have “no or little direct eye contact” or they have “widely open staring eyes.”

Putting agents in the position of sussing out potential terrorists with a long list of contradictory indicators does travelers and their safety no favors. When nothing can be reconciled against the TSA’s disproven “science,” agents are more likely to fall back on their own biases when vetting travelers. Hence the large number of non-white fliers “randomly” selected for additional screening.

The program hasn’t made the TSA smarter or more nimble. All it’s done is made flying even more unpleasant, especially for those that fit the “profile” the TSA provides… which is damn near everyone attempting to board a plane.

Filed Under: , , , ,
Companies: aclu

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “Confirmed: TSA's Behavioral Detection Program Is Useless, Biased, And Based On Junk Science”

Subscribe: RSS Leave a comment
22 Comments
Anonymous Coward says:

Re: Re:

Even worse, the TV-show is depicting scientists having studied the fields for a decade+ mostly. You are never going to understand how to apply it from crash courses.

A more valuable thing is to be able to discern single syllible sounds from tiny expressional changes when people think them, like sir Darren Brown. At least that is mostly specific as opposed to being able to discern emotions, which in the vast majority of situations are unrelated and very rarely specific to the question they want answered.

Anonymous Coward says:

Like a lot of law enforcement professionals, TSA agents have a lot of faith in their unprovable gut reactions. “I know a bad guy when I see one. I just know, okay?”

The Behavioral Detection Program was never anything more than an attempt to find a way to legitimize the fact that an entire agency was being run on amorphous hunches and guesswork.

Anonymous Coward says:

I am rather curious. I would think other airports would have terrorist problems way more than the US. How does Israel or Egypt handle security. Why reinvent the wheel. Look at other nations, learn from what works and apply. Seems like the TSA just sticks a bunch of high schoolers in a room with a picture of a terrorist looks like and tell them to come up with a plan to stop them.

Thad (user link) says:

Re: Re:

How does Israel or Egypt handle security. Why reinvent the wheel. Look at other nations, learn from what works and apply.

https://fivethirtyeight.com/features/trump-says-profiling-has-protected-israel-it-probably-wouldnt-work-here/

Basically, you’re proposing a solution that doesn’t scale. There are a hell of a lot more people in America than Israel. They have less air travel, their terror attacks are usually carried out by a small number of organizations while ours are primarily the work of lone wolves, and their entire population has compulsory military training.

Why don’t we do what Israel does? Because we’re not Israel.

Cowardly Lion says:

Re: Re: The Israelis don't just profile

Some of their techniques could apply, and scaling wouldn’t necessarily be an issue.

I’ve flown into and out of Tel Aviv several times from European airports. Going, I, along with all other passengers, was always interviewed in a private office at the departure airport by a very young, polite lady who did not identify herself. It took about 3 minutes. Basic questions such as where was I staying, where was I going, why was I going, would I be meeting anyone, and so on.

Leaving, I was questioned at Tel Aviv by another very young, polite lady who did not identify herself. Very similar interview, but I was also asked whether I’d met anyone, spoken to anyone, been given anything…

I took the interviewers to be junior agents of some security agency. Possibly MOSSAD. Ethnically, I’m a typical WASP, so I’d argue I wasn’t being profiled.

ed271 (profile) says:

I'd say the program works well

What the TSA would like to do is harass anyone they feel like harassing. Since they have a list of behaviors so long and vague that it applies to anyone all they have to do is pick out people with the wrong skin color and then claim they were just following the list. If they want to search the guy with the fourth amendment t-shirt they just wait for him to yawn and bingo, he counts as a terrorist. The policy is only a total failure if you think they’re actually trying to catch terrorists.

Leave a Reply to ed271 Cancel reply

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Deals
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Loading...