The Long Tail Is Only As Good As The Recommendation System

from the that's-how-it's-supposed-to-work dept

It’s been amusing to watch folks like Andrew Orlowski continue to misinterpret Chris Anderson’s slight admission that things in “the long tail” aren’t exactly they way he’d predicted them to be. Of course, Orlowski entirely misses the point by assuming incorrectly (as many others have done) that the discussion of the long tail meant the death of “the blockbuster.” That’s not at all true. The idea of the long tail was that it both enabled more content to be produced by opening up more shelf space and then made it easier to find that content.

But, the fact remains that the finding of that content is entirely dependent on the filtering and recommendation systems, which is highlighted in the recent NY Times piece by Clive Thompson about attempts to improve Netflix’s recommendation engine (and, yes, this is the second post I’ve written on that article, but this is discussing an entirely different issue than the first, so it seemed worthwhile). In the article, Thompson notes:

Cinematch has, in fact, become a video-store roboclerk: its suggestions now drive a surprising 60 percent of Netflix?s rentals. It also often steers a customer?s attention away from big-grossing hits toward smaller, independent movies. Traditional video stores depend on hits; just-out-of-the-theaters blockbusters account for 80 percent of what they rent. At Netflix, by contrast, 70 percent of what it sends out is from the backlist ? older movies or small, independent ones. A good recommendation system, in other words, does not merely help people find new stuff. As Netflix has discovered, it also spurs them to consume more stuff.

Basically, that entire paragraph explains the issue. A good recommendation system does two things: it gets people to consumer more — and it introduces them to stuff they might not have heard about otherwise. But, that second part is not necessarily the same as the first part. Many people assumed, incorrectly, that the greatness of such “long tail filters” was that it would drive people to consumer more down the tail — but as Netflix is seeing, the good recommendation engine drives people to consume more content in both the head and the tail.

And, when you think about it, that makes an awful lot of sense. Popular stuff often is popular for a reason. While some may disagree, things are often popular because they really do appeal to a lot of people, so it should be no surprise that a good recommendation system would increase consumption in the head: it’s accurately noting that an awful lot of people will like that content. But that doesn’t exclude promoting some of the content from the tail. Since the recommendation system is driving more consumption overall, it’s “lifting all boats” as they say, even if (as is likely) it lifts the boats in the head more than in the tail. In the past, that content in the tail wouldn’t get any business at all, but these days it can at least make some money, if not a huge amount.

So, no the concept of the long tail is hardly dead or even in trouble (or, as Orlowski notes, downgraded). Instead, it’s just being understood better.

Filed Under: , ,

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “The Long Tail Is Only As Good As The Recommendation System”

Subscribe: RSS Leave a comment
dieselm says:

Remember also that Netflix has an economic bias in favor of steering customers to backlist titles which should be reflected in the design of the algorithm.

The demand a DVDs in the first six weeks of release is huge and then falls off a cliff. Anything that steers people away from new releases in favor of old titles with similar satisfaction reduces costs dramatically.

hautedawg says:

Blockbuster's demise

Blockbuster is dying a painful and slow death beecause they simply do not care about the consumer. They don’t give a rat’s patootie if what you are looking for is in stock or not, they simply carry the newest big name releases, and hold on to them for several months after the release. Then they sell them for a couple of bucks, restocking with the next big movie. If you are looking for a classic, there is a slight chance they will have it, but not a strong one.

When there was actual competition for your rental money, the stores had to carry a wider variety of movies, including movies that were 10 years old. Now that the small stores have been run out of town, Blockbuster does not carry movies that are more than a year or two old, or if they do, they only have one or two copies.

In no way does this serve the consumer, unless you are only wanting to rent new movies, or recent releases. If you want a “classic” or an older movie, you need to rent it online from Blockbuster or NetFlix.

In my way of thinking, the only person that is being served by this is Lackluster and certainly NOT the consumer. We are not being exposed to movies that are small release or movies that have been around for 3 or 4 years.

Happy Holidaze!

Michael Long (user link) says:

More than recommendations...

Actually, there’s three legs to the making the tail work: browsing, search, and recommendations.

You discussed recommendations. Search is self explanatory. But browsing is often overlooked, when in fact it’s a core component of the long tail, dividing a single long tail into multiple long tails.

Take NetFlix’s “Thrillers” category, which in itself is a smaller long tail with the same most popular/least popular slope as the orginal tail. “Pyschological Thrillers”, in turn, is again a smaller yet identical tail. Yet its smaller size makes it much more manageable, relevant, and easier to browse and digest.

Coming up with the right browse lists (genres, by year, by actor, by director, by awards, and so on) is another powerful way to maximize visibility into the tail.

bowerbird (profile) says:

people have finite time and attention,
so it’s not possible to “raise all boats”
forever and across all of the mediums.

if i’m watching more films, then i must
be reading fewer books, or attending
fewer plays, or playing fewer games…

what _is_ being well-served, though, is
my level of _satisfaction_experienced_.

instead of wasting my time watching a
crummy movie, i’m watching one i like,
regardless if it’s in the head or the tail.

and that’s a good thing.

the movie business used to be able to
churn out crap, and we’d still watch it,
because it was the only thing out there.
now, they have to compete against all
of the classics of the past, and the niche
product that’s now right at our fingertips.

all of this is a good thing…


Add Your Comment

Your email address will not be published.

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Deals
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...