Twitter Could Be A Good Predictor Of Box Office Sales

from the crystal-ball dept

Twitter is very useful for figuring out "what is happening right now." For example, Twitter has been used to figure out where an earthquake is happening. But instead of what's happening now, can it also be useful for telling what will happen in the future? Two researchers at HP Labs, Sitaram Asur and Bernardo A. Huberman, postulate that Twitter can actually be used to predict future box office results for movies. By building a computer model around the tweets for 24 movies, they claimed were able to predict the opening weekend box office results with 97.3% accuracy. An accuracy of around 97% seems unnaturally high, so I dug a little further into the actual report and found that both of these numbers were a result of combining each approach with the number of theaters associated with each release. Without taking into account the number of theaters in the release, tweets alone were able to predict at 93%. According to Asur, the correlation between theater counts alone and box office results is a paltry 39%. Considering that theater counts are probably a good indication of how well a studio thinks a film is going to perform, it seems that Hollywood should take notice of these forecasts.

The supposed gold-standard of box office predictions is Hollywood Stock Exchange, a prediction market. The researchers found that HSX had a 96.5% accuracy (when also combined with number of theaters). It's impressive that HSX gets a fair amount of accuracy despite it using "fake" currency. HSX is currently awaiting a ruling from the U.S. Commodity Futures Trading Commission that will allow it to trade using real money. When that happens, the accuracy of its prediction market should increase. At that point it may be interesting to see how much more closely the two prediction systems compare, since the apparent edge that the Twitter algorithm has right now seems too small to be significant.

In any case, with Twitter, since it's also a communications medium, tweets about a movie not only indicate interest, but also can ultimately influence a movie's sales at the box office. However, this effect seems distinctly different than the traditional notion of "observer effect," since the act of measuring the interest in a movie can actually occur without directly participating in the Twitter conversation. That said, if it becomes common practice to predict box office success by analyzing Twitter, the incentive to exploit this by spamming Twitter with tweets about an upcoming movie increases greatly. After all, the many predictions that foretold that Avatar would break box office records certainly played a self-fulfilling part in its breaking of those box office records. Furthermore, Tweets were taken for the 7 days before the weekend -- which means there would not be enough time to make any adjustment to any marketing (in the event of a dire prediction), and certainly not to production budgets, which have already been spent.

So, while, in their report, Asur and Huberman conclude:
While in this study we focused on the problem of predicting box office revenues of movies for the sake of having a clear metric of comparison with other methods, this method can be extended to a large panoply of topics, ranging from the future rating of products to agenda setting and election outcomes. At a deeper level, this work shows how social media expresses a collective wisdom which, when properly tapped, can yield an extremely powerful and accurate indicator of future outcomes.
The simple fact is that there is still quite a chasm to cross before Twitter can be used practically for any type of prediction or forecasting activity.


Reader Comments (rss)

(Flattened / Threaded)

  1.  
    identicon
    Anonymous Coward, Apr 6th, 2010 @ 9:04pm

    not now it wont

    haha

     

    reply to this | link to this | view in thread ]

  2.  
    icon
    Pontifex (profile), Apr 6th, 2010 @ 9:06pm

    The earthquake story reminds me of a recent xkcd comic:
    http://xkcd.com/723/

     

    reply to this | link to this | view in thread ]

  3.  
    identicon
    Anonymous Coward, Apr 7th, 2010 @ 12:31am

    Snakes on a Plane.

     

    reply to this | link to this | view in thread ]

  4.  
    icon
    PaulT (profile), Apr 7th, 2010 @ 2:01am

    Re:

    Damn you, Pontifex, that was what I was going to post!

    Anyway, this should not be a surprise to anybody with half a brain or an understanding of how the market has traditionally worked (which sadly leaves out many studio executives). Word of mouth has always been an important indicator of general awareness, and an important tool to promote a movie. Twitter simply moves this online, publicly visible to all.

    Of course, the marketplace can be fickle, and the online buzz around a particular movie can help drive its success (Paranormal Activity) or lead to inflated expectations that aren't met (Snakes On A Plane). High tweeting levels don't necessarily lead to financial returns, but it's a great tool if looked at correctly and not in isolation.

     

    reply to this | link to this | view in thread ]

  5.  
    identicon
    enrolled agent test, Apr 7th, 2010 @ 3:22am

    "Twitter is very useful for figuring out "what is happening right now." For example, Twitter has been used to figure out where an earthquake is happening. "

    Damn! Either the person who did this is courageous, or he's just plainly a Twitter addict. ^_^

     

    reply to this | link to this | view in thread ]

  6.  
    identicon
    Gumnos, Apr 7th, 2010 @ 4:51am

    And in other news...

    a movie called "RT" will be coming out shortly...a somewhat inane plot line, but the twitter predictors are OFF THE CHARTS!

     

    reply to this | link to this | view in thread ]

  7.  
    identicon
    Anonymous Coward, Apr 7th, 2010 @ 5:05am

    Are you allowed to tweet during the movie?

     

    reply to this | link to this | view in thread ]

  8.  
    icon
    fogbugzd (profile), Apr 7th, 2010 @ 7:00am

    Convergence

    The Exchange will probably get closer to the predictions of social networks because the people who are really serious at playing the exchanges will probably start incorporating social network-based predictions into their buy-sell decisions.

     

    reply to this | link to this | view in thread ]

  9.  
    identicon
    hegemon13, Apr 7th, 2010 @ 12:41pm

    Really?

    "After all, the many predictions that foretold that Avatar would break box office records certainly played a self-fulfilling part in its breaking of those box office records."

    Funny, all the articles I read prior to it's release focused on the high budget and said it was unlikely to make back that budget. Could just be the sites I frequent, but I saw FAR more negative predictions than positive ones before Avatar's launch. I must admit, I thought that they were probably right. I guess I should have had more faith in the Cameron blockbuster machine.

     

    reply to this | link to this | view in thread ]

  10.  
    icon
    Dennis Yang (profile), Apr 7th, 2010 @ 6:01pm

    Re: Really?

    Related to this, the researchers found that the *number of tweets* had a good correlation to the opening weekend numbers. The sentiment (positive/negative) of the tweets did not really affect the first weekend numbers -- however, sentiment did start having an affect starting week 2.

    So, the moral of this story is that a ton of chatter (good or bad) will get you a great opening weekend, but sustaining power is netted by if people actually liked it...

     

    reply to this | link to this | view in thread ]


Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here
Get Techdirt’s Daily Email
Save me a cookie
  • Note: A CRLF will be replaced by a break tag (<br>), all other allowable HTML will remain intact
  • Allowed HTML Tags: <b> <i> <a> <em> <br> <strong> <blockquote> <hr> <tt>
Follow Techdirt
A word from our sponsors...
Essential Reading
Techdirt Reading List
Techdirt Insider Chat
A word from our sponsors...
Recent Stories
A word from our sponsors...

Close

Email This