<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
xmlns:wfw="http://wellformedweb.org/CommentAPI/">
<channel>
<title>Techdirt. Stories filed under &quot;forecasting&quot;</title>
<description>Easily digestible tech news...</description>
<link>http://www.techdirt.com/</link>
<language>en-us</language>
<image><title>Techdirt. Stories filed under &quot;forecasting&quot;</title><url>http://www.techdirt.com/images/td-88x31.gif</url><link>http://www.techdirt.com/</link></image>
<item>
<pubDate>Mon, 27 Feb 2012 17:00:00 PST</pubDate>
<title>DailyDirt: Build It And They Will Come...</title>
<dc:creator>Michael Ho</dc:creator>
<link>http://www.techdirt.com/articles/20100209/1104298096/dailydirt-build-it-they-will-come.shtml</link>
<guid>http://www.techdirt.com/articles/20100209/1104298096/dailydirt-build-it-they-will-come.shtml</guid>
<description><![CDATA[ Moneyball (the movie) has recently popularized the concept of sabermetrics, but for a while now, real sports fans (and mathletes) have been applying rigorous analysis to just about every sport. There still aren't any sure bets, but forecasting player performance has gotten a lot better in the last decade or so. Here are just a few examples of math geeks taking some shots at jocks.

<ul>

<li> <a title="http://online.wsj.com/article/SB10001424052970204880404577225562995441868.html?mod=e2fb" href="http://on.wsj.com/wIc6FF">Enjoy your fifteen minutes of fame, Ed Weiland -- for being a bit less surprised than most about Linsanity.</a> Weiland wrote in 2010: "<i>... Jeremy Lin is a good enough player to start in the NBA and possibly star.</i>" [<a href="http://online.wsj.com/article/SB10001424052970204880404577225562995441868.html?mod=e2fb">url</a>]</li>

<li> <a title="http://www.baseballprospectus.com/article.php?articleid=2659" href="http://bit.ly/wJ9pw5">Nate Silver called himself a forecaster, explained how he looked at baseball stats, and created the PECOTA system for evaluating MLB players.</a> Baseball Prospectus bought the PECOTA system in 2003 and publishes its forecasts for all kinds of baseball fans and fantasy baseball leagues. [<a href="http://www.baseballprospectus.com/article.php?articleid=2659">url</a>]</li>

<li> <a title="http://espn.go.com/sportsnation/poll/_/id/4691/mit-sloan-conference-paper-previews" href="http://es.pn/wsnGhb">The annual MIT Sloan Sports Analytics Conference has picked its top ten finalists for its Research Paper of the Year.</a> These papers discuss various stats like "15% of basketball rebounds hit the floor before being collected." [<a href="http://espn.go.com/sportsnation/poll/_/id/4691/mit-sloan-conference-paper-previews">url</a>]</li>

<li><b>To find some other online challenges and games, <a title="http://www.stumbleupon.com/to/stumble/topic:117" href="http://bit.ly/ifsJE4">check out what StumbleUpon has found to play.</a></b> [<a href="http://www.stumbleupon.com/to/stumble/topic:117">url</a>]  <a title="what's this?" href="#" class="whatsthis help_ddstumble">&nbsp;</a>
</li>
</ul> 

By the way, StumbleUpon can also recommend some good <a title="http://www.stumbleupon.com/to/stumble/stumblethru:www.techdirt.com" href="http://bit.ly/fagV8c">Techdirt</a> articles, too.<br /><br /><a href="http://www.techdirt.com/articles/20100209/1104298096/dailydirt-build-it-they-will-come.shtml">Permalink</a> | <a href="http://www.techdirt.com/articles/20100209/1104298096/dailydirt-build-it-they-will-come.shtml#comments">Comments</a> | <a href="http://www.techdirt.com/articles/20100209/1104298096/dailydirt-build-it-they-will-come.shtml?op=sharethis">Email This Story</a><br />
 ]]></description>
<slash:department>urls-we-dig-up</slash:department>
<wfw:commentRss>http://www.techdirt.com/comment_rss.php?sid=20100209/1104298096</wfw:commentRss>
</item>
<item>
<pubDate>Tue, 6 Apr 2010 20:43:13 PDT</pubDate>
<title>Twitter Could Be A Good Predictor Of Box Office Sales</title>
<dc:creator>Dennis Yang</dc:creator>
<link>http://www.techdirt.com/articles/20100402/1618388853.shtml</link>
<guid>http://www.techdirt.com/articles/20100402/1618388853.shtml</guid>
<description><![CDATA[ Twitter is very useful for figuring out "what is happening right now." For example, Twitter has been used to figure out where an <a href="http://venturebeat.com/2008/07/29/socal-earthquake-a-powerful-reminder-of-twitters-potential/">earthquake</a> is happening.  But instead of what's happening now, can it also be useful for telling what will happen in the future?  Two researchers at HP Labs,  Sitaram Asur and Bernardo A. Huberman, postulate that <a href="http://www.fastcompany.com/1604125/twitter-predicts-box-office-sales-better-than-anything-else">Twitter can actually be used to predict future box office results for movies</a>.  By building a computer model around the tweets for 24 movies, they claimed were able to predict the opening weekend box office results with 97.3% accuracy.  An accuracy of around 97% seems unnaturally high, so I dug a little further into the actual <a href="http://www.hpl.hp.com/research/scl/papers/socialmedia/socialmedia.pdf">report</a> and found that both of these numbers were a result of combining each approach with the number of theaters associated with each release.  Without taking into account the number of theaters in the release, tweets alone were able to predict at 93%.  According to Asur, the correlation between theater counts alone and box office results is a paltry 39%.  Considering that theater counts are probably a good indication of how well a studio thinks a film is going to perform, it seems that Hollywood should take notice of these forecasts.
<br /><br />
The supposed gold-standard of box office predictions is Hollywood Stock Exchange, a prediction market.  The researchers found that HSX had a 96.5% accuracy (when also combined with number of theaters).  It's impressive that HSX gets a fair amount of accuracy despite it using "fake" currency.  HSX is currently <a href="http://www.google.com/hostednews/ap/article/ALeqM5i45T6trE0cVgYfUPc5adV8eK624wD9EQCHV80">awaiting</a> a ruling from the U.S. Commodity Futures Trading Commission that will allow it to trade using real money.  When that happens, the accuracy of its prediction market should increase.  At that point it may be interesting to see how much more closely the two prediction systems compare, since the apparent edge that the Twitter algorithm has right now seems too small to be significant.
<br /><br />
In any case, with Twitter, since it's also a communications medium, tweets about a movie not only indicate interest, but also can ultimately <i>influence</i> a movie's sales at the box office.  However, this effect seems distinctly different than the traditional notion of "observer effect," since the act of measuring the interest in a movie can actually occur without directly participating in the Twitter conversation.  That said, if it becomes common practice to predict box office success by analyzing Twitter, the incentive to exploit this by spamming Twitter with tweets about an upcoming movie increases greatly.  After all, the many predictions that foretold that <em>Avatar</em> would break box office records certainly played a self-fulfilling part in its breaking of those box office records.  Furthermore, Tweets were taken for the 7 days before the weekend -- which means there would not be enough time to make any adjustment to any marketing (in the event of a dire prediction), and certainly not to production budgets, which have already been spent.
<br /><br />
So, while, in their report, Asur and Huberman conclude:
<blockquote>
While in this study we focused on the problem of predicting box office revenues of movies for the sake of having a clear metric of comparison with other methods, this method can be extended to a large panoply of topics, ranging from the future rating of products to agenda setting and election outcomes. At a deeper level, this work shows how social media expresses a collective wisdom which, when properly tapped, can yield an extremely powerful and accurate indicator of future outcomes.
</blockquote>
The simple fact is that there is still quite a chasm to cross before Twitter can be used practically for any type of prediction or forecasting activity.<br /><br /><a href="http://www.techdirt.com/articles/20100402/1618388853.shtml">Permalink</a> | <a href="http://www.techdirt.com/articles/20100402/1618388853.shtml#comments">Comments</a> | <a href="http://www.techdirt.com/articles/20100402/1618388853.shtml?op=sharethis">Email This Story</a><br />
 ]]></description>
<slash:department>crystal-ball</slash:department>
<wfw:commentRss>http://www.techdirt.com/comment_rss.php?sid=20100402/1618388853</wfw:commentRss>
</item>
<item>
<pubDate>Thu, 19 Jul 2007 08:16:43 PDT</pubDate>
<title>Predicting The Future Is Still Really Tough</title>
<dc:creator>Joseph Weisenthal</dc:creator>
<link>http://www.techdirt.com/articles/20070719/054736.shtml</link>
<guid>http://www.techdirt.com/articles/20070719/054736.shtml</guid>
<description><![CDATA[ Across many disciplines, it's common for experts to make <a href="http://www.techdirt.com/articles/20070716/073502.shtml">bold forecasts about what the future may hold</a>.  Ostensibly these forecasts are based on science or sound models, but in the end, nobody can confidently predict the future.  Even those forecasts that turned out to be correct don't say too much, because the forecaster could've just been lucky.  For some time, software companies have been pushing software to help make accurate predictions of future patterns, but it's not clear how effective this really is.  A recent study takes issue with this technology, <a href="http://technology.guardian.co.uk/weekly/story/0,,2129120,00.html">particularly as it relates to predicting human behavior</a>.  Although models can attempt to paint a picture of how people will behave on the aggregate (as a group), they can't say much about the actual individuals that comprise the group -- human behavior is simply too variable to be reduced to an average or a smooth bell curve.  What's more, decision makers don't know how to use or understand the data that they receive, which further compounds the problem.  Predictive technology will remain an interesting area of further study, but it's foolish to think we're getting to the point that we can see the future.<br /><br /><a href="http://www.techdirt.com/articles/20070719/054736.shtml">Permalink</a> | <a href="http://www.techdirt.com/articles/20070719/054736.shtml#comments">Comments</a> | <a href="http://www.techdirt.com/articles/20070719/054736.shtml?op=sharethis">Email This Story</a><br />
 ]]></description>
<slash:department>the-silicon-crystal-ball</slash:department>
<wfw:commentRss>http://www.techdirt.com/comment_rss.php?sid=20070719/054736</wfw:commentRss>
</item>
</channel>
</rss>