Predicting The Future Is Still Really Tough

from the the-silicon-crystal-ball dept

Across many disciplines, it’s common for experts to make bold forecasts about what the future may hold. Ostensibly these forecasts are based on science or sound models, but in the end, nobody can confidently predict the future. Even those forecasts that turned out to be correct don’t say too much, because the forecaster could’ve just been lucky. For some time, software companies have been pushing software to help make accurate predictions of future patterns, but it’s not clear how effective this really is. A recent study takes issue with this technology, particularly as it relates to predicting human behavior. Although models can attempt to paint a picture of how people will behave on the aggregate (as a group), they can’t say much about the actual individuals that comprise the group — human behavior is simply too variable to be reduced to an average or a smooth bell curve. What’s more, decision makers don’t know how to use or understand the data that they receive, which further compounds the problem. Predictive technology will remain an interesting area of further study, but it’s foolish to think we’re getting to the point that we can see the future.

Filed Under: , ,

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “Predicting The Future Is Still Really Tough”

Subscribe: RSS Leave a comment
21 Comments
dorpus says:

Central Limit Theorem

Human behavior may not fit smooth bell curves — but they may fit gamma distributions, Poisson processes, curved exponential distributions, or Markov chains rather well.

Would you call me crazy if I said that the time between deaths in the state of Alabama follow the Poisson process predicted by theory almost perfectly? Even the dips and spikes can be explained by the human tendency to record times in multiples of 5; the dips at 0 and 1 correspond to calling center capacity.

http://www.mixedasians.com/member_pics/haplotype_1183490705.gif

Would you also call me crazy if I said that death rate is an almost perfectly linear function of temperature? Even the spreading of points near the end of the lines is consistent with theory; with fewer readings at the temperature extremes, more variation is expected.

http://www.mixedasians.com/member_pics/haplotype_1183414347.gif

So yes, seemingly unpredictable events like death may turn out to have very predictable patterns. There is no correlation between our intuition of “predictable” events and the pattern of their occurrence.

dorpus says:

Re: Re: Central Limit Theorem

Even if death has a mathematically nice distribution, this won’t do jack shit to help you predict even one individual(‘s) death, so your claims, even if true, have no relevance

Depending on the circumstances, it is possible to predict patient outcomes with high probability. If a patient’s death is certain, or has a high probability, they will receive lower priority than those that have hope. Health care outcomes are less certain because we already exclude those whose death is certain — e.g. patients with no chance of surviving an organ transplant are not given them in the first place. Those who have some chance are given the organs. Those whose survival is certain are not considered for mortality statistics, hence the mortality statistics appear less certain than they really are.

Daniel Berch (user link) says:

Predicting Normality vs. the Extreme

Interesting… I was just writing about this on my blog ( http://danielberch.wordpress.com/2007/07/19/decision-analysis-part-2-predictionor-wild-guess

Essentially, the question is: are we trying to predict normal events or extremely unlikely events. Our ultimate goals should determine what type of approach to use.

Dr E says:

Some Human Behavior Is Highly Predictable

The comment about human behavior not being reducible to smooth bell curves is not true. Actually, most measures of human behavior fit bell curves very well when the sample of individuals is large and randomly collected. It is not the variability in human behavior that is a problem.

The claim that human behavior is unpredictable (at the level of the individual) is too broad a brush. Some aspects of human behavior can be predicted with great accuracy, at the individual level. For example, in the US, were I predict that drivers of cars will drive on the right side of the road when they pull out of their driveways, I would be right almost 100% of the time. Whether human behavior is predictable depends on the particular behavior, the nature of the measures used on which to base predictions, and the precision of the prediction. A common demonstration in psychology classes to prove how easy it is predict human behavior at the individual level is this: When taking about prediction and control of behavior, I would right down the following predictions, “Walk to front of room”, “Sit on the table in front of class”. I would then ask students whether they thought human behavior was predictable. Many would say they didn’t think so. I would then say I would like prove them wrong. I would pick a student at random and say I want to do a demonstration that proves I can control your behavior. I would ask the student to come up in front of the class so we could run the test. I would ask them to sit on the table while I prepared the test. Every student in every class did as I requested. After they sat on the table, I would show the class my written predictions. I was right 100% of the time. Behavior can be predicted when researchers have knowledge of the specific situation and know the effect of that situation on people. The situation has to be one that controls specific behaviors. College classrooms exert great control over people. Students are all sitting. They are all dressed. There are clear consequences for violation of the social rules. Under these specific conditions behavior can often be predicted. Performance on final examples is often highly predictable from performance on midterms (the correlations often are .7 and above).

With that said, however, it should be noted that most research conducted by psychologists and psychiatrists is NOT designed to make point predictions. The research not only deal with averages over many “equivalent” examples (different people), something that is common in all sciences (let’s see a physicist predict the trajectory of a particular particle), it also is rarely parametric (unlike physics). Thus, when studying say, the relationship between drugs and future crime, researchers almost never attempt to fit particular theoretically derived functions relating the amount of drug use (but how measured?: frequency of use, dosage per use, type of drug, mixture of drugs, etc.) with the “amount” of crime (but how measured?: frequency of arrests, most serious crime committed, number of times convicted, mix of crimes, etc.). The lack of parametric experimental designs and the lack of agreement about how to measure key conceptual variables is a major reason more aspects of human behavior is not more predictable. Not the fact that human behavior is variable.

Another reason human behavior is difficult to predict is the fact that the situations in which humans find themselves is highly variable and the fact that a good portion of human behavior is under the control of situations in which we find ourselves. Crimes occur in many different specific situations. If the situations do not reoccur, the behaviors controlled by those situations will not reoccur. This is why simple measures (e.g., drug use, family structure, etc.) do not do a very good job of predicting. They ignore the specific criminal settings.

SailorRipley says:

Re: Some Human Behavior Is Highly Predictable

no offense, but if I was sitting in your class, I would think, and probably tell you, that your demonstration was quite lame…you might as well have written down on the cards “I will be asking a student to come to the front of the class” and “I will ask a student to sit on the table”

suv4x4 says:

You are unique, just like everyone

“human behavior is simply too variable to be reduced to an average or a smooth bell curve.”

The grand illusion we’re unpredictable: it’s hard to accept you’re a little fish in a flock of clones. But you are.

Ever wondered how come exit poles work (most of the times reliably)? Wow, so we’re not so unique: a large majority of the population mirrors a small representative group picked out semi randomly.

Sucks doesn’t it. But maybe you can be non-conformist and wear emo white/black makeup and laugh at people being similar. That just puts you in another large group of look-alikes.

No escape from this trap.

SailorRipley says:

Re: You are unique, just like everyone

geez, what an excellent example…

here’s how exit poles work: you take a sample group that is suppposed to be sufficiently large to

1) be representative for the entire group of voters
2) prevent any disproportionate representation of a subgroup

the fact that exit poles predict the outcome rather accurately has nothing to do with people being similar or not, it just has to do with math and statistics…

if people’s behavior was predictable, one wouldn’t need to do the exit polls…

The Man says:

Predictions in 1900

If you would have asked someone in 1900 to predict what they thought a major problem in 2000 would be you would probably get the answer, “where will they get enough horses for the population increase?” and “How will they fix the pollution problem of all the horse shit in the streets?”

Would someone from the 50’s be able to predict that almost all power in Europe. Anyone in the 70’s think about video on a cell phone?

you can not predict the future. Computer models are just humans puting in code from guess they make.

That is why Global Warming is BS. Sure there is a slight warming trend, but will it cause global devistation? How are they predicting that except of wild ass guesses? To think that we right now can even imagine what type of fuel and vehicles people will use is crazy.

Overcast says:

Ha!!

Maybe the future’s hard for you people without shamanistic bones to throw onto the ground! Just a toss and the bones tell me what’s goin’ down tomorrow.

These software companies could do to invest some money in bones, crystal balls, or even various entrails and a decent soothsayer. I have those and some mystical crystals I would be more than willing to sell them.

Only $4200.00 for a nice set of bones, how could they pass it up??

hehe

Anonymous Coward says:

Sure it may be possible to predict the behavior of people on litte things like who do you vote for since your choices are very limited (the number of candidates + 1 for the choice not to vote) but for something that vastly more possibilities.

If I walk into a video game store where there are 300 different games (assuming I have the required console/pc to play them all) how do you predict which one I will buy? It may be somehow possible to narrow it down to a specific genre or two which would reduce the selection from 300 to about 20-40 games but how do you get the final prediction of which one I’ll buy?

Charles Griswold (user link) says:

Human Behaviour...

Brian: Please, please, please listen! I’ve got one or two things to say.
The Crowd: Tell us! Tell us both of them!
Brian: Look, you’ve got it all wrong! You don’t NEED to follow ME, You don’t NEED to follow ANYBODY! You’ve got to think for your selves! You’re ALL individuals!
The Crowd: Yes! We’re all individuals!
Brian: You’re all different!
The Crowd: Yes, we ARE all different!
Man in crowd: I’m not…
The Crowd: Sch!

Monty Python quotes for the win! 🙂

dorpus says:

If you post on this forum

There is a very high probability that you live in a place where there is at least one chair, two tables, paper towels, running water, and electricity. You probably don’t eat mice on a regular basis, you’ve had at least one soft drink in the past year, and riding a car is not an amazing experience for you.

On a worldwide basis, that puts you in a relatively select group of people, and I have narrowed down your behavior considerably.

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Techdirt Deals
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Loading...