The Oscars, ABC’s prediction game, and the power of aggregating likely human choices

Posted by Adam Gordon on Feb 18, 2009 in all, foresight tools & methods, horizon scanning, managing uncertainty, prediction markets | 2 comments

It’s the week of the 81st Academy Awards and this means my automated Internet searches for future predictions are bunged up with blogger & media pundits predicting whether it’s going to be Brad Pitt or Sean Penn; Kate Winslet over Angelina Jolie; Slumdog Millionaire or The Reader, etc. This is just the fun-of-the-fair forecasting of course. But, turns out there are some significant things to talk about from a Future Savvy point of view.

First, there is the prediction game on offer from ABC, taglined: “The Oscars Live Challenge: Think you can Predict a Winner? Make Your Picks Now!”

It’s all part of the marketing drive of course, but, nevertheless how would one play it best and what might that tell us? Let’s assume there is something at stake, like you’re really going to sit in front of the TV and mark off your right vs. wrong predictions, and compare your score with that of your spouse for year-long bragging rights – now there’s pressure – how would you predict? Would you think (a) “this is the best movie so I predict it will win”? Hardly. You would think: (b) “this is the one that I think most people will pick, so that’s the one I think will win.”

You would be making a meta-prediction – going with what you think most are going to choose. In this particular case you would also know that that Oscar winners are chosen by balloting the 6,000 members of the Academy of Motion Picture Arts and Sciences. So your more exact question would be: who is this special group likely to choose in each category?

What’s going on? In future situations that are heavily dependent on aggregate human choices – which is very many situations – the savviest predicting strategy is to figure out the choices most people are going to make. Oscars aside, figuring out the choices most people will make on any issue – hybrid cars, tighter securities legislation, public health care, etc. – is an excellent guide to what will really happen. It’s a mass market-led view of the future to be sure, but that’s exactly what makes it dependable in mass-opinion situations. (Not all situations are determined by mass-market choices – predicting a presidential election winner is; predicting a superbowl winner is not.)

Playing the game

I had a shot at the Oscar prediction game, joining the alleged 1,680 other “players” who were then online. From what I could tell via the rather gristly Flash interface is that the game is not (yet) “social” in that you can’t see what other people are predicting – there is no access to aggregate opinion. No matter. One can instantly get this in hundreds of prediction market forums right now, for example Intrade, where the price of each outcome in each Academy Awards category directly reflects how strongly players as a whole have bid up that outcome.

At Intrade, at time of writing, Slumdog Millionaire is at $87.30 (max is $100; the other 4 movies share the remaining $12.70). When used as a prediction this means that the aggregate opinion of people staking real money has been effectively captured: it is that Slumdog Millionaire is 87% likely to be the choice of the Academy members in its category.

This is a guide to Oscar night that I would not bet against if I wanted to hold onto my bragging rights. Even in situations less overwhelmingly agreed on by players, it has been shown that prediction markets, tapping the aggregate “wisdom of crowds” (working like “Ask the audience” on Who Wants to be a Millionaire) are a fabulous tool for capturing what most people think will happen, resulting in excellent predictions. Caveat Emptor: prediction markets are poor at predicting long-term, open-ended situations, particularly where the outcome alternatives are unknown or can’t be clearly bounded, as blogged a few months back.