Archive for the 'qualitative forecasting' Category

Feb 04 2010

Telling words on a running controversy in risk & foresight, from Peter Bernstein

I’ve been flying across the world recently, which has given me a few quiet moments to read a real bona fide book, and the one I have been busy with is Peter Bernstein’s Against the Gods: the Remarkable Story of Risk (Wiley, 1996). It’s aclaimed all over the place, particularly in risk management circles, but I’d never quite got to it.

Anyway, this is in the intro (p5), and I found it a perfect encapsulation of a core problem in foresight thinking — quantitative vs qualitative methods — well worth retyping out to have on hand for reflection. Here goes:

against the gods Telling words on a running controversy in risk & foresight, from Peter Bernstein“The story that I have to tell is marked all the way through by a persistent tension between those who assert that the best decisions are based on quantification and numbers, determined by the patterns of the past, and those who base their decisions on more subjective degrees of belief about the uncertain future This is a controversy that has never been resolved.
The issue boils down to one’s view about the extent to which the past determines the future. We cannot quantify the future, because it is an unknown, but we have learned how to use numbers to scrutinize what happened in the past. But to what degree should we rely on the patterns of the past to tell us what the future will be like? Which matters more when facing a risk, the facts as we see them or our subjective belief in what lies hidden in the void of time? Is risk management a science or an art? Can we even tell for certain precisely where the dividing line between the two approaches lies?
It is one thing to set up a mathematical model that appears to explain everything. But when we face the struggle of daily life, of constant trial and error, the ambiguity of the facts as well as the power of the human heartbeat can obliterate the model in short order.”

Post to Twitter Tweet This Post

No responses yet

Oct 19 2009

Perhaps some lessons in prediction learned as US dollar-demise scenario emerges

One of the benefits of scenario-based future thinking is the ‘permission’ to think through alternative future outcomes without necessarily predicting them. ‘Predictors’ focus, by contrast, on isolating the highest probability future in order not to have to think through or plan for less likely outcomes.


Predictions of the dollar’s demise are as old as the greenback itself of course, but over recent weeks the specter of the dollar heading way way below its trading range — a dollar crunch — has entered the zone of the credible, or, in scenario terms, the ‘cone of plausible uncertainty.’ That means decision-makers with lots at stake are taking it seriously.

Like the British pound, the dollar has been under a cloud due to perceptions of economic fallout from the credit crunch and global recession, but particular questions about the US currency have recently surfaced, driven by reports [Robert Fisk's 'The Demise of the Dollar' story in The Independent (Oct 6)]  that “Gulf Arabs are planning – along with China, Russia, Japan and France – to end dollar dealings for oil, moving instead to a basket of currencies including the Japanese yen and Chinese yuan, the euro, gold and a new, unified currency planned for nations in the Gulf Co-operation Council” (Saudi Arabia, Abu Dhabi, Kuwait and Qatar).

The subtext is far from merely financial. Practically, it would mean that on any day, the real cost of oil to US consumers and businesses would go up or down depending on the strength of the currency. This is something America is not used to. But, more deeeply, dropping dollar-denomination of oil is a direct shot across the bows of Washington’s say over oil affairs, and the hegemony of the dollar as the dominant global reserve currency.

De-dollarizing oil would not in itself push the US currency below its 25-year range. But it is portentous of the clear trend to a genuinely multi-power world, for better or worse, in which the dollar will get no favors. That will push the dollar down, at least while the news and fallout make their way through the financial and real economic systems.

Rumors of de-dollarization have been hotly denied, as further reported here, but as the Independent points out, denials are to be expected, and are always issued in these situations. They mean nothing. Even cub reporters know that.

.
Scenario thinking

What’s particularly interesting to me is that a ‘scenario’ of dollar demise has become not only plausible in the mainstream view of the future, but scenario thinking is being used as a way to consider the nature of this outcome, and how best to respond without predicting the outcome either way. As recently as directly pre-credit crunch, the media question would have been: ‘what is the best prediction for the dollar (or the housing market, or credit default swaps?) and that, rather then scoping out the implications of the lesser-likelihood, would have dominated the discussion.

So, what struck me forcefully in the Business Week video interview above, where BW Chief Economist Mike Mandel interviews the news magazine’s Economics Editor Peter Coy (see Coy’s underlying story here), is how the less-likely, non-predicted, but very significant outcome is actively addressed:

Says Coy: “It’s so hard to know what the dollar is going to do. We don’t argue that we know… what we do is we say, ‘it could happen’ and let’s take that possibility seriously, in the same way we should have taken the possibility of falling housing prices seriously…”

This is not formal scenario-building of course. But it is, fundamentally an adoption of the framework, saying in the classic ‘scenarios’ way: “we can’t predict if it will happen or it won’t, but if it does it will have significant impact. So let’s just ask: ‘what if ‘ it does and explore the outcomes and our responses. What will the word look like? What would be the implications, the knock-ons and spinoffs? If it comes to pass, what would be wish we had done today?”

Perhaps failing to predict the credit crunch has dented predictors’ halos enough to cause a mini-zeitgeist-shift towards the only real way to cope with important uncertainty: exploring all outcomes that pass the plausibility and significance test, whether or not we actually believe they will happen.

Post to Twitter Tweet This Post

No responses yet

Feb 18 2009

The Oscars, ABC’s prediction game, and the power of aggregating likely human choices

It’s the week of the 81st Academy Awards and this means my automated Internet searches for future predictions are bunged up with blogger & media pundits predicting whether it’s going to be Brad Pitt or Sean Penn; Kate Winslet over Angelina Jolie; Slumdog Millionaire or The Reader, etc. This is just the fun-of-the-fair forecasting of course. But, turns out there are some significant things to talk about from a Future Savvy point of view.

oscars The Oscars, ABCs prediction game, and the power of aggregating likely human choices

First, there is the prediction game on offer from ABC, taglined: “The Oscars Live Challenge: Think you can Predict a Winner? Make Your Picks Now!”

It’s all part of the marketing drive of course, but, nevertheless how would one play it best and what might that tell us? Let’s assume there is something at stake, like you’re really going to sit in front of the TV and mark off your right vs. wrong predictions, and compare your score with that of your spouse for year-long bragging rights – now there’s pressure – how would you predict? Would you think (a) “this is the best movie so I predict it will win”? Hardly. You would think: (b) “this is the one that I think most people will pick, so that’s the one I think will win.”

You would be making a meta-prediction – going with what you think most are going to choose. In this particular case you would also know that that Oscar winners are chosen by balloting the 6,000 members of the Academy of Motion Picture Arts and Sciences. So your more exact question would be: who is this special group likely to choose in each category?

What’s going on? In future situations that are heavily dependent on aggregate human choices – which is very many situations – the savviest predicting strategy is to figure out the choices most people are going to make. Oscars aside, figuring out the choices most people will make on any issue – hybrid cars, tighter securities legislation, public health care, etc. – is an excellent guide to what will really happen. It’s a mass market-led view of the future to be sure, but that’s exactly what makes it dependable in mass-opinion situations. (Not all situations are determined by mass-market choices – predicting a presidential election winner is; predicting a superbowl winner is not.)

Playing the game

I had a shot at the Oscar prediction game, joining the alleged 1,680 other “players” who were then online. From what I could tell via the rather gristly Flash interface is that the game is not (yet) “social” in that you can’t see what other people are predicting – there is no access to aggregate opinion. No matter. One can instantly get this in hundreds of prediction market forums right now, for example Intrade, where the price of each outcome in each Academy Awards category directly reflects how strongly players as a whole have bid up that outcome.

At Intrade, at time of writing, Slumdog Millionaire is at $87.30 (max is $100; the other 4 movies share the remaining $12.70). When used as a prediction this means that the aggregate opinion of people staking real money has been effectively captured: it is that Slumdog Millionaire is 87% likely to be the choice of the Academy members in its category.

This is a guide to Oscar night that I would not bet against if I wanted to hold onto my bragging rights. Even in situations less overwhelmingly agreed on by players, it has been shown that prediction markets, tapping the aggregate “wisdom of crowds” (working like “Ask the audience” on Who Wants to be a Millionaire) are a fabulous tool for capturing what most people think will happen, resulting in excellent predictions. Caveat Emptor: prediction markets are poor at predicting long-term, open-ended situations, particularly where the outcome alternatives are unknown or can’t be clearly bounded, as blogged a few months back.

Post to Twitter Tweet This Post

2 responses so far

Feb 12 2009

Design and future studies: siblings after all in the quest for valuable innovations

It’s an auspicious time for those of us long convinced that design and future studies are fields with significant overlap whose coordination is helpful in addressing both social and commercial problems and/or future opportunities.

futures by design Design and future studies: siblings after all in the quest for valuable innovations

Conference: March 19-21

Tim Brown of IDEO, the the industrial design firm, recently published a Harvard Business Review piece Design Thinking – investigating designer-methods in business innovation. At Davos last month there was a “Global Agenda Council/ Design,” featuring Newsweek’s Bruce Nussbaum and built-environment design firm ARUP’s head of foresight, Chris Leubkeman. (The general agenda may be found here.) Next month, the Association of Professional Futurists are having a “Futures by Design”  conference in association with The Art Center College of Design in Pasadena, CA.

And so on. I’m going to be blogging more about this. But for now I wanted to put out a note-to-self I wrote on the issue about five years ago, trying to briefly define how the fields relate to each other, and what the crossover is. Here goes:

The tools of design and planning dovetail closely with those of industry foresight. The overlap and interaction between these two disciplines is not commonly understood, and so the methods and process insights from design professions that could augment the range of strategic foresight tools is often ignored.

1. Beyond aesthetics
Sunday supplements and glossy magazines often use “design” to mean style and fashion. While aesthetics is important, good design means much more than how products appear. It is about creating better processes, interactions and solutions for human benefit. This often involves experimenting with new technologies, envisaging possibilities under conditions of uncertainty and complexity, exploring and comparing alternatives, and determining the best and most durable solution for the long term.

2. Future focus
Whether planning a building, or redesigning a product, or innovating a process, the designer is called on to anticipate a solution that caters to future needs ­ often responding to futures issues, for example environmental-sustainability pressures and changing social values. In other words, design methods, like futures tools in general, form the bridge between current products, systems and practices and what it will be required and desired in the future.

In achieving this future focus, designers, like good “futurists,” must use techniques of imagination, creativity and intuition to generate and evaluate future outcomes. Like futures professionals, designers are called on to practice original thinking, imagine the world differently and see possibilities that others don’t. They are required to take risks, negotiate change and challenge the status quo under conditions of ambiguity and uncertainty. And like good foresight work, design succeeds only if it finds the right tradeoffs between technology possibilities, economic realities, and social needs.

3. Rendering
More than merely anticipating the future, designers and planners are practical agents of visual imagination, creating the blueprints for the objects and experiences of tomorrow. From product creation to urban renewal, designers and planners have tools and experience translating abstract future concepts and ideals into visible or tangible form ­- “making the invisible visible.” Through this rendering function they are primary agents in articulating the future, and therefore in helping us see and negotiate (or refuse) the transition.

4. Systemic innovation
Design is about systems and practices as much as products: better-designed systems improve utility, cut costs, and improve resource use. Designers play a key role in the organizational innovation process as a whole, including the development of integrated product and services, or inventing new types of value chains, alliances, and collaborations.

In sum, much of what foresight professionals are trying to do every day is already being done by design professions. Their methods and process insights should be integrated into the foresight field as a whole.

Post to Twitter Tweet This Post

4 responses so far

Jan 23 2009

Foresight and Foucault in “The Age of Heretics”

Review: The Age of Heretics, (2nd Edition), Art Kleiner, Jossey-Bass, 2008

futurist heretics Foresight and Foucault in The Age of HereticsOne of the conundrums of foresight work is that it demands a macro-perspective, but real change requires focus. In order to get the breadth of view across society and technology to think adequately about the future, the futures analyst is forced to forgo much of the detail, while implementers are thinking: “this 40,000 ft view is very illuminating, but how do I land the plane?” What changes do I make, in my organization, in my industry, on Monday morning, and how do I not get fired for making them?

Kleiner’s updated The Age of Heretics, (2nd edition, Jossey-Bass, 2008) is the modern history of people who find themselves – or put themselves – on the focus side of foresight: who work practically on the ground inside corporate institutions to achieve change, which means by definition challenging the methods and perspectives of their institution. It is not the story of foresight at the lofty level of ideas, but the altogether grittier and more interesting story of how macro-change consciousness meets real institutions, real organizational dynamics, real industry pressures, and real career considerations, in the history of US corporations since 1945.

Kleiner, the editor-in-chief of Booz Allen’s Strategy+Business, is no stranger to the foresight field. He is the ghost-writer behind an eye-popping portion of the futures canon, including The Art of the Long View; The Fifth Discipline, and its Fieldbook; and The Living Company, and so on, (source: http://www.well.com/~art/) so it’s no surprise that the fabric of his text is lush in its familiarity with the players and ideas in the field.

The common thread he follows – through figures like Herman Kahn, Willis Harman, Amory Lovins, Oliver Markley, and so on, is that of the heretic, the maverick against the machine. Intriguingly, along the way, Kleiner gives us a worm’s-eye view of the genesis of many new management ideas, from “lean production” to the “balanced scorecard” to “scenario planning’ – showing how they emerge from and have been engendered by the forces of institutions in productive conflict with their heretics.


The political history of truth, and its future

Philosopher Michel Foucault catapulted our understanding of institutions as a political field, using insights from the history of prisons, hospitals, and asylums to show the relationship between power and knowledge in the evolution of institutional forms. But he never dealt with the modern business corporation. It may be overstating it, but not by much, to say that Kleiner updates Foucault for corporate America. The themes he carries: the role of the deviant, transgression, the evolution of truth, and discursive struggles between insiders and outsiders, are highly resonant. In his previous book, Who Really Matters (Doubleday, 2003) Kleiner developed other parts of this same perspective: showing how every organization’s identity and choices can be understood as driven by the interests of its core group – its powerful insiders.

The Age of Heretics is an engrossing history of change-agents in companies in strategic and organizational transformation. But it’s not just a history. In the future – while the names of the players, and their issues, and the institutions themselves will change, the productive articulation between the heretic and the institution will remain the format of change in big groups. So the lessons of the book are well taken and very highly recommended.

[This review, authored by Adam Gordon, first appeared in The Association of Professional Futurist's Compass Magazine]

Post to Twitter Tweet This Post

No responses yet

Jan 13 2009

A future of computing scenario where digital meets the stone age

microsoft future computing A future of computing scenario where digital meets the stone age

Microsoft - Computer Electronics Show 2009

Product prototype communication is a close cousin of scenario building. Typically the company creates their product or service in action, in the future, being used by happy customers, their “preferred future” scenario. Prototype communication doesn’t typically build in alternative scenarios, the litmus test of strategy-based scenario work. It’s more a kite-flying exercise, designed to put out a future-oriented message to stakeholders and the public, garner broad feedback, and (if you’re powerful like Microsoft) put up “this-is-the-future-of-the-industry” markers.

Nevertheless, with the caveat that they are one among many plausible outcomes, product showcase scenarios can be an eye-opening guide to what’s actually possible and what the future will be like.

A newly released Microsoft “Future of Computing” video, showcased at CES 2009 in Las Vegas in the past few days, is an example. The 10-minute piece, presented by Janet Galore, Program Manger: Strategic Prototyping, takes us through a scenario of interactive education in the future (when, exactly, is not said but the implication is it’s not too far off) showing how participants would find, use, and share information across devices and across platforms.

What we see is a tablet PC that can communicate seamlessly with other electronics and interact with Web info on the fly. Okay nothing new there. What’s interesting is how it’s all held together by surface computing, a smart desk with a screen, which allows information to be viewed in the process of collaboration, sharing, and filing.  In some futurist fantasies it is thought that communication is ideally invisible (my phone e-handshakes your phone without me doing anything, etc.) But actually humans mostly seem to prefer to see what’s happening, and to have the choice to interact with what is happening while it’s happening – not least so they know what machines have done and don’t have to pull their hair out before they find their precious work buried four subdirectories into the Temp folder… sheesh. But I digress.

The scenario focuses on organizing and sharing multiple inputs, therein making a pretty clear statement about the future: what will be really valuable is not access to information anywhere, anytime (an assumed, table-stakes factor), but a way to share and collaborate with the information in an productive way. It refreshingly assumes that whiz-bang graphics – they are there too – are the easy stuff, but that collaboration and teamwork are the hard things to get right, and the truly valuable service given the chaos of billions of voices and trillions of data objects that pertain in any human-work future.

The other real strength of the prototype and related scenario is its close attention to natural (or, at least, strongly socialized, conventional, classic) human ways of doing things, which are slow to change, and therefore will change slowly. The smart desk is something one can really see oneself sitting around, because this is what we already do. Also this future of computing envisages no stylus, no mouse, no magic wand to master. Rather, we move digital stuff around the desk with our hands. We point to it and we shift it. That is, digital capability accommodates and interlaces with Stone Age human and organizational patterns. That’s why this view of the future is persuasive.

Post to Twitter Tweet This Post

One response so far

Nov 04 2008

“Future Savvy” prescribed for Masters Program in Strategic Foresight

My aim for this blog is not particularly to champion success stories for Future Savvy. I’m happy to let the book talk for itself. I’d prefer to look at forecasts and foresight work out there and think about how well it is working, and/or who it may be working for. However it’s nice to be able to report, inter alia, that the book has been quickly picked up and prescribed as a required resource in the Masters Program in Strategic Foresight, at the School of Global Leadership & Entrepreneurship, Regent University (VA).

regent 2 300x78 Future Savvy prescribed for Masters Program in Strategic Foresight
Future Savvy is intended to be a book for business and policy professionals, not academics. But it does speak to students and scholars who need to assess and evaluate foresight work. In any event, professors Jay Gary and Dennis Walters have included it alongside works by Wendel Bell, Jerome Glenn, and Ted Gordon (no relation) — household names in the foresight field — so the comparison is of course very happily accepted.

The following is from the course outline. I’ve included the full bibliography, which is in itself a valuable collection of sources in the futures field, and merits attention all the way down the list.

Course Description:
Surveys traditional forecasting theory and methods. After a consideration of forecasting in general, students learn how to conduct research using both qualitative (secondary sources, interviews and questionnaires) and quantitative (data analysis, numerical forecasting and trend decomposition). They also apply critical thinking skills to existing forecasts. [Learning objectives:] 1. Managing: understand the principles and applications of operational forecasting within organizations. 2. Assessing: decide when to use statistical or judgmental methods in strategic forecasting, and how to combine foresight methods to generate 10 to 20 year outlooks. 3. Evaluating: gather information in a specific domain that can be used to forecast baseline as well as alternative futures. 4. Researching: construct a long-term strategic forecast for a client organization that draws upon both quantitative and qualitative sources.

Required Resources
* Bell, Wendell. 1996. Foundations of futures studies: History, purposes, and knowledge. (Human Science for a New Era), vol. 1. New Brunswick, NJ: Transaction. ISBN: 0765805391
* Carlberg, C. G. (2005). Excel sales forecasting for dummies. Hoboken, NJ: Wiley. ISBN: 0764575937
* Glenn, J. C., and Gordon, T. J. Futures Research Methodology V2.0 CD-ROM American Council for the UNU. ISBN: 097220511X
[This item is available through http://www.acunu.org/millennium/FRM-v2.html]
* Gordon, A. (2009). Future Savvy: Identifying trends to make better decisions, manage uncertainty, and profit from change. New York: American Management Association. ISBN: 0-8144-0912-1
* Jain, C. L. ed. (2001). Practical guide to business forecasting. Flushing, NY: Graceway. ISBN: 092126758

Recommended and supplemental resources:
*  Coates , Joseph F 2025, John B. Mahaffie, and Andy Hines. 2025: Scenarios of US and Global Society Reshaped by Science and Technology. Oak Hill Press. ISBN: 1886939098, also available in .pdf files via http://www.josephcoates.com/2025_PDF.html
* Armstrong, J. S. (1985). Long-range forecasting: From crystal ball to computer (2nd ed.). New York: Wiley. ISBN: 0471823600, also available in .pdf files via http://www.forecastingprinciples.com/Long-Range%20Forecasting/contents.html
* Armstrong, J. Scott. 2001. Principles of Forecasting . Kluwer. ISBN: 0792374010.
* Caplow, T., Hicks, L., & Wattenberg, B. J. (2001). The first measured century: An illustrated guide to trends in America , 1900-2000 . Washington , DC : AEI Press. Download chapters at: http://www.pbs.org/fmc/book.htm
* Dawes, R. M. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34, 571-582.
* Duberley, J., & Johnson, P. (2000). Understanding management research: An introduction to epistemology. Thousand Oaks, CA: Sage.
* Einhorn, H.J. (1986). Accepting error to make less error. Journal of Personality Assessment, 50, 387-395.
* Fischoff, B. (1994). What forecasts (seem to) mean. International Journal of Forecasting, 10, 387-403.
* Gawiser, Sheldon R., and G. Evans Witt. 1994. A Journalist’s Guide to Public Opinion Polls . Praeger. ISBN: 0275949893.
* Gillham, Bill. 2000. The Research Interview. Continuum International. ISBN: 082644797X.
* Hetman, F. (1969). Le Langage de la prévision, the language of forecasting: With a French-English-German vocabulary. Paris: S.ÉD.ÉI.S. http://www.cnam.fr/lipsor/eng/data/langageprevision.pdf
* Jantsch, E. (1967). Technological forecasting in perspective. Paris: OECD. http://www.cnam.fr/lipsor/recherche/laboratoire/data/prevtech_en_final.pdf
* Makridakis, S. G., Wheelwright, S. C., & Hyndman, R. J. (1998). Forecasting: Methods and applications (3rd ed.). New York: John Wiley & Sons.
* Molitor, G. T. (2003). The power to change the world: The art of forecasting. Potomac, MD: Public Policy Forecasting.
* Moore, D. A., Kurtzberg, T., Fox, C. R., & Bazerman, M. H. (1999). Positive illusions and forecasting errors in mutual fund investment decisions. Organizational Behavior & Human Decision Processes, 79, 95-114.
* Orrell, D. (2007). The future of everything: The science of prediction. New York, NY: Thunder’s Mouth.
* Rescher, N. 1998. Predicting the future: An introduction to the theory of forecasting. Albany: SUNY Press. ISBN: 0-7914-3553-9
* Salant, Priscilla, and Don A. Dillman. 1994. How to Conduct Your Own Survey . Wiley. ISBN: 0471012734.
* Seidensticker, R. B. (2005). Future hype: The myths of technology change. San Francisco, CA: Berrett-Koehler.
* Schnaars, S. P. (1989). Megamistakes: Forecasting and the myth of rapid technological change. New York: Free Press
* Sherden, William A. (1998). The fortune sellers: The big business of buying and selling predictions. New York: John Wiley.
* Wood, G. (1992). Predicting outcomes: Sports and Stocks. Journal of Gambling Studies, 8, 201-222.

Post to Twitter Tweet This Post

No responses yet

Twitter links powered by Tweet This v1.6.1, a WordPress plugin for Twitter.