Future Savvy: Quality in Foresight

I’ve been flying across the world recently, which has given me a few quiet moments to read a real bona fide book, and the one I have been busy with is Peter Bernstein’s Against the Gods: the Remarkable Story of Risk (Wiley, 1996). It’s aclaimed all over the place, particularly in risk management circles, but I’d never quite got to it.

Anyway, this is in the intro (p5), and I found it a perfect encapsulation of a core problem in foresight thinking — quantitative vs qualitative methods — well worth retyping out to have on hand for reflection. Here goes:

“The story that I have to tell is marked all the way through by a persistent tension between those who assert that the best decisions are based on quantification and numbers, determined by the patterns of the past, and those who base their decisions on more subjective degrees of belief about the uncertain future This is a controversy that has never been resolved.
The issue boils down to one’s view about the extent to which the past determines the future. We cannot quantify the future, because it is an unknown, but we have learned how to use numbers to scrutinize what happened in the past. But to what degree should we rely on the patterns of the past to tell us what the future will be like? Which matters more when facing a risk, the facts as we see them or our subjective belief in what lies hidden in the void of time? Is risk management a science or an art? Can we even tell for certain precisely where the dividing line between the two approaches lies?
It is one thing to set up a mathematical model that appears to explain everything. But when we face the struggle of daily life, of constant trial and error, the ambiguity of the facts as well as the power of the human heartbeat can obliterate the model in short order.”

Tweet This Post

In a recent Times article ‘The future was never going to be the C5‘ actor-comedian Ben Millar offers a familiar criticism of foresight work. Inter alia he says: “For all our achievements in art, science, and technology, the human race has always been spectacularly bad at predicting the future. Literature is littered with shockingly wide-of-the-mark utopias, dystopias, shiny suits, flying saucers and whole meals contained in a single pill. As a child of the Seventies, I was taught that as an adult in a world run by machines my main challenge would be how to spend my endless hours of leisure time…”

Yes, Ben. I’m sure you know this has all been said before ad nauseam. But more importantly, 40 years on many lessons have been learned, and it wouldn’t run foul of quality journalism standards to reflect this.

First, let’s be clear: nobody can predict the future. Anyone who says they can is a charlatan. Also, yes, unconscionably dreadful and irresponsible predictions have been made and are continually being made. But there are three problems with the ‘no-flying-car-so-there-we-can’t-predict-the-future’ argument:

(1) The kinds of predictions Millar cites are a product of a particular moment in Western thought and therefore foresight. The 1960s and early 70s were a time of Post-War American emergence, unleashing for a while a techno-futurist predictive rapture, most of which has indeed proved to be rubbish. There are still people, very famous talking-head futurists, promoting techno-rapture for the 21st century (caveat emptor) but as a whole the foresight field has moved on to become much more circumspect about what can be predicted.

Balancing techno-fantasy

Foresight practitioners are these days more likely to balance technology wowee with economic, social, and environmental friction; see systemic (often indirect or counter-intuitive) effects where once only simple cause-and-effect was seen; and create scenarios of key alternative outcomes rather than predict one.

(2) The second thing that is missed in gleefully deriding foresight work, is how many people and institutions get it right, or right enough.  It’s axiomatic that in order to be successful a person or organization must have correctly assessed both key changes and rate of change in their operating environment. To take a famous case, as quoted in Future Savvy, while Nixon’s Vice President Spiro Agnew in 1972 erroneously forecast super-sonic passenger air travel, Herb Kelleher, founder of SouthWest Airlines, foresaw the low-cost air travel industry. Bingo. Billionaire. Similarly, behind every success one can find future thinking that, while sometimes latent, was present and correct.

(3) The purpose of foresight work is misunderstood. We cannot predict the future and it’s pointless to try. We can only assess signals of change, trends, and potential for surprises and reversals, including challenging our all-too-easily calcified mental models, and take this into a process of understanding alternative outcomes and pre-considering best strategic actions. In other words, actively stimulating the investigation and analysis of future conditions in order to create the basis of better decision-making today.

In fact sometimes the ’strategic conversation’ that results from poor predictions is instructive to managers. As I say to clients: the goal of foresight work is better decisions not better predictions.

Back-street abortionists

The reality is that there is good and bad foresight work. Yes, some futurists are the technical and moral equivalent of back street abortionists. But the good work remains, and quality foresight is a critical advantage to decision-makers. The key thing is to be able to tell good foresight work from bad.

Simplistic trashing of foresight work en bloc ignores the weight of case evidence that people and organizations can improve their management of future uncertainty and/or create a situation where they manage the future better than competitors. Further, it encourages managers to fly blind into changing environments, often resulting in spectacularly poor decisions that deeply and widely punish their dependent stakeholders.

Tweet This Post

Continuing the theme of financial types talking to each other about predictions and predictability, this ‘Tea with the Economist’ interview of Stephen Roach, Chairman, Morgan Stanley Asia by Economist New York Bureau Chief Mathew Birk, carries interesting lessons about the limits of prediction.

Birk commends Roach for being one of the few to have predicted the Credit Crunch problems, to which Roach demurs in saying he was “too early”. He then furthers his modesty in saying that the “breakage” in the financial system was “in excess of anything I envisioned.”

Self-deprecation in assessing one’s predictive abilities will endear anyone to me. Even Roach, who later in the interview burns this hard-won credibility by laying the blame for the credit crunch at the door of regulators, forgetting how hard financial institutions lobbied regulators for greater freedoms in the 1990s.

But I digress. The predictive issues the interview raises are as follows. Issue one: it’s not enough (as any stock short-seller will confirm) to get the direction of a future change right. One must get the timing right too. Issue two: it’s not enough to anticipate a change. One must be able to judge it’s impact. Getting either timing or impact wrong is effectively to have missed the future.

.

Probability

On the latter topic — the problem of impact — Nassim Taleb is unrelenting, and he is right. Analysts routinely mix up probability and impact. They think that because an event has a low probability (‘it would be a 10-sigma event!’) it can be marginalized in the predictive number crunching. Of course, it can’t. The low-probability of a wildcard or black swan event is irrelevant because when it happens it will change the game, and that’s why, in every predictive situation of reasonable complexity and uncertainty, using statistical extrapolations (regressions and so on) to predict, is to dangerously paper over the cracks. It is precisely the cracks that businesses and policy makers need to worry about.

Determining the direction of change is hard enough. Assessing timing or extent of impact — a ‘total future impact index’ — is wickedly difficult. It’s a task not to be underestimated, and to simply extrapolate current trends (= assuming the trend’s timeline and impact stay the same as in the past) is the royal road to underestimating it.

This is the reason foresight for complex, uncertain, changing situations can only be grasped by NOT predicting (quantitatively or otherwise) but by exploring the limit-conditions of the plausible (What would happen if the timing of the change accelerated, or was significantly delayed? What if  the impact was 10x or one tenth of what we expect? And so on.)

.

Tweet This Post

One of the benefits of scenario-based future thinking is the ‘permission’ to think through alternative future outcomes without necessarily predicting them. ‘Predictors’ focus, by contrast, on isolating the highest probability future in order not to have to think through or plan for less likely outcomes.

Predictions of the dollar’s demise are as old as the greenback itself of course, but over recent weeks the specter of the dollar heading way way below its trading range — a dollar crunch — has entered the zone of the credible, or, in scenario terms, the ‘cone of plausible uncertainty.’ That means decision-makers with lots at stake are taking it seriously.

Like the British pound, the dollar has been under a cloud due to perceptions of economic fallout from the credit crunch and global recession, but particular questions about the US currency have recently surfaced, driven by reports [Robert Fisk's 'The Demise of the Dollar' story in The Independent (Oct 6)]  that “Gulf Arabs are planning – along with China, Russia, Japan and France – to end dollar dealings for oil, moving instead to a basket of currencies including the Japanese yen and Chinese yuan, the euro, gold and a new, unified currency planned for nations in the Gulf Co-operation Council” (Saudi Arabia, Abu Dhabi, Kuwait and Qatar).

The subtext is far from merely financial. Practically, it would mean that on any day, the real cost of oil to US consumers and businesses would go up or down depending on the strength of the currency. This is something America is not used to. But, more deeeply, dropping dollar-denomination of oil is a direct shot across the bows of Washington’s say over oil affairs, and the hegemony of the dollar as the dominant global reserve currency.

De-dollarizing oil would not in itself push the US currency below its 25-year range. But it is portentous of the clear trend to a genuinely multi-power world, for better or worse, in which the dollar will get no favors. That will push the dollar down, at least while the news and fallout make their way through the financial and real economic systems.

Rumors of de-dollarization have been hotly denied, as further reported here, but as the Independent points out, denials are to be expected, and are always issued in these situations. They mean nothing. Even cub reporters know that.

.
Scenario thinking

What’s particularly interesting to me is that a ’scenario’ of dollar demise has become not only plausible in the mainstream view of the future, but scenario thinking is being used as a way to consider the nature of this outcome, and how best to respond without predicting the outcome either way. As recently as directly pre-credit crunch, the media question would have been: ‘what is the best prediction for the dollar (or the housing market, or credit default swaps?) and that, rather then scoping out the implications of the lesser-likelihood, would have dominated the discussion.

So, what struck me forcefully in the Business Week video interview above, where BW Chief Economist Mike Mandel interviews the news magazine’s Economics Editor Peter Coy (see Coy’s underlying story here), is how the less-likely, non-predicted, but very significant outcome is actively addressed:

Says Coy: “It’s so hard to know what the dollar is going to do. We don’t argue that we know… what we do is we say, ‘it could happen’ and let’s take that possibility seriously, in the same way we should have taken the possibility of falling housing prices seriously…”

This is not formal scenario-building of course. But it is, fundamentally an adoption of the framework, saying in the classic ’scenarios’ way: “we can’t predict if it will happen or it won’t, but if it does it will have significant impact. So let’s just ask: ‘what if ‘ it does and explore the outcomes and our responses. What will the word look like? What would be the implications, the knock-ons and spinoffs? If it comes to pass, what would be wish we had done today?”

Perhaps failing to predict the credit crunch has dented predictors’ halos enough to cause a mini-zeitgeist-shift towards the only real way to cope with important uncertainty: exploring all outcomes that pass the plausibility and significance test, whether or not we actually believe they will happen.

Tweet This Post

The sustained market rally, with stocks up over 40% on average since the lows in March 2009 (The Dow Jones Industrial Average was about 6,500 in March 09; it is now about 9,500) is taken to be a forecast that real future economic recovery is on the horizon. But is the market a reliable forecaster of anything? That is, from the perspective of real industry and strategic foresight professionals, using hard-won, battle-tested approaches to anticipating future outcomes, should we factor the market’s direction into our expectations of the economic future?

DJIA since Sept '08

The answer is, broadly, yes. Stocks are shares in the future earnings of a company. They are therefore a “bet” on (er, an “investment” in) the future performance of a company, or many companies. The trading price on any day is the price at which there are as many buyers as sellers for these future returns. Rising prices mean there are more buyers than sellers, that means general expectation of future profits is going up. Investors are putting a higher price on the future.

The market is therefore considered a leading indicator of economic conditions. (By contrast, employment figures are lagging indicators — due frictional forces, not to mention morality, it takes companies a while to downsize in recessions or upscale in booms, so employment levels track economic conditions but with a delay.)

But how valid and dependable is the market as a leading indicator? It is also apparent that markets move up slowly and steadily, but fall in a hurry. So the downward move can hardly be held to be predictive. But the upward move appears to hold some weight as harbinger of better times. How much weight?

What’s particularly important is that the aggregate insight into future returns from shareholding investments — across many investors and many stocks — cancels out individual errors. Any one person may have a dumb idea of the ‘future cash flows’ from one or many companies, and the price of any one company may be unreliable for innumerable reasons, including fraud, but the knowledge and intelligence of hundreds of thousands of people, when aggregated and spread over many thousands of stocks, corrects for all these errors. It becomes robust.

Prediction Markets

This reliability of shared, aggregated insight — the wisdom of crowds — is precisely what makes ‘prediction markets’ such a powerful forecasting tool, as I have mentioned in previous posts. (Prediction markets apply market-like wisdom to create foresight in areas that are not normally ‘tradeable.’) Any one person will, as likely as not, get it wrong, but everyone together, rather astoundingly, get it right.

Ironically, crowd wisdom is much more reliable than the technical forecasting models that investment institutions use to try to determine how business, macroeconomic, interest rate, or other conditions will affect future stock prices. These predictions, based on the assumptions of a handful of model programmers and/or model users, are deeply vulnerable because there is no crowd-wisdom balance. It’s no better than reading tea leaves, only apparently (and unaccountably) more respectable.

Having said all this, it is well known that the ‘crowd,’ aka the ‘herd’ can and do all get it wrong together. This is what happens in price bubbles, or panic market exits, with everyone buying or selling because they are making the same wrong assumptions, or just doing what everyone else appears to be doing. (Most players making the same mistake together is the basic problem when prediction markets fail too.)

However, what is clear is this case is there was a very hard sell-off in the months prior to March 09, following revelations of the gravity of the Credit Crunch, but that this has slide has been arrested and mostly reversed. This says that innumerable smart people with, collectively, billions of dollars at stake, are expecting future profits higher than they did in March. That’s a prediction one can rely on.

Tweet This Post

I note from a link on the Ian Miles Futures blog that “2025:  Scenarios of US and Global Society Reshaped by Science and Technology” by Coates, Hines, & Mahaffie, is now available free for full-text download.

For full disclosure, I should say I worked in the Coates office in Washington D.C. during the mid-late 1990s (but got there just after the book was done.)

There are deep and ultimately overwhelming problems with the book itself. It sees science-technology as the primary driver of change, when what science is done and what technology is produced is often the product of policy or economic or values / zeitgeist decisions further up the chain. It also has an astoundingly poor conceptual framework (‘Worlds 1, 2, 3′) for dealing with non-US societies and cultures, and their economic and social development: one that would make Tom Friedman (‘World is Flat’) giggle and Hans Rosling surely cry. Truly there are many reasons they have to give this book away for free.

But its importance is elsewhere. It remains remarkable for one thing — the thing that the Coates & Jarratt foresight firm was known for — a willingness to speculate confidently and in detail (and sometimes even stupidly) about future changes. The book is likewise exemplary in its commitment to concrete, interesting, ‘fearless’ long-range speculation, in a world where most analysts waste most of their foresight ink timidly equivocating and covering their back.

Quality, reloaded

Evocative, concrete speculation is important, even if it is wrong. It is commonly misapprehended that the purpose of foresight work is to “predict the future,” (and someone with this perspective is going to pop up in 2025 and say “so, how right or wrong was this book?”) But, nobody can be right. The real value of foresight work is other: to know as much as we can about the present, and the forces and factors changing it, to be able to preconceive the full range of possible future outcomes that pertain, in order to make decisions today towards an outcome we prefer. (Who “we” are and what “we” prefer — social welfare; shareholder value maximization; environmental sustainability, etc., — will vary hugely among interest groups of course.)

This preconception (of a range of scenarios, if you like) is what allows truly effective discussions and debates to take place in considering alternatives, and therefore promotes better decision-making regardless of whether the scenarios ultimately turn out to have been, in themselves, ‘right’ or ‘wrong.’ High-quality scenarios are to be preferred of course, but quality is in the ability to stimulate and provoke management attention to the right areas in a timely manner, not in having been right in prediction. As Coates used to say (and I echo this to my Industry Foresight students): “You don’t have to be right, you just have to be interesting.”

Tweet This Post

Samuel, L., Future: A Recent History, University of Texas Press, 2009

I recently received a copy of Future: A Recent History to review. True confession: what hit me first on picking up the book was (a) “wow, the title Future is not already taken!? And (b) what a fabulous job the University of Texas Press has done producing this book. It is beautifully designed, with an understated Art Deco motif, and carefully laid out with enough text on the page, on delightfully solid paper stock.
It may seem odd to go on about text on the page, but it’s much easier to read like an adult, in paragraphs. So many books, particularly business books, these days appear produced at 14-point, double spacing, like pre-school readers. Makes you wonder…

Anyway, author Larry Samuel’s project is to investigate the history of views of the future from 1920 to the present. (The book has an acknowledged US-centric focus, partially defended by the notion that future-mindedness is “a principle strand in America’s DNA.”) He organizes the book chronologically into six periods between then and now, and shows, with interesting examples, how each period had its own views of the future, and how the views shifted from period to period.

In tracing the history of “tommorowism,” in this way, Future is on a similar track to the classic book in this field: I.F. Clarke’s The Pattern of Expectation 1644-2001 (Jonathan Cape, 1979). It ultimately makes similar points, although Samuel’s argument is obviously drawn from more recent examples. As Samuel puts it: “A look back on how people looked forward reveals that while it possesses certain common themes … the future is not a fixed idea but a highly variable on that reflects the values of those who are imagining it.”

Happily I can say this chimes exactly with the argument of Future Savvy, particularly Chapter 4 “Zeitgeist & Perception,” where I argued how heavily the nature of the present and its topical issues frames how the future is seen (what is forecast, what is aspired to or feared, what counts as a valid method for thinking ahead, and so on). Which means the framing conditions of the present  should be carefully analyzed in assessing the validity of any future view.

Historiography

Historiography – investigating the meta-conditions surrounding what is recorded and how it is interpreted by historians – what counts as “history” and for whom –  is a well-understood part of doing good history. Unfortunately, there is no equivalent standard “futuriography” in the foresight field, despite it being absolutely fundamental to understanding the value of our own predictions as, similarly, highly determined by the epistemic configurations of their production. It is here that Samuel very competently fills a much needed gap.

The practical implication of this, which Future does not get into – it’s not that kind of book – is that to make better predictions (or make valid assessments of others’ predictions) we need to ask stiff questions as to how much of what we foresee is determined by the perspectives of today, and expect the answer to be “very much.” Understanding the limitations and biases of our own perspective is the sine-qua-non of a robust view of what tomorrow will actually bring.

Tweet This Post

Peter Bernstein, the author of “Against the Gods: The Remarkable Story of Risk,” died recently at the age of 90. In memoriam McKinsey Quarterly reposted this recent Bernstein interview. I put it up here because it’s a timely and timeless lesson in thinking about uncertainty and threats, and avoiding simplistic (quantitative) approaches to managing them – one of core themes of “Future Savvy.” Bernstein offers and endorsement of real options and explains why sophisticated Long Term Capital Management (LTCM) mathematical models to control risk created “a math dependency” that was blind to, among other things, unexpected systemic feedback to its own emergence:

One of the first things Bernstein says is that risk implies that we don’t know what will happen, which could be good things happening too. Risk management, as it is currently understood, gets executives to look at what could go wrong in the uncertain future of the enterprise. (Somehow threats are easier than opportunties to get departmental budget for.) The standard approach is to break risks down into commonly understood threat categories: a typical analysis would illuminated risks posed by technology failure, communications failure, security failure, natural disasters, accidents, or market/reputation risk, liability risk, financial/credit risk, and so on. This negative-outcome identification is typically followed by strategies to monitor, minimize, or control the risk event or its impact.

Doing all this is great, BUT it is just a narrow part of enterprise and industry foresight. Why? First, industry foresight or futures studies for business is focused as much on the opportunities change offers as on threats. Second, foresight tools (when correctly applied) set themselves the task of enlarging perspectives or mental maps so that we can see more things, or more possibilities than the generally expected set (whether good or bad). Set against this, risk management is little more than the catalog of known threats. The unknown or poorly understood threat, or unseen opportunity missed (and grabbed by others) is likely to be more damaging to the enterprise.

Tweet This Post

I’ve been quite careful not to use this blog as a “brag wall” for Future Savvy. I can say reviewers have all been glowing, without exception. But this review, below, which recently appeared in the St Andrews Management Institute’s Vector Magazine, I felt was worth reposting here because – more than just saying nice things – it also captures the essence of what the book is trying to do. Here it is:

Book reviews by SAMI fellows and associates
“Future Savvy” by Adam Gordon (American Management Association, 2009)

“Forecasts and predictions are ubiquitous. We are bombarded with views of the future on a plethora of subjects from myriad sources, with a diverse set of motivations and self-interests. Adam Gordon seeks to provide a practical users guide to the assessment and interpretation of all things about the future, with special emphasis on the cautions and ‘health warnings’ that need to be applied, so as not to be misled by forecasts. However, the author is careful not to veer towards over-cynical dismissal of all future projections; rather, he seeks to provide guidance to the reader on how to apply the necessary caveats, and in the author’s words “profit from change”.

The book covers a very broad field, from the basic issues of the misuse of data and statistics, covering the quality and validity of data as well as their misinterpretation, through technology forecasting, trend and horizon scanning to quantitative modelling and scenarios. The one theme common to all these activities is the need to be alert to bias, whether it be a deliberate motive to influence behaviour through a dire prediction; or a bias inherent in futurologists needing to see rapid and pervasive change in all areas of society – if it exists or not – and evangelising it.

The track record of much futurology is mixed. Well-known examples are quoted: television did not lead to the end of the cinema industry. Nor has space exploration led to people taking foreign holidays on other planets – yet! Bias may also lie in the beholder. The ‘Zeitgeist’ tendency, whereby we are all influenced by contemporary perceptions, affects not only how “experts” and professionals see the world, but also how the audience receives the views of the future – often with unprepared minds. The internal “official future” of an organisation can pose a real blind spot to its progress.

The weaknesses of much quantitative modelling are highlighted, with such forecasts only being as good as the assumptions on which they are based, but which are often not overtly stated. In contrast to the conceptual and practical errors inherent in much futures output, the role and advantages of scenario planning are emphasised as a tool for challenging assumptions and developing alternative futures: “It’s better to be vaguely right than precisely wrong”.

The penultimate chapter takes examples of relatively recent forecasts from a range of organisations, whose subjects range from US agricultural production to UK dementia sufferers. These are subjected to a form of ‘retro wind-tunnelling’ to illustrate the deficiencies in their construction and how they would have benefited from the application of methodologies described earlier in the book. The final chapter provides a summary checklist, or framework, to apply in evaluating forecasts and future predictions.

Adam Gordon has written a shrewd and perceptive book that deserves a wide readership, especially among managers in both the private and public sectors, as well as the familiar ‘general reader’. Those wishing a more detailed technical guide to the various forecasting and futurist methodologies will need to consult other standard works. Professionals in the fields of management and strategy consulting and scenario practitioners might well be familiar with many of the points made in the book. However, those with some savvy might do well to recommend the book to their clients.

Michael Owen, 20 April 2009

Tweet This Post

One of the more alarming mistakes in foresight work is that forecasters don’t see themselves as operating within their own world view, and the preconceptions and priorities of their own time. In fact the very idea of foresight – why do it and how to do it – has changed quite markedly through human history. Knowledge of this historiography is of course important in assessing current forecasts. This is why Oona Strathern’s A Brief History of the Future (Robinson, London, 2007) is an important book.

One doesn’t start reading a “Brief History of” book in a series that includes A Brief History of the Birth of the Nazis and A Brief History of British Kings & Queens, without a certain trepidation. But, in fact, A Brief History of the Future is well-considered and well-written summing up of the characters and concerns that have shaped and continue to shape the future studies field.

Strathern, is a British journalist-turned-futurist, based in Vienna. One of the key attributes she brings is a journalist’s (and sub-editor’s) critical “don’t-bullshit-me” faculties, which is welcome in a field that is often short on common sense.

The book is hardly brief (at 300 pages) so there’s no sense that it’s a potted history. And it’s not compromised by what one – alas – expects of this kind of setup: pandering to all characters in positive or equal terms. In fact a key value of the book is its clear-headed and plucky judgment of who the key figures are (and who are not) and what their contributions have each been (vs what they might have thought they were). It is also unusually even-handed in balancing US and European inputs.

The book follows the obvious structure, starting with the oracles of Ancient Greece, Plato, moving through Leonardo de Vinci, and Thomas Malthus and so on through to the 19th century (Jules Verne, Karl Marx, etc.) and on to the present. In this Strathern argues for and operates with a wide definition of futures work – including in the dreamers, social reformers, and sci-fi writers in addition the more formal analysts and planners.

20th Century Weltanschauung
The book really hits its straps in the 20th century – in discussions of Aldous Huxley, H.G. Wells, George Orwell, Arthur C. Clarke, Herman Kahn, Buckminster Fuller, Alvin Toffler, Isaac Asimov, Margaret Mead and many lesser known figures. What is most interesting here is how the links between foresight approaches and the evolving broader existential and political “weltanschauung” of the century is knitted together, inserting “futurology” into the 20th century world of ideas at each point.

Although the book deals with institutions of foresight pretty well, the one angle I missed was the development of foresight education over the past 40 years. Part or full university degrees in foresight methods are an important part of the evolution of the field. Much has been learned in the debates over what and how and where to teach it. Ironically, the book – as intelligent a summary of the “future studies” field as you will find – would be an ideal text for an introductory course in such a curriculum.

Tweet This Post