Future Savvy, as viewed by ‘Info-Savvy’ Peter Stoyko (SmithySmithy)

Posted by Adam Gordon on Jul 29, 2010 in all, decision-making, failed predictions, forecast filtering, Future Savvy, managing uncertainty, scenario planning, strategic foresight, trend tracking

I was lucky enough to have Future Savvy included in a lengthy review of critical thinking in forecasting & foresight, done on the SmithySmithy “info-savvy” blog. The post also included Nassim Taleb’s ‘The Black Swan’ (2007) and ‘Fooled By Randomness’ (2005); Kenneth Posner’s ‘Stalking the Black Swan’ (2010), and Chris Luebkeman’s Drivers of Change (2009).

As Stoyko’s is head-and-shoulders the most insightful and thorough assessments of the book itself, and the book in context, I’m reposting it here, with thanks. There are also fabulous graphics added, such as these (see more below):

“My search led to Adam Gordon’s Future Savvy. Like Posner, Gordon challenges Taleb’s blanket dismissal of forecasting. Gordon does not deny the existence of Black Swan events. And his book is a giant compendium of all of the things that usually go wrong with predictions. Moreover, Gordon offers a sceptical discussion of the subject that chastises simple-minded futurists, tech enthusiasts, and various other prophets of doom and boom. The difference between Taleb and Gordon is that Gordon doesn’t dismiss out-of-hand the usefulness of structured thinking about the future. Many important decisions require us to speculate about what the future might hold. Gordon wants us to be savvy in the way we anticipate the future instead of flying by the seats of our pants, so to speak.

“To set the stage, Gordon talks about how the forecasting industry is rife with problems. There are no standards, no accepted methods, no standard terminology. There are no penalties for failure given that people tend to forget forecasts by the time they can be proven wrong. And when dealing with the forecasts offered by pundits, stakeholders, and activists, Gordon reminds us, “we are knee deep in predictive wishful thinking, scare-mongering, or blatant self-promotion.” (p. 5) Buyer beware.

“Then there are the data problems. Forecasters use data from the past to project trends into the future. They rely heavily on data gathered for other purposes, not gathered for the task at hand. Availability is patchy. The data comes from multiple sources and is created using different methods. Important statistical caveats get lost. The context of the original studies gets forgotten. Variables are often defined loosely … and change over time … and are measured differently in different places. Data gathering methods often change over time in ways that exaggerate or obscure a trend. Sensationalist “newsy” data often commands the most attention. Some things are inherently difficult or impossible to measure accurately. All sorts of assumptions get embedded in data projected into the future. Furthermore, Gordon talks about the ways in which numbers can be finessed in an underhanded way. He advocates “number scepticism”, warning: “But no matter how scientific the data appears, choices have been exercised at every point about what to observe, what to count, how to measure it, and how to report it. … But numbers are not bedrock. There is no bedrock.” (p. 59)

“As an aside, statisticians have a snide nickname for analysts who mix’n’match statistics from a hodgepodge of sources to create complicated models or story-lines. That nickname is junk-yard dog. Gordon gives the impression that the forecasting business is, by necessity, heavily populated with these collectors.

“The sources of potential error don’t end with data. Our biases cause us to misinterpret and misreport the data.

“Some bias is intentional manipulation. Rascally analysts ignore or downplay countervailing evidence. They give evidence less scrutiny if it confirms the desired result. Emotionally charged language and associations are used. Terms are defined in leading ways. Extreme cases are used to represent the norm. Forecasts that don’t accord with an agenda get ignored, especially if the forecast is sponsored by a powerful interest. Organisational incentives can cause those being scrutinised to fudge the numbers. When forecasts are presented to the media, the most extreme trends get attention and important caveats remain unreported. Gordon is particularly critical of the so-called futurists who use “stretch thinking” and “big-picture thinking” to imagine a world full of only big changes. Many have a technophile bias, or the assumption that technology is the sole motive-force of large-scale societal change. Gordon’s advice is to keep your guard up and be wary of motives.

“Setting aside the thinness of this advice, Gordon has a strange attitude when talking about manipulation. He makes a distinction between forecasts that attempt to be accurate and forecasts that attempt to influence. Employee-prodding managers, partisan policy wonks, and alarmist activists use loaded forecasts to move minds. Humility, qualification, and tentativeness don’t have a place in these circles. There may be a legitimate reason for using leading forecasts, such as communicating the art-of-the-possible or giving someone an ambitious target to strive for. However, leading forecasts without full disclosure are instruments of underhanded manipulation. Gordon is eerily agnostic. His advice and tone of voice suggests that he is oblivious to the ethical problems posed by the manipulative use of forecasts. It’s a strange contrast with Gordon’s advice about being careful and pragmatically sceptical. [Editor's note: Agnostic? Moi? Hardly, but perhaps the chill of my irony was not chilly enough.]

“Back to the sources of error.

“Gordon itemises a number of cognitive biases that are inherent to the way we think. We often miss Black Swan events and abrupt changes in prevailing wisdom (“paradigm shifts”), he argues, because we are always filtering information based on perceived relevance. This “inattentional blindness” causes us to not notice important influences on the future. We also overemphasize recent happenings over older events (the recency effect). We’re susceptible to herd thinking and faddish ideas. A few chance events are often mistakenly interpreted as a trend or other pattern. Gordon places particular emphasis on how our current context frames the way we see and think (situational bias), especially how the prevailing mindset and preoccupations of an era skew the way we think about the future (Zeitgeist bias). For example, nuclear-powered airplanes may have seemed inevitable to someone living in the 1950s, a time preoccupied with thoughts of nuclear technology, suggests Gordon. That notion seems absurd today. To counter this problem, he argues for the need to extract the assumptions underpinning our expectations. Those assumptions need to be questioned and tested. And one good test is to reverse the assumption; that is, consider how the future would be different if the opposite (or very different) assumption were used.

I would add that people habitually rely on lazy assumptions about the future in general. As Howard Segal points out in his book Technological Utopianism in American Culture (2005), late-19th and early-20th-Century intellectuals assumed a technological plateau when describing the future. Even today, we assume our arrival at some destination—a future steady state—instead of a world of on-going change that is unevenly distributed and erratically paced, as exists now.

Gordon invites us to consider the utility people derive from a particular technology before jumping to conclusions about how it will revolutionise everyone’s lives. Tech-happy futurists are too quick to assume broad public acceptance of a new technology while ignoring the trade-offs of adoption. There are costs to be considered. In many cases, the price is too high and existing technologies do a good enough job. Or old technologies have an inertia, such as when users are “locked in” to a particular technology. Or social values change. Or switching creates undue inconvenience and aggravation. Or the technology has uneven appeal across diverse groups in society. Or, or … Gordon reminds us that simple technological domino effects almost never happen. The pace of change is usually slower than anticipated. A variety of factors determine how successful an innovation will be.

That leads us to the dynamics of change. I’m not going to describe each dynamic in detail. Gordon devotes a lot of space to them. Instead, I’ve listed them iconographically in the following diagram. Note that the darker lines signify consequences (and consequences of consequences; a.k.a. second-order and third-order events).

“A trend observed today may not continue onward along a straight-forward path. Trends peter out … change course … hit limits … get caught in reinforcing loops … have side-effects … provoke reactions … et cetera. The same goes for underlying causes. Trends can be particularly difficult to track within the complex systems that govern our lives. Thus, Gordon offers a chapter on system analysis.

“As someone who studies organisations, I’m often seeing policies and strategies change with sadly predictable pendulum swings. Gung-ho leaders push in one direction with gusto only to get a lesson in humility. Their efforts hit limits and opposition. Their assumptions hit reality. Subsequent leaders see wreckage everywhere and push in the opposite direction, looking for balance. Balance alludes them and they go to far. Another pendulum swing begins. Some swings happen from season to season. Others happen over decades. These swings may be predictable, but their exact timing certainly isn’t.

“Gordon rounds out Future Savvy with a utilitarian survival-guide of sorts. His big advice is that “it’s better to be vaguely right than exactly wrong.” Success is being alert to important changes and being prepared to cope, not with having accurate predictions. Narrowing down the things that need to be prepared for is an important practical benefit. In that spirit, Gordon talks about the strengths and weaknesses of using multiple scenarios instead of pat forecasts. He steps the reader through the analysis of some forecasts while looking for weaknesses. A chapter-long battery of questions is offered to guide the analysis. These questions do a good job of summarising the book.

“All told, Future Savvy is an excellent textbook for those who want to discipline the way they think about the future. I disagree with Gordon’s tangents about the inherently subjective nature of truth. I also have a few qualms about his take on scepticism. But these tangents rarely get in the way of his stock-taking exercise. That exercise has led me to be even more suspicious of forecasting, especially forecasts in volatile industries where data is patchy and assumptions are legion. I’d love to know the success rate of high-tech cheer-leaders … er, research firms that peddle forecasting numbers. Gordon dismisses the tracking of forecast failures as “smirk lists”. I’m with Taleb and his tsk tsking. If these numbers are just part of the hype machine and have a dismal track-record, then what good are they? Validation for reckless investment strategies? Fodder for misleading Power­Point slides? Numbers that give a false sense of being in-touch with the market? Tsk tsk.

“That said, Future Savvy has increased my interest in foresight more generally. Gordon’s guide left me wondering how I can better prepare groups of decision-makers to think about the future. How do we get them to see the many changes afoot with greater foresight?”

Been a while since there was a ‘Future Savvy’ podcast, but here’s a new one

Posted by Adam Gordon on Apr 20, 2010 in all, decision-making, failed predictions, Future Savvy, managing uncertainty, Perils of Prediction

I had a chat the other day to Stephan Magus for his Abenteuer Zukunft (Future Adventures) podcast channel, taking about the rationale behind making a stand for quality in foresight. That is, what’s under the hood of Future Savvy, and why.

The podcast is up at the Abenteuer Leben site, playable via the buttons on the right hand side.

Alternatively it can be accessed directly at

http://media1.roadkast.com/abenteuerzukunft/DAZ71_120410_6tt6.mp3

(If you don’t speak German, you need to fast forward through the first 3 minutes.)

Perhaps some lessons in prediction learned as US dollar-demise scenario emerges

Posted by Adam Gordon on Oct 19, 2009 in 2015, all, economy & finance, failed predictions, foresight tools & methods, managing uncertainty, scenario planning, strategic foresight

One of the benefits of scenario-based future thinking is the ‘permission’ to think through alternative future outcomes without necessarily predicting them. ‘Predictors’ focus, by contrast, on isolating the highest probability future in order not to have to think through or plan for less likely outcomes.

Predictions of the dollar’s demise are as old as the greenback itself of course, but over recent weeks the specter of the dollar heading way way below its trading range — a dollar crunch — has entered the zone of the credible, or, in scenario terms, the ‘cone of plausible uncertainty.’ That means decision-makers with lots at stake are taking it seriously.

Like the British pound, the dollar has been under a cloud due to perceptions of economic fallout from the credit crunch and global recession, but particular questions about the US currency have recently surfaced, driven by reports [Robert Fisk's 'The Demise of the Dollar' story in The Independent (Oct 6)]  that “Gulf Arabs are planning – along with China, Russia, Japan and France – to end dollar dealings for oil, moving instead to a basket of currencies including the Japanese yen and Chinese yuan, the euro, gold and a new, unified currency planned for nations in the Gulf Co-operation Council” (Saudi Arabia, Abu Dhabi, Kuwait and Qatar).

The subtext is far from merely financial. Practically, it would mean that on any day, the real cost of oil to US consumers and businesses would go up or down depending on the strength of the currency. This is something America is not used to. But, more deeeply, dropping dollar-denomination of oil is a direct shot across the bows of Washington’s say over oil affairs, and the hegemony of the dollar as the dominant global reserve currency.

De-dollarizing oil would not in itself push the US currency below its 25-year range. But it is portentous of the clear trend to a genuinely multi-power world, for better or worse, in which the dollar will get no favors. That will push the dollar down, at least while the news and fallout make their way through the financial and real economic systems.

Rumors of de-dollarization have been hotly denied, as further reported here, but as the Independent points out, denials are to be expected, and are always issued in these situations. They mean nothing. Even cub reporters know that.

.
Scenario thinking

What’s particularly interesting to me is that a ‘scenario’ of dollar demise has become not only plausible in the mainstream view of the future, but scenario thinking is being used as a way to consider the nature of this outcome, and how best to respond without predicting the outcome either way. As recently as directly pre-credit crunch, the media question would have been: ‘what is the best prediction for the dollar (or the housing market, or credit default swaps?) and that, rather then scoping out the implications of the lesser-likelihood, would have dominated the discussion.

So, what struck me forcefully in the Business Week video interview above, where BW Chief Economist Mike Mandel interviews the news magazine’s Economics Editor Peter Coy (see Coy’s underlying story here), is how the less-likely, non-predicted, but very significant outcome is actively addressed:

Says Coy: “It’s so hard to know what the dollar is going to do. We don’t argue that we know… what we do is we say, ‘it could happen’ and let’s take that possibility seriously, in the same way we should have taken the possibility of falling housing prices seriously…”

This is not formal scenario-building of course. But it is, fundamentally an adoption of the framework, saying in the classic ‘scenarios’ way: “we can’t predict if it will happen or it won’t, but if it does it will have significant impact. So let’s just ask: ‘what if ‘ it does and explore the outcomes and our responses. What will the word look like? What would be the implications, the knock-ons and spinoffs? If it comes to pass, what would be wish we had done today?”

Perhaps failing to predict the credit crunch has dented predictors’ halos enough to cause a mini-zeitgeist-shift towards the only real way to cope with important uncertainty: exploring all outcomes that pass the plausibility and significance test, whether or not we actually believe they will happen.

Poundstretcher’s lessons for the future, for 2025, for 2050, and beyond

Posted by Adam Gordon on Aug 4, 2009 in 2025, all, economy & finance, failed predictions, lifestyles & values, social change, technology change

In all the predictions of the future that I have ever read or heard, and all the scenarios I have been exposed to, it’s almost unheard of to see one that says “the squeezed middle class keeps their eye on a good deal, as they always have.”

I’m thinking about this as I see the Guardian today featuring a story about how “Poundland” has doubled it’s profits. Poundland is a copy-cat of the venerable US institution, the “dollar store,” where everything cost the same price, in this case £1.

Pic: Andrew Fox, The Guardian, August 4, 2009

The merchandising of these stores is not unsubtle. There are definite too-good-to-be-true loss leaders, but these more than offset by the many items that cost pennies wholesale. Fair enough. And recently reported doubling of profits is because more people are buying at these stores (downshifting) due to recessionarly squeeze and/or because of the current “sense of thrift” in the zeitgeist which makes pennywatching more “the done thing.”

But neither merchandising, nor consumer psychology is our primary concern here. From a foresight point of view, the point is that forecasts of 2010 that were around around a decade or two ago didn’t quite get around to saying anything about Poundstretcher leading a healthy economic life. It’s as unsexy as anything, compared to “peak oil” or advancing “singularity,” or nano-babble, and so on into the glorious future – or its polar alternative: crash & burn, soup kitchens, urban warlords rampaging, and so on.

But here we are coming to the end of the decade and a basic retailing gimmick for the squeezed middle-class consumer is well trafficked and very much part of the future. Yes, it’s success correlates with tougher times, but economic cycles will be with us repeatedly through the rest of the century and beyond.

This doesn’t mean there won’t be breakthroughs in technology or in consumer behavior. In fact, looking at the picture, one surely would not have got a pound for any amount of plain bottled water in a retail environment 20 years ago. Things do change. They just change slowly, or unevenly, against the gritty reality of savvy agregate choices made by a wary (global and growing) middle class.

‘Shrewd and perceptive book deserves wide a readership, especially among managers’

Posted by Adam Gordon on May 6, 2009 in all, decision-making, failed predictions, forecast filtering, foresight tools & methods, Future Savvy, leadership, management, strategic foresight

I’ve been quite careful not to use this blog as a “brag wall” for Future Savvy. I can say reviewers have all been glowing, without exception. But this review, below, which recently appeared in the St Andrews Management Institute’s Vector Magazine, I felt was worth reposting here because – more than just saying nice things – it also captures the essence of what the book is trying to do. Here it is:

Book reviews by SAMI fellows and associates
“Future Savvy” by Adam Gordon (American Management Association, 2009)

“Forecasts and predictions are ubiquitous. We are bombarded with views of the future on a plethora of subjects from myriad sources, with a diverse set of motivations and self-interests. Adam Gordon seeks to provide a practical users guide to the assessment and interpretation of all things about the future, with special emphasis on the cautions and ‘health warnings’ that need to be applied, so as not to be misled by forecasts. However, the author is careful not to veer towards over-cynical dismissal of all future projections; rather, he seeks to provide guidance to the reader on how to apply the necessary caveats, and in the author’s words “profit from change”.

The book covers a very broad field, from the basic issues of the misuse of data and statistics, covering the quality and validity of data as well as their misinterpretation, through technology forecasting, trend and horizon scanning to quantitative modelling and scenarios. The one theme common to all these activities is the need to be alert to bias, whether it be a deliberate motive to influence behaviour through a dire prediction; or a bias inherent in futurologists needing to see rapid and pervasive change in all areas of society – if it exists or not – and evangelising it.

The track record of much futurology is mixed. Well-known examples are quoted: television did not lead to the end of the cinema industry. Nor has space exploration led to people taking foreign holidays on other planets – yet! Bias may also lie in the beholder. The ‘Zeitgeist’ tendency, whereby we are all influenced by contemporary perceptions, affects not only how “experts” and professionals see the world, but also how the audience receives the views of the future – often with unprepared minds. The internal “official future” of an organisation can pose a real blind spot to its progress.

The weaknesses of much quantitative modelling are highlighted, with such forecasts only being as good as the assumptions on which they are based, but which are often not overtly stated. In contrast to the conceptual and practical errors inherent in much futures output, the role and advantages of scenario planning are emphasised as a tool for challenging assumptions and developing alternative futures: “It’s better to be vaguely right than precisely wrong”.

The penultimate chapter takes examples of relatively recent forecasts from a range of organisations, whose subjects range from US agricultural production to UK dementia sufferers. These are subjected to a form of ‘retro wind-tunnelling’ to illustrate the deficiencies in their construction and how they would have benefited from the application of methodologies described earlier in the book. The final chapter provides a summary checklist, or framework, to apply in evaluating forecasts and future predictions.

Adam Gordon has written a shrewd and perceptive book that deserves a wide readership, especially among managers in both the private and public sectors, as well as the familiar ‘general reader’. Those wishing a more detailed technical guide to the various forecasting and futurist methodologies will need to consult other standard works. Professionals in the fields of management and strategy consulting and scenario practitioners might well be familiar with many of the points made in the book. However, those with some savvy might do well to recommend the book to their clients.

Michael Owen, 20 April 2009

Hello Davos: all crises of the present are foresight failures of the past

Posted by Adam Gordon on Jan 30, 2009 in all, decision-making, failed predictions, forecast filtering, Future Savvy, leadership, managing uncertainty, policy, risk management, strategic foresight

All crises of the present can be viewed as a failure of foresight or planning at some previous point, and the current global economic crisis is no different.

The mood is justly sombre at the World Economic Forum’s Davos meeting this year, as grim-faced world leaders mull over the dismal state of the global economy and how to fix it. This is in marked contrast to recent years, when the top executives were warmly congratulating themselves on the general state of things.

In one sense this is perfectly understandable. The crisis is upon us and leaders should be directly and practically involved in tackling it. On another level it’s profoundly disturbing, because world leaders and senior managers should be doing more than merely responding to situations. When crises occur, crisis management becomes part of a leader’s job, but their real job is thinking ahead effectively to avoid crises and, on the positive side, develop opportunities.

Put another way: the heads of a companies or countries – Davos-level people – are tasked far beyond effective daily management. They are tasked, fundamentally, with negotiating the VUCA (volatile, uncertain, complex, ambiguous) world on behalf of the rest of us. If not them, then who?

This requires foresight and vision. In this sense, many who are at Davos this week are responsible for the current crisis. They failed to foresee it, in fact they generally endorsed the growth of complex financial instruments, the shadow banking system, and private equity growth –- much of which bypassed SEC or equivalent regulation, and which is now seen to be the root cause of the meltdown.

In fact much of the “new finance” system was thought to spread and therefore actually lower risk. Turns out that was a poor view of the future. In fact the present situation as a whole is the result of key decision-makers operating on a poor view of future. As a group, their mental model was not open to bad outcomes, or even just alternative outcomes to what was commonly expected.

Could we have thunk it?

Their response might be: “nobody can predict the future!” “Easy to say after the event!” This is true. But it’s common knowledge that there were those who foresaw the mess — The Times identified at least 10. As Davos attendees might now be forced to agree, some forecasts are clearly better than others.

This is where executive leaders can learn from the foresight field and particularly the history of failed predictions. Everyone relies on predictions for their guide to the future – nobody can be an expert in every field. And there’s never a shortage of them – they are frequently published in the media, offered by consultancies and think tanks, and are a key part of Davos.

While getting a prediction is easy, the key leadership skill is to be able to tell a good one from a bad one: that’s what turns a forecast into a strategic resource. That is what leads to better decisions, better plans, and better actions.

Can one do that? Can one critically assess a particular or consensus-held view of the future, to identify its strengths and weaknesses? Absolutely yes. Among the tests one can run on a prediction are:

•    assessing motivation – who is speaking and what their agenda might be, particularly if they have an interest in maintaining a current system or shaping the emergence of a new one
•    determining whether the tools used are appropriate to the level and type of uncertainty faced. High-uncertainty situations and long-term views require different approaches to standard modeling
•    questioning consensus mental-models and forcing consideration of alternative outcomes. All foresight is swayed by “zeitgeist” – spirit of the times – and good forecasts swim against this tide.

These are just a few among the many forecast tests one can run, as detailed in Future Savvy.  But even if Davos attendees had been applying just these three in previous years, their foresight would have been greatly improved. It won’t help with this crisis, but it might forestall the next.

* This article, authored by Adam Gordon, was first edited and published by Bnet.co.uk

The Zeitgeist Effect on Prediction Markets

Posted by Adam Gordon on Sep 4, 2008 in all, failed predictions, foresight tools & methods, Future Savvy, prediction markets

In my previous post, below, I threatened myself with the penance that I’d have to come back and think about the zeitgeist effect as a further limit on the use and validity of prediction markets. (Once again, I’m basically sold that prediction markets are a fabulous way to think about the short-term and/or contained system future, but it’s worth being clear about the limits of this tool.)

Zeitgeist, German for “spirit of the times,” refers to the often unconscious spectrum of intellectual views, analytical approaches, political and social concerns, etc., that people in any era share. Evidence from the checkered history of predicting the future shows that forecasters have been very heavily biased by their then-current conditions, current issues, and current state of the world, that is by their zeitgeist. They see reality and therefore the future through the lens of their times. The key marker of this effect at work is when many forecasts are not only wrong, but are wrong in the same way.

The zeitgeist effect, by the way, is not a peculiar condition. It is part of the many common human and social cognitive-perceptual biases that exist. (For a longer list and their effects in forecasting, see Future Savvy.) Zeitgeist is in fact sometimes more broadly known as “situational bias,” where situations that people find themselves in frame what they see and how they interpret events. In a depression, famously, it is difficult to see any source of upturn; in boom times it is hard to see the crash.

The Zeitgeist of the 1990s
Just one example of zeitgeist bias in forecasting can be seen in predictions made in the 1990s, when the fall of Soviet Union and the end of the Cold War provoked new hope about global interaction and growth, and this, combined with the rise of digital technologies, the Internet, WTO agreements, and the dot.com market boom, fueled a new zeitgeist of optimism. It was very common, in this era to predict global prosperity, international peace and harmony, rising standards of living, enhanced personal freedoms, and a better environment. By the end of 2001, the NASDAQ bubble had burst, Al-Qaeda had struck buildings that symbolized U.S. power, the “War on Terror” had begun, and the entire rosy 1990s and all the forecasts that went with it, were finished. Zeitgeist or situation has, evidently, a very strong pull on what people think is possible and likely in the world at large, and in their own sector or industry. It frames the questions people ask, the topics they think are important, the outcomes they expect, and how they interpret signals of change.

The point is, do prediction markets somehow counter this well-known perceptual-cognitive bias in forecasting? No. The outcomes people think more plausible – that they will “buy up” in a prediction market – are deeply affected by situational conditions. This is sure to be a factor when, for example, Google sets up a market to tap its employees for forecasts. The people involved, smart as they are, will be strongly by situational factors – and this will affect which future outcomes look more likely.

Herd Effects
Moreover, they will be pulled in the same direction. As prediction markets, like Delphi studies, are particularly a consensus-based method (forecasters drawing predictive results from the study/game are going on what most people say/do), they are by definition deeply vulnerable to the zeitgeist effect. This dovetails with another well-known social cognitive bias, the “herd effect” or “bandwagon effect,” or “groupthink,” where people to believe or do things because many other people are doing or appear to be doing them. The only way to avoid groupthink is to isolate people from each other (as Delphi studies attempt to do by not disclosing others’ responses while the study is live.) But in prediction markets the player can, of course, see what others are doing. When buying a “stock” that is getting more expensive they may be reassured that others are buying it too — leading them to buy more, producing a classic herd-effect situation.

These biases – and various others, as detailed in Future Savvy, are among the many perceptual and cognitive biases that people bring to the world. They are part of (and evidence of) perception being active and constituent in our understanding of the world, and therefore of the future. We can chip away at our perceptual framwork, particularly by questioning our assumptions and investigating the basis of our knowledge (possibly through scenario planning.) However, no matter how astutely we look and how consciously we try to eliminate them, our paradigms exist, and they color our forecasts, and prediction markets do not make them go away.

Future Savvy: What’s Under the Hood

Posted by Adam Gordon on Jul 9, 2008 in 2015, 2025, all, decision-making, failed predictions, forecast filtering, foresight tools & methods, Future Savvy, horizon scanning, leadership, managing uncertainty, Perils of Prediction, scenario planning, strategic foresight, strategic planning, systems dynamics, technology change, trend tracking

The book Future Savvy shows readers how to critically judge forecasts for themselves. These are the chapters that take the reader there:

Chapter 1: Recognizing Forecast Intentions, deals with considerations of how forecasts come about, who makes them, and with what intention. Those who research and produce forecasts, those who invest in understanding trends and drivers of change, and those (including the media) who bring the forecasts and their implications to our attention, inevitably have reasons for doing so – to benefit from the knowledge by seizing opportunities or avoiding threats or by affecting outcomes in the world. Understanding a forecast’s “return on investment” gives us an important vantage point in assessing the merits of a forecast.

Chapter 2: The Quality of Information, shows how a forecast communicates information between forecaster and reader subject to the same standards of accuracy, truth-telling, and bias-control by which one would judge any communication. Forecasts can be very different in methods and goals, but all forecasts lay claim to factual truth, particularly truth in the data, and the argument deals with the various ways in which data can be less solid than it looks, even with the best intentions.

Chapter 3: Interpretation and Bias, considers how data – whether good or bad in itself – can be interpreted or misinterpreted in forecasting, that is, the “political” aspects of forecasting. Just as there is no value-free look at history, so too there is no value-free look to the future and asking the right questions allows us be ready to mentally rebalance forecasts that are presented.

Chapter 4: Paradigms and Perception, investigates how predictive statements are exposed to a broader form of interpretive bias that has to do with the forecaster’s mental model or “paradigm,” and the “zeitgeist” (spirit of the times) when the forecast is made. This chapter investigates situations where forecast failure is caused by failure to escape society’s current mental models – which often do not hold through the forecast period.

Chapter 5: The Utility Principle, considers economic and market forces, and the role of consumers, in promoting or resisting the future. Without reigning in creative thinking, some simple economic filters inevitably apply direction or timing realism to futurist flights of fancy.

Chapter 6: Drivers, Blockers, and Trends, consider drivers and blockers of change, and how viewing these dynamics improves forecast assessment. It identifies the roles of Drivers, Enablers, Friction, and Blockers acting on events to cause change or resist it, and problems in dumbly projecting current trends.

Chapter 7: The Limits of Quantitative Analysis, discusses the role of statistical analysis and quantitative modeling in predicting the future – where this is possible and useful and where it is not, and why not.

Chapter 8: The Systems Perspective, investigates “system effects,” which occur whenever different elements or variables that may appear isolated are in fact linked together, such that changes in one element cause changes in others. Anticipating future behavior of any variable hinges on identifying the broader systemic elements influencing it and failing to do this is a big part of what causes forecasts to fail.

Chapter 9: Living with Alternative Futures, investigates non-predictive ways of approaching change – where the tone is more about managing uncertainty than predicting the future. It acknowledges unfathomable complexity of most future questions and provides perspectives that raise chances of success in an inherently unpredictable future.

Chapter 10: Forecast Filtering in Action, illustrates the processes of the book by applying them in case studies to real-world sample forecasts that decision makers in business and policy areas might find themselves interacting with. This demonstrates how real everyday predictive material may be probed and critically evaluated, following the principles developed in previous chapters.

Chapter 11: A Forecast Filtering Checklist, is a cross-cutting checklist which summarizes the principles of the book in one convenient, thematic list.