Posted by Adam Gordon on Oct 29, 2009 in all, economy & finance, failed predictions, forecast filtering, foresight tools & methods, managing uncertainty, Perils of Prediction, risk management, strategic foresight
Continuing the theme of financial types talking to each other about predictions and predictability, this ‘Tea with the Economist’ interview of Stephen Roach, Chairman, Morgan Stanley Asia by Economist New York Bureau Chief Mathew Birk, carries interesting lessons about the limits of prediction.
Birk commends Roach for being one of the few to have predicted the Credit Crunch problems, to which Roach demurs in saying he was “too early”. He then furthers his modesty in saying that the “breakage” in the financial system was “in excess of anything I envisioned.”
Self-deprecation in assessing one’s predictive abilities will endear anyone to me. Even Roach, who later in the interview burns this hard-won credibility by laying the blame for the credit crunch at the door of regulators, forgetting how hard financial institutions lobbied regulators for greater freedoms in the 1990s.
But I digress. The predictive issues the interview raises are as follows. Issue one: it’s not enough (as any stock short-seller will confirm) to get the direction of a future change right. One must get the timing right too. Issue two: it’s not enough to anticipate a change. One must be able to judge it’s impact. Getting either timing or impact wrong is effectively to have missed the future.
.
Probability
On the latter topic — the problem of impact — Nassim Taleb is unrelenting, and he is right. Analysts routinely mix up probability and impact. They think that because an event has a low probability (‘it would be a 10-sigma event!’) it can be marginalized in the predictive number crunching. Of course, it can’t. The low-probability of a wildcard or black swan event is irrelevant because when it happens it will change the game, and that’s why, in every predictive situation of reasonable complexity and uncertainty, using statistical extrapolations (regressions and so on) to predict, is to dangerously paper over the cracks. It is precisely the cracks that businesses and policy makers need to worry about.
Determining the direction of change is hard enough. Assessing timing or extent of impact — a ‘total future impact index’ — is wickedly difficult. It’s a task not to be underestimated, and to simply extrapolate current trends (= assuming the trend’s timeline and impact stay the same as in the past) is the royal road to underestimating it.
This is the reason foresight for complex, uncertain, changing situations can only be grasped by NOT predicting (quantitatively or otherwise) but by exploring the limit-conditions of the plausible (What would happen if the timing of the change accelerated, or was significantly delayed? What if the impact was 10x or one tenth of what we expect? And so on.)
.
read morePosted by Adam Gordon on Oct 19, 2009 in 2015, all, economy & finance, failed predictions, foresight tools & methods, managing uncertainty, scenario planning, strategic foresight
One of the benefits of scenario-based future thinking is the ‘permission’ to think through alternative future outcomes without necessarily predicting them. ‘Predictors’ focus, by contrast, on isolating the highest probability future in order not to have to think through or plan for less likely outcomes.
Predictions of the dollar’s demise are as old as the greenback itself of course, but over recent weeks the specter of the dollar heading way way below its trading range — a dollar crunch — has entered the zone of the credible, or, in scenario terms, the ‘cone of plausible uncertainty.’ That means decision-makers with lots at stake are taking it seriously.
Like the British pound, the dollar has been under a cloud due to perceptions of economic fallout from the credit crunch and global recession, but particular questions about the US currency have recently surfaced, driven by reports [Robert Fisk's 'The Demise of the Dollar' story in The Independent (Oct 6)] that “Gulf Arabs are planning – along with China, Russia, Japan and France – to end dollar dealings for oil, moving instead to a basket of currencies including the Japanese yen and Chinese yuan, the euro, gold and a new, unified currency planned for nations in the Gulf Co-operation Council” (Saudi Arabia, Abu Dhabi, Kuwait and Qatar).
The subtext is far from merely financial. Practically, it would mean that on any day, the real cost of oil to US consumers and businesses would go up or down depending on the strength of the currency. This is something America is not used to. But, more deeeply, dropping dollar-denomination of oil is a direct shot across the bows of Washington’s say over oil affairs, and the hegemony of the dollar as the dominant global reserve currency.
De-dollarizing oil would not in itself push the US currency below its 25-year range. But it is portentous of the clear trend to a genuinely multi-power world, for better or worse, in which the dollar will get no favors. That will push the dollar down, at least while the news and fallout make their way through the financial and real economic systems.
Rumors of de-dollarization have been hotly denied, as further reported here, but as the Independent points out, denials are to be expected, and are always issued in these situations. They mean nothing. Even cub reporters know that.
.
Scenario thinking
What’s particularly interesting to me is that a ‘scenario’ of dollar demise has become not only plausible in the mainstream view of the future, but scenario thinking is being used as a way to consider the nature of this outcome, and how best to respond without predicting the outcome either way. As recently as directly pre-credit crunch, the media question would have been: ‘what is the best prediction for the dollar (or the housing market, or credit default swaps?) and that, rather then scoping out the implications of the lesser-likelihood, would have dominated the discussion.
So, what struck me forcefully in the Business Week video interview above, where BW Chief Economist Mike Mandel interviews the news magazine’s Economics Editor Peter Coy (see Coy’s underlying story here), is how the less-likely, non-predicted, but very significant outcome is actively addressed:
Says Coy: “It’s so hard to know what the dollar is going to do. We don’t argue that we know… what we do is we say, ‘it could happen’ and let’s take that possibility seriously, in the same way we should have taken the possibility of falling housing prices seriously…”
This is not formal scenario-building of course. But it is, fundamentally an adoption of the framework, saying in the classic ‘scenarios’ way: “we can’t predict if it will happen or it won’t, but if it does it will have significant impact. So let’s just ask: ‘what if ‘ it does and explore the outcomes and our responses. What will the word look like? What would be the implications, the knock-ons and spinoffs? If it comes to pass, what would be wish we had done today?”
Perhaps failing to predict the credit crunch has dented predictors’ halos enough to cause a mini-zeitgeist-shift towards the only real way to cope with important uncertainty: exploring all outcomes that pass the plausibility and significance test, whether or not we actually believe they will happen.
read morePosted by Adam Gordon on Oct 2, 2009 in all, economy & finance, failed predictions, foresight tools & methods, managing uncertainty, prediction markets, strategic foresight
The sustained market rally, with stocks up over 40% on average since the lows in March 2009 (The Dow Jones Industrial Average was about 6,500 in March 09; it is now about 9,500) is taken to be a forecast that real future economic recovery is on the horizon. But is the market a reliable forecaster of anything? That is, from the perspective of real industry and strategic foresight professionals, using hard-won, battle-tested approaches to anticipating future outcomes, should we factor the market’s direction into our expectations of the economic future?
DJIA since Sept '08
The answer is, broadly, yes. Stocks are shares in the future earnings of a company. They are therefore a “bet” on (er, an “investment” in) the future performance of a company, or many companies. The trading price on any day is the price at which there are as many buyers as sellers for these future returns. Rising prices mean there are more buyers than sellers, that means general expectation of future profits is going up. Investors are putting a higher price on the future.
The market is therefore considered a leading indicator of economic conditions. (By contrast, employment figures are lagging indicators — due frictional forces, not to mention morality, it takes companies a while to downsize in recessions or upscale in booms, so employment levels track economic conditions but with a delay.)
But how valid and dependable is the market as a leading indicator? It is also apparent that markets move up slowly and steadily, but fall in a hurry. So the downward move can hardly be held to be predictive. But the upward move appears to hold some weight as harbinger of better times. How much weight?
What’s particularly important is that the aggregate insight into future returns from shareholding investments — across many investors and many stocks — cancels out individual errors. Any one person may have a dumb idea of the ‘future cash flows’ from one or many companies, and the price of any one company may be unreliable for innumerable reasons, including fraud, but the knowledge and intelligence of hundreds of thousands of people, when aggregated and spread over many thousands of stocks, corrects for all these errors. It becomes robust.
Prediction Markets
This reliability of shared, aggregated insight — the wisdom of crowds — is precisely what makes ‘prediction markets’ such a powerful forecasting tool, as I have mentioned in previous posts. (Prediction markets apply market-like wisdom to create foresight in areas that are not normally ‘tradeable.’) Any one person will, as likely as not, get it wrong, but everyone together, rather astoundingly, get it right.
Ironically, crowd wisdom is much more reliable than the technical forecasting models that investment institutions use to try to determine how business, macroeconomic, interest rate, or other conditions will affect future stock prices. These predictions, based on the assumptions of a handful of model programmers and/or model users, are deeply vulnerable because there is no crowd-wisdom balance. It’s no better than reading tea leaves, only apparently (and unaccountably) more respectable.
Having said all this, it is well known that the ‘crowd,’ aka the ‘herd’ can and do all get it wrong together. This is what happens in price bubbles, or panic market exits, with everyone buying or selling because they are making the same wrong assumptions, or just doing what everyone else appears to be doing. (Most players making the same mistake together is the basic problem when prediction markets fail too.)
However, what is clear is this case is there was a very hard sell-off in the months prior to March 09, following revelations of the gravity of the Credit Crunch, but that this has slide has been arrested and mostly reversed. This says that innumerable smart people with, collectively, billions of dollars at stake, are expecting future profits higher than they did in March. That’s a prediction one can rely on.
read more