Archive for the 'risk management' Category

Nov 24 2009

The turkey problem in trend work: is your prediction robust to Thanksgiving?

We owe a debt to Nassim Taleb for memorably encapsulating the demerits of predicting by extrapolating trends as “The Turkey Problem,” and now seems the moment to reiterate it:

Imagine you are a turkey. Every day someone comes to feed you. Every day you get bigger. Your portion sizes get bigger too, brought by a nice man at regular intervals. You extrapolate the trend and you confidently predict a bigger you, with more to eat. Regularly too.

But what happens is … Thanksgiving. Or Christmas

Taleb, N., The Fourth Quadrant: a Map of the Limits of Statistics, Edge Foundation, September 2008

Taleb, N., The Fourth Quadrant: a Map of the Limits of Statistics, Edge Foundation, September 2008

The hard reality for those who predict the future by extrapolating trends (and those gullible enough to believe them) is that even if our turkey had excellent data points (carefully observed and accurately recorded in, for example, a time series analysis) and, moreover, even if our turkey was a mathematically sophisticated — not merely simply projecting trends, but applying all the latest modeling techniques, from moving averages to compound regression — he is still going to be wrong about the future. Dead wrong.

All the data analysis in the world, all the fancy computer software, all the consulting time paid for, and he is still a dead duck.

Ouch. The lesson: there may be (or, vexingly, may not be) something outside the trend, a framing condition, which where it does exist is invisible within the trend projector’s mental model. The only way to get a view of the future that is “robust to Thanksgiving” is (a) to question assumed framing conditions, for example through properly done scenarios, and (b) to hold a view of the future which assumes fundamental ‘game-changing’ surprises can and will occur.

If, as they say, “the trend is your friend” it is assuredly only your fair-weather friend.

Post to Twitter Tweet This Post

No responses yet

Nov 12 2009

Risk assessment, first base on the way to industry foresight

I’m pleased to have been invited to be one of a dozen or so regular contributors to the blog ‘Risk Matters,’ because, well, risk matters. It’s a key part of the reason why anyone or any group would look to the future… which of course also conditions how we look, what we look for, and what we find or miss.

So this stimulates me to put down a few thoughts about risk assessment and its relationship with industry and strategic foresight as a whole. This is a big topic of course, but seeing as the categories are confused a lot, it’s worth tackling even if just in summary terms.

When I reach the topic of Risk Assessment in my ‘Industry Foresight and Business Future Strategy’ MBA elective, I use the ‘Adidas-Salomon: Incorporating Risk into Corporate Strategy’ mini-case [Ref: ICFAI 304-141-1; sourced via Cranfield’s Case Clearing house.]

The case is a useful baseline in risk assessment because it describes the various risks a multinational company typically faces: marketing risks (market change, brand image); operations risks (quality; reliability of processes and suppliers); social & environmental risks (workforce & natural resources compliance); legal (liability, regulation, patent); information technology (compromise or disruption); and financial risks (currency, interest rate, credit).

Business disruptors
In sum these are the things that could damage or disrupt the business. Isolating such factors, keeping vigilance over them, and having thought through or enacted counter-measures in advance, allows the organization to better control or reduce the impact should risk become reality.

All risks are future events, so a risk assessment is undoubtedly a future study, but assuming a company looks diligently across all these categories for potential and emerging hazards, how prepared is it for a changing world? What kind of industry foresight does this give managers? Is a risk assessment a futures assessment?

The obvious first answer is that a risk assessment is only half the equation. It’s oriented to the downside potential of changes not the upside; looking for threats not opportunities. Obviously that means that opportunities are less likely to be identified.

The second thing is that a standard risk assessment operates in the realm of known risks, in known categories, that may cause disruption and damage in a known way. It doesn’t have the mechanism to expand conceptions of what could go wrong, or how it could go wrong, or what the full knock-on effects will be. The types of mental-model-expanding techniques that fuller foresight offers are not built into a typical risk assessment.

Strategy questions
Third, risk assessments never really broach the question: is the business idea or business model good and will it keep on being good? That is, what products or services will be appropriate going forward, or how will models of supply or manufacture or marketing or fulfillment need to change, due to technology change or shifting consumer preferences.

In other words, risk assessment doesn’t ask strategic questions of managers. It is part of the day-to-day management vigilance necessary with reference to the future – the hygiene factors in running an organization. It is about keeping the business going as is, not about changing it for a changing word.

There’s nothing wrong with this. The point is, it’s just ‘first base’ in building a quality view of the future, and therein a robust point-of-view about what to do next. Although no doubt companies such as Google or Apple or Virgin, etc., assess and mitigate their risks, they didn’t become successful in their future by doing risk assessment and saying ‘That’s it, were done. We’re ready for the future.”

Post to Twitter Tweet This Post

No responses yet

Oct 29 2009

Unexpected prediction modesty highlights problems of timing and impact

Continuing the theme of financial types talking to each other about predictions and predictability, this ‘Tea with the Economist’ interview of Stephen Roach, Chairman, Morgan Stanley Asia by Economist New York Bureau Chief Mathew Birk, carries interesting lessons about the limits of prediction.


Birk commends Roach for being one of the few to have predicted the Credit Crunch problems, to which Roach demurs in saying he was “too early”. He then furthers his modesty in saying that the “breakage” in the financial system was “in excess of anything I envisioned.”

Self-deprecation in assessing one’s predictive abilities will endear anyone to me. Even Roach, who later in the interview burns this hard-won credibility by laying the blame for the credit crunch at the door of regulators, forgetting how hard financial institutions lobbied regulators for greater freedoms in the 1990s.

But I digress. The predictive issues the interview raises are as follows. Issue one: it’s not enough (as any stock short-seller will confirm) to get the direction of a future change right. One must get the timing right too. Issue two: it’s not enough to anticipate a change. One must be able to judge it’s impact. Getting either timing or impact wrong is effectively to have missed the future.

.

Probability

On the latter topic — the problem of impact — Nassim Taleb is unrelenting, and he is right. Analysts routinely mix up probability and impact. They think that because an event has a low probability (‘it would be a 10-sigma event!’) it can be marginalized in the predictive number crunching. Of course, it can’t. The low-probability of a wildcard or black swan event is irrelevant because when it happens it will change the game, and that’s why, in every predictive situation of reasonable complexity and uncertainty, using statistical extrapolations (regressions and so on) to predict, is to dangerously paper over the cracks. It is precisely the cracks that businesses and policy makers need to worry about.

Determining the direction of change is hard enough. Assessing timing or extent of impact — a ‘total future impact index’ — is wickedly difficult. It’s a task not to be underestimated, and to simply extrapolate current trends (= assuming the trend’s timeline and impact stay the same as in the past) is the royal road to underestimating it.

This is the reason foresight for complex, uncertain, changing situations can only be grasped by NOT predicting (quantitatively or otherwise) but by exploring the limit-conditions of the plausible (What would happen if the timing of the change accelerated, or was significantly delayed? What if  the impact was 10x or one tenth of what we expect? And so on.)

.

Post to Twitter Tweet This Post

No responses yet

Jun 24 2009

Peter L. Bernstein on risk; and how risk management fits into foresight as a whole

Peter Bernstein, the author of “Against the Gods: The Remarkable Story of Risk,” died recently at the age of 90. In memoriam McKinsey Quarterly reposted this recent Bernstein interview. I put it up here because it’s a timely and timeless lesson in thinking about uncertainty and threats, and avoiding simplistic (quantitative) approaches to managing them – one of core themes of “Future Savvy.” Bernstein offers and endorsement of real options and explains why sophisticated Long Term Capital Management (LTCM) mathematical models to control risk created “a math dependency” that was blind to, among other things, unexpected systemic feedback to its own emergence:


One of the first things Bernstein says is that risk implies that we don’t know what will happen, which could be good things happening too. Risk management, as it is currently understood, gets executives to look at what could go wrong in the uncertain future of the enterprise. (Somehow threats are easier than opportunties to get departmental budget for.) The standard approach is to break risks down into commonly understood threat categories: a typical analysis would illuminated risks posed by technology failure, communications failure, security failure, natural disasters, accidents, or market/reputation risk, liability risk, financial/credit risk, and so on. This negative-outcome identification is typically followed by strategies to monitor, minimize, or control the risk event or its impact.

Doing all this is great, BUT it is just a narrow part of enterprise and industry foresight. Why? First, industry foresight or futures studies for business is focused as much on the opportunities change offers as on threats. Second, foresight tools (when correctly applied) set themselves the task of enlarging perspectives or mental maps so that we can see more things, or more possibilities than the generally expected set (whether good or bad). Set against this, risk management is little more than the catalog of known threats. The unknown or poorly understood threat, or unseen opportunity missed (and grabbed by others) is likely to be more damaging to the enterprise.

Post to Twitter Tweet This Post

No responses yet

Feb 26 2009

Sir Fred Goodwin and the Imperative for Looking Long and Rewarding Longer

Publication of the Institute for the Future’s “Map of Future Forces Affecting Sustainability” on the same day that it is revealed that Sir Fred Goodwin (50) of failed & baled Royal Bank of Scotland (RBS) will get a £693,000 (about $1,000,000) a year payment for the rest of his life, gets me thinking about short-termism and its entrenchment.

iftf sustainability Sir Fred Goodwin and the Imperative for Looking Long and Rewarding Longer

The IFTF’s full map is available for download here.  Quick aside: these maps, putting complex forces into visuals, have defined IFTF’s public (and client, one presumes) communications for over five years, and have raised the bar of excellence in the foresight communications. The company has produced many such outstanding maps, some publicly available.

The new map and Sir Fred-gate are unrelated of course. But here was the connection for me: The IFTF map lists six “Key Driving Forces” (2007-2017) in the area of sustainability, and the first is:
“An Imperative for Looking Long: The 21st century will test our ability to grasp the future impacts of present choices, but even as we struggle to incorporate future knowledge into our day-to-day decisions, we’re tuning up our bodies and minds and even our cultural frameworks for a much longer view.”

My question is, “really?” Is the long view really a driver – something that will drive change and shape the future? Or do we hope it is. Are we trying to talk it into being?

No question that the long-term view is crucial. Solving just about any social, technological, or environmental problem requires sustained long-term action. And everyone who works in foresight keeps evangelizing long-termism. But, in fact, what we have in industry and government is rampant short-termism and there is no indication this will change, despite the crisis and many heartfelt calls.

Linking big to long

The problem with Sir Goodwin’s package (in career and in retirement) is that the reward numbers were based on short-term company returns. “Hey, we made lots of money this year, so you get a big bonus, and you get a big bonus,” etc. But a few years down the line  – in the long term – it turns out that no bonuses were valid (if a bonus is, truly, a reward for success).

Put it another way: in finance, as in other aspects of society, technology, and the environment, we don’t know if we’ve succeeded or failed until the long-term numbers are in. Few would have a problem with handsome rewards for a valuable job well done, but those rewards must surely be delayed, and delayed, until we are in command of the long view of the performance.

Easy in theory, hard in practice. Perhaps impossible in practice when most politicians and legislators are themselves on a short 3-7 year cycle, like CEOs. I have some inkling from the IFTF map that the thinking is that life-extending technologies will improve to the point where people will really see themselves in for the long haul, and so adopt a longer perspective on benefits and rewards.

Time on the clock

Perhaps. But, life-technologies aside, plenty of decision-makers – Goodwin included – still have a lot of time left on the clock and that doesn’t appear to stop them chasing and cashing in short-term incentives at the expense of the future. Or legislators (and the public who votes them in) structuring performance rating on our immediate perception of their performance.

What we have, and what we have increasingly had (the trend) over the past few decades, is systemic short-termism. Winning in the next annual report or the next election is what what leaders’ rewards are based on. Incentives for politicians or business leaders or even scientists or engineers to make a better world for 2025 or 2050 are negligable.

Until there is reason to anticipate that this fundamental underlying short-term incentive structure and mentality changes (that is – convince me – who will change it and how?) the future savvy perspective must say that the “long-term imperative” remains a nice sound-bite, but not a material driver of anything.

Post to Twitter Tweet This Post

2 responses so far

Jan 30 2009

Hello Davos: all crises of the present are foresight failures of the past

All crises of the present can be viewed as a failure of foresight or planning at some previous point, and the current global economic crisis is no different.

The mood is justly sombre at the World Economic Forum’s Davos meeting this year, as grim-faced world leaders mull over the dismal state of the global economy and how to fix it. This is in marked contrast to recent years, when the top executives were warmly congratulating themselves on the general staworld economic forum logo Hello Davos: all crises of the present are foresight failures of the pastte of things.

In one sense this is perfectly understandable. The crisis is upon us and leaders should be directly and practically involved in tackling it. On another level it’s profoundly disturbing, because world leaders and senior managers should be doing more than merely responding to situations. When crises occur, crisis management becomes part of a leader’s job, but their real job is thinking ahead effectively to avoid crises and, on the positive side, develop opportunities.

Put another way: the heads of a companies or countries – Davos-level people – are tasked far beyond effective daily management. They are tasked, fundamentally, with negotiating the VUCA (volatile, uncertain, complex, ambiguous) world on behalf of the rest of us. If not them, then who?

This requires foresight and vision. In this sense, many who are at Davos this week are responsible for the current crisis. They failed to foresee it, in fact they generally endorsed the growth of complex financial instruments, the shadow banking system, and private equity growth –- much of which bypassed SEC or equivalent regulation, and which is now seen to be the root cause of the meltdown.

In fact much of the “new finance” system was thought to spread and therefore actually lower risk. Turns out that was a poor view of the future. In fact the present situation as a whole is the result of key decision-makers operating on a poor view of future. As a group, their mental model was not open to bad outcomes, or even just alternative outcomes to what was commonly expected.


Could we have thunk it?

Their response might be: “nobody can predict the future!” “Easy to say after the event!” This is true. But it’s common knowledge that there were those who foresaw the mess — The Times identified at least 10. As Davos attendees might now be forced to agree, some forecasts are clearly better than others.

This is where executive leaders can learn from the foresight field and particularly the history of failed predictions. Everyone relies on predictions for their guide to the future – nobody can be an expert in every field. And there’s never a shortage of them – they are frequently published in the media, offered by consultancies and think tanks, and are a key part of Davos.

While getting a prediction is easy, the key leadership skill is to be able to tell a good one from a bad one: that’s what turns a forecast into a strategic resource. That is what leads to better decisions, better plans, and better actions.

Can one do that? Can one critically assess a particular or consensus-held view of the future, to identify its strengths and weaknesses? Absolutely yes. Among the tests one can run on a prediction are:

•    assessing motivation – who is speaking and what their agenda might be, particularly if they have an interest in maintaining a current system or shaping the emergence of a new one
•    determining whether the tools used are appropriate to the level and type of uncertainty faced. High-uncertainty situations and long-term views require different approaches to standard modeling
•    questioning consensus mental-models and forcing consideration of alternative outcomes. All foresight is swayed by “zeitgeist” – spirit of the times – and good forecasts swim against this tide.

These are just a few among the many forecast tests one can run, as detailed in Future Savvy.  But even if Davos attendees had been applying just these three in previous years, their foresight would have been greatly improved. It won’t help with this crisis, but it might forestall the next.

* This article, authored by Adam Gordon, was first edited and published by Bnet.co.uk

Post to Twitter Tweet This Post

2 responses so far

Twitter links powered by Tweet This v1.6.1, a WordPress plugin for Twitter.