On Leadership – Why more information is not always better

Malcolm Gladwell On Leadership - Why more information is not always better
Overconfidence has been proclaimed to be the most prevalent and potentially catastrophic problem in judgment and decision making and has been offered as an explanation for wars, business failures and stock market bubbles. Overconfidence is the psychological phenomenon that when people gain access to more information there is an increase in their level of confidence in their judgments, but not in the actual accuracy of their judgments.

A few months ago I had the pleasure of attending a presentation by Malcolm Gladwell, author of the best-selling books The Tipping Point, Blink and Outliers. He talked about expert failure, the paradox that people make mistakes and misjudgments, not because of incompetence or lack of information, but precisely because they have information. The reason is that with all this information comes overconfidence. As we get more information our level of confidence grows, but our level of accuracy does not always follow suit thus increasing the gap between what we know and what we think we know.

A classical study by the psychologist Stuart Oskamp investigated the obvious assumption that when psychologists accumulate case study material about another person, they naturally come to believe they know that person pretty well. The study examined whether that increase in confidence is justified by a corresponding increase in accuracy of conclusions. Oskamp showed that as psychologists and psychology students got more information their confidence level increased from 33% to 53%, but the accuracy of their judgments (<30%) did not improve.

Back to Malcolm Gladwell who talked about the American Civil War, in particular about the battle at Chancellorsville in 1863, where General Robert E. Lee, leader of the army of the South, and General Joseph Hooker, commander of the Army of the Potomac (the largest Union army), fought one of the biggest battles of the war. The American Civil War was presumably a turning point in the history of warfare due to its widespread use of and methodical approach to intelligence. General Hooker established a bureau of military information and is said to be the first general to do organized military intelligence. This led Hooker to have a lot of information about the enemy: positions, numbers, troop movements… you name it. He knew maybe even more about Lee’s army than Lee knew.

And the more information Hooker got, the more confident he felt. In fact he became certain he would win with the overwhelming amount of information about the battlefield and his opponent. Only thing: As he got more information, it did not necessarily make him a better decision-maker, because that overwhelming information did not improve his accuracy or leadership. Hooker got repeated intelligence on how General Lee’s troops were moving, and he believed that they were on retreat. But in reality it turned out they were preparing a flank attack. Three days of fighting ended in Union retreat.

Overconfidence comes in fact from two sources: Miscalibration and better-than-average-effect.

Miscalibration is for example seen in empirical studies when participants are asked to answer questions with two choices, and then asked to state the probability that their answer is correct. An example could be:

Who was born first, Charles Darwin or Charles Dickens?
How sure are you in terms of probability that your answer is correct?

The usual finding is that the proportion of correct answers is lower than the assigned probability. Bigger biases are found in studies where questions are to be answered with interval estimates (lower and upper bound), such as the length of the river Nile or future stock prices.

Another facet of overconfidence is the better-than-average-effect. What question to better exemplify this than:

Consider your driving skills. Do you think that you have above-average skills compared to the other people in this room?

I am sure both of us have excellent driving skills. If we try to exhibit a reasonable amount of self-criticism we may admit we may not be the best, but FOR SURE we are better than average. The problem is that everybody tends to say so. In a study, 82% of a group of students ranked themselves among the 30% of drivers with the highest driving safety. We tend to have an unrealistically positive view of ourselves. Numerous studies have shown that we often judge ourselves to be better than others with regard to skills or positive personality attributes, such as generosity.

Thus General Hooker’s overconfidence may have come not only from miscalibration but from believing himself and his army to be superior. In fact he said to his troops: “My plans are perfect. May God have mercy on General Lee for I will have none”.

Overconfidence is a problem to take seriously as it can severely impact the lives of millions of people. A US study from June 2001 to March 2011 concluded that financial executives are severely miscalibrated. During this study, more than 13,300 S&P 500 forecasts were collected. US CFOs were – on a quarterly basis – asked to predict one- and 10-year market-wide stock returns within an 80% confidence interval. As it turned out, the realized one-year S&P 500 returns only fell within their 80% confidence intervals 36.3% of the time. Now the occurrence of financial crises is not such a surprise after all. Other studies have shown that overconfident investors underestimate the variance of the value of a risky asset or overestimate their precision. Also they trade more aggressively. The higher the degree of overconfidence is for investors, the higher their trading volume is. Thus, overconfidence can explain bubbles in financial markets.

Overconfidence can lead to suboptimal decisions not only by investors, executives and generals. There is a lot of evidence that miscalibration tends to occur among experts in most fields. As Malcolm Gladwell put it, expert failure is more dangerous than incompetence, because when people lack skills and knowledge it is less likely that they are to be found in powerful positions. Experts on the other hand are the once in charge of banks, armies and countries.

So how do we handle the problem of overconfidence?

Of course it should not lead us to discard information, experts or education. Financial education and financial knowledge has in fact proved to be helpful to reduce biases in trading.

What we need to keep in mind is that making good decisions is not just a matter of having as much information as possible. It is just as much about our ability to turn information into knowledge and knowledge into wisdom. To overcome overconfidence we need to evaluate new information and our own abilities in better and more critical ways. And we need to look beyond the data – at the underlying mechanisms. This is particularly true when we consider diagnosing patients, making investments and going to war.

Information does not float around in free space – it is processed and interpreted by human beings. More information may thus prove invaluable without an increasing awareness and understanding of the human factor.

Itzhak Ben-David et. Al: Managerial Miscalibration, NBER Working Paper No. 16215, 2010 (revised 2013)
Robert W. Kolb: Behavioral Finance: Investors, Corporations, and Markets, Wiley 2010.
Stuart Oskamp: Overconfidence in case-study judgments, Journal of Consulting Psychology, 1965, Vol. 29, No. 3, 261-265

Share small business news, blogs and social media tips with Project Eve's community of small business owners and entrepreneurs today. Our contributors come from a wide range of backgrounds; so whether you are a small business owner, social media strategist, financial adviser, serial entrepreneur, or write an amateur blog we urge you to contribute a blog to our 350,000+ community today. For more information, please refer to our Content Submissions Guidelines.

Add a Blog