The most frequently cited result in the entire research literature on overconfidence comes from a 1981 paper published by the Swedish psychologist Ola Svenson.(1) Svenson asked people in the United States and in Sweden how they thought their driving abilities stacked up against other drivers. Most scholars cite Svenson’s result as showing that the majority of people think that they are better drivers than average. But that wouldn’t be impressive because it might be entirely possible for everyone to be better than average.

As the leggy scholar Shane Frederick has pointed out, for instance, more than 99 percent of the population boasts more legs than average. In a skewed distribution, a few low numbers can pull the average down so that the majority of people are above it. As with leg counts, it is plausible to think that most drivers are adequately skillful, but there are a few drivers in the habit of texting in between bites of lunch and touching up their hair while they inspect themselves in the mirror. Most of us better than those maniacs.

What’s interesting about the popular misrepresentation of Svenson’s result is that what he did was more impressive than showing that the majority think they are above average.  What Svenson actually did was to ask people to place themselves in one of ten deciles with respect to their driving safety and skill. A respondent who thought she was among the 10 percent of most skillful drivers should place herself in the top decile. Ranked on a percentile scale like this, it is, in fact, statistically impossible for the majority of people to be in the top 5 deciles. The median (which splits the top from the bottom 5 deciles) exactly divides the population into two equally-sized halves. Yet Svenson found that 93 percent of Americans in his sample claimed to be more skillful than the median driver. The Swedes were not quite so recklessly overconfident—only 68 percent of them believed they were more skillful than the median.

So what exactly were Svenson’s respondents telling him? Was their claim to being better than other drivers an honest reflection of beliefs that would also lead these drivers to decline the purchase of insurance, knowing that their greater skill decreased their risk of getting in an accident? Or was it more a strategic act, like telling the person interviewing you that you think have what it takes to succeed at the job, or telling your kid’s teacher that you think they belong in the gifted program?

There are at least three possible explanations for Svenson’s result. The first is that what they were doing was trying to impress him or make themselves look good by asserting their skill. If this were the case, then paying people for their accuracy should ameliorate their overconfidence. After all, if I expected to get $1 million prize for accurately estimating my percentile ranking on a driver’s test, I would do my darndest to accurately estimate my ranking. But it seems unlikely that Svenson’s respondents were just showing off to impress him. I don’t mean to insult Svenson or anything, but boasting on a survey about your enormous driving talents is like boasting to a census-taker about how many people live in your house—it is not clear that your boast gets you anything or that they really ought to be impressed. Personally, I am skeptical that impressing others is a powerful motive in this instance. When other researchers have attempted to motivate respondents to answer accurately by paying them more for accuracy, it does not come close to eliminating overplacement.(2, 3)

A second possible explanation for Svenson’s result is that different drivers have different definitions of skill.  It is possible that some drivers think skill is reflected in being able to drive while texting, eating, and resolving squabbles between children in the back seat. Whereas others may believe they are skillful because they drive so carefully that they never exceed 30 miles per hour. If everyone agreed what it meant to be a skillful driver and had a good sense of their own and others’ skill, then exactly 50% should rate themselves above the median. On the other hand, if every person had his or her own idiosyncratic definition of what it meant to be a good driver, then all drivers could rate themselves as the best, and all of them could be right. There is good evidence that this ambiguity accounts for a good deal of “better-than-average” effects like Svenson’s drivers.(4)

This result also speaks against the third explanation: that drivers are simply fooling themselves about how skilled they are. Self-delusion may be the most commonly cited explanation for better-than-average beliefs. But if that’s the main reason for it, then overplacement should be greatest for things that people regard as important. After all, I don’t get as much out of believing that I am the best flagpole-climber than I do out of believing that I am the smartest or most virtuous.

I have been working for several years with my colleagues Jenn Logg and Uriel Haran to test this hypothesis.(5) Mostly, we have failed to find much supportive evidence of self-delusion. After searching long enough and hard enough we have found some evidence of self-delusion. But the effect is limited and the conditions have to be just right to get it. We do find that the more important something is, the more people claim to be better than others, but only when the skill and its measurement are left vague. To pick a particular example, lots of people will claim to be more intelligent than others, but overplacement decreases substantially when those same people estimate their percentile ranks on an IQ test they all took.(6) This suggests that “better-than-average” beliefs are strongest when people can “get away” with employing an idiosyncratic definition of what it means to be good at something.

So if you want to reduce bias and the risk of you or others deluding themselves, be clear about what you are assessing and how you are measuring it. Do not content yourself with vague assessments of intelligence or driving ability; instead, examine scores on tests, problems solved, and accident records. Quantify your assessments using clear criteria and probabilities. And keep score. It will help keep you humble and help keep you honest.

References

1. O. Svenson, Are we less risky and more skillful than our fellow drivers? Acta Psychol. (Amst). 47, 143–151 (1981).
2. E. F. Williams, T. Gilovich, Do people really believe they are above average? J. Exp. Soc. Psychol. 44, 1121–1128 (2008).
3. E. Hoelzl, A. Rustichini, Overconfident: Do you put your money on it? Econ. J. 115, 305–318 (2005).
4. E. van den Steen, Rational overoptimism (and other biases). Am. Econ. Rev. 94, 1141–1151 (2004).
5. J. M. Logg, D. A. Moore, U. Haran, Is overconfidence a motivated bias? Experimental evidence. Unpubl. Manuscr. (2018).
6. M. M. Roy, M. J. Liersch, I am a better driver than you think: examining self-enhancement for driving ability. J. Appl. Soc. Psychol. 43, 1648–1659 (2013).