Do 24 jams really stop people buying? What happened to choice overload
The idea
On two Saturdays at Draeger’s, an upscale supermarket in Menlo Park, California, the psychologists Sheena Iyengar and Mark Lepper set up a tasting table of Wilkin & Sons jams. Every hour the display switched between 24 flavours and six, with the order of hours counterbalanced across the two days. Anyone who stopped got a coupon for a dollar off a jar.
The larger display drew more people in: 60 percent of the 242 shoppers who passed it stopped, against 40 percent of the 260 who passed the small one. But the coupons told a different story at the till. About 30 percent of those who stopped at the six-jam table later bought a jar; at the 24-jam table it was about 3 percent, four people out of 145. Two more studies in the same 2000 paper pointed the same way: Stanford students offered six essay topics for extra credit were more likely to write the essay than those offered 30, and students choosing from six chocolates reported more satisfaction than those choosing from 30.
The paper launched the idea of choice overloadchoice overload The claim that offering more options can make people less likely to choose anything, or less satisfied with what they pick., the claim that beyond some point, adding options makes people less likely to choose at all, or less happy with what they chose. It became one of the most quoted findings in consumer psychology and was widely repeated in books and business advice.
Why it might change a decision
The finding implies a specific, checkable prediction: cutting a range of options should, under some conditions, increase how often people choose anything, even though fewer options cannot offer a better match. A retailer, a pension scheme or a software menu could test this directly by randomly showing some users a shorter list and measuring completed choices, not just clicks. The later research suggests the answer will depend on how hard the options are to compare, and the original study does not tell you in advance which side of that line a particular case sits on.
How solid is this?
The original jam result rests on a single field study with 249 people who stopped at the table, and only 35 purchases in total. The conditions alternated by hour rather than being randomly assignedrandom assignment Putting each participant into a study condition by chance, so that the groups differ only in what the researchers changed. per shopper, which is a reasonable design for a shop but leaves room for differences between who shops at which hour.
Benjamin Scheibehenne attempted a close replicationreplication Running a study again, independently, to see whether the original result holds up. in an upscale German supermarket and, according to the 2010 meta-analysismeta-analysis A study that pools the results of many earlier studies on the same question to estimate an overall effect and what makes it vary. he co-wrote, found no negative effect of the larger range. That meta-analysis, by Scheibehenne, Rainer Greifeneder and Peter Todd, pooled 63 conditions from 50 published and unpublished experiments with 5,036 participants. The mean effect was about 0.02 on a standardised scale, which they describe as “a mean effect sizeeffect size How large an effect is, as opposed to whether it exists at all. A result can be statistically reliable and still be too small to matter. of virtually zero.” The original jam study, by comparison, comes out at about 0.77 on the same scale. They also found substantial heterogeneityheterogeneity How much the results of different studies on the same question disagree with each other, beyond what chance alone would produce.: the studies disagreed with each other more than chance would predict. Some found overload, some found that more choice helped, many found nothing.
A near-zero average with wide disagreement is a hint that the effect depends on conditions. In 2015 Alexander Chernev, Ulf Böckenholt and Joseph Goodman ran a second meta-analysis, of 99 observations with 7,202 participants, coding each study for features of the task. They report four moderatorsmoderator A condition that changes how strong an effect is, or whether it appears at all. that make overload more likely: complex choice sets, difficult decision tasks, uncertain preferences, and a goal of getting the decision over with. Once these are taken into account, they say, the effect of assortment size is significant, which they present as running against the earlier meta-analytic conclusion.
The two meta-analyses are not as contradictory as they first look. Both agree that “more choice is bad” fails as a general rule. They differ on whether the remaining effect is a dependable phenomenon under identifiable conditions or something closer to noise. The strongest competing explanation for the positive findings is selective reporting: analyses that look for moderators after the fact can find patterns that partly reflect which studies got published. Neither meta-analysis is a preregisteredpreregistered Describes a study whose plan and main analyses were published before the data were collected. test of the moderators, so the 2015 conditions are best read as a well-grounded hypothesis rather than a settled rule.
The popular version, that people offered many options freeze and buy nothing, outruns this evidence. What remains is narrower: in some hard, unfamiliar choices, a large set can reduce choosing, and the size and reliability of that effect are still debated.
Sources
- Iyengar SS, Lepper MR. “When choice is demotivating: Can one desire too much of a good thing?” Journal of Personality and Social Psychology, 2000;79(6):995-1006. https://doi.org/10.1037/0022-3514.79.6.995 (PDF: https://faculty.washington.edu/jdb/345/345%20Articles/Iyengar%20&%20Lepper%20(2000).pdf)
- Scheibehenne B, Greifeneder R, Todd PM. “Can there ever be too many options? A meta-analytic review of choice overload.” Journal of Consumer Research, 2010;37(3):409-425. https://doi.org/10.1086/651235 (PDF: https://abcwest.cogs.indiana.edu/pmwiki/pdf/scheibehenne.options.2010.pdf)
- Chernev A, Böckenholt U, Goodman J. “Choice overload: A conceptual review and meta-analysis.” Journal of Consumer Psychology, 2015, issue 2, pp. 333-358. Abstract: https://www.kellogg.northwestern.edu/academics-research/research/detail/2015/when-product-assortment-leads-to-choice-overload-a-conceptual/