Irrational Exuberance: Shiller's Guide to Bubbles

Robert Shiller's Irrational Exuberance is one of the most important books ever written about stock market bubbles. Originally published in 2000 - just before the dot-com crash - and updated in subsequent editions, the book explains why stock markets periodically become wildly overvalued. Shiller, a Nobel laureate in Economics, argues that narratives and investor psychology drive valuations far more than most investors realise. His key contribution, the Cyclically Adjusted Price-to-Earnings (CAPE) ratio, gives investors a way to assess whether markets are expensive or cheap relative to history.

How Narratives Drive Market Bubbles

Shiller argues that stock market bubbles are driven by more than economic fundamentals. They are fuelled by narratives - stories that capture the public's imagination and lead to widespread investor enthusiasm. These narratives can be about technological innovation, economic growth, or political stability.

The dot-com bubble of the late 1990s is the classic example. The narrative of the "new economy" convinced investors that traditional valuation metrics no longer applied. Companies with no earnings and no clear path to profitability reached valuations of tens of billions of dollars. When the narrative collapsed, the Nasdaq fell roughly 78% from its March 2000 peak.

In the UK, similar dynamics have played out with tech stocks, cryptocurrency hype, and even certain IPOs that capture media attention. Shiller warns that when a narrative becomes dominant, it creates a feedback loop: rising prices reinforce the story, which attracts more buyers, which pushes prices higher still. UK investors using ISAs or SIPPs should be especially cautious about chasing these stories without examining the underlying fundamentals.

What Is the CAPE Ratio and Why Does It Matter?

One of Shiller's most significant contributions is the CAPE ratio (also called the Shiller P/E). Unlike the traditional price-to-earnings (P/E) ratio, which uses just one year of earnings, the CAPE ratio averages inflation-adjusted earnings over the past ten years. This smooths out the cyclical ups and downs of corporate profits and gives a more stable picture of whether the market is cheap or expensive.

Shiller's research shows that high CAPE ratios have historically been followed by lower long-term returns. When the US CAPE ratio hit 44 in late 1999, the subsequent decade delivered negative real returns for the S&P 500. When the CAPE was below 15, subsequent 10-year returns were consistently strong. You can track the current Shiller CAPE ratio on his Yale data page.

For UK investors planning for retirement or other long-term goals, the CAPE ratio provides a reality check. It does not predict short-term market moves, but it gives a useful signal about the returns you are likely to earn over the next decade if you buy at current prices.

The Feedback Loop: How Bubbles Inflate and Burst

Shiller describes a specific mechanism that inflates bubbles. It works like this:

1. A plausible narrative emerges (new technology, deregulation, a new economic era)
2. Early investors profit, which seems to validate the narrative
3. Media coverage amplifies the story, attracting more investors
4. Rising prices are treated as proof that the narrative is correct
5. Sceptics are dismissed or ridiculed
6. Prices disconnect from fundamentals
7. A trigger (often minor) breaks the feedback loop and prices collapse

This pattern repeated in the South Sea Bubble of 1720, the 1929 crash, the dot-com bust, and the 2008 housing crisis. Recognising this pattern is the first step to avoiding it. For more historical context on speculative manias, see our review of the history of financial speculation.

How UK Investors Can Apply Shiller's Lessons

Shiller's work offers several practical takeaways for UK investors:

Question dominant narratives. When everyone agrees that a particular sector or asset class can only go up, that is precisely when you should be most cautious. Ask yourself whether the current price is justified by earnings and cash flow, not by the story.

Use the CAPE ratio as a sanity check. Before making large lump-sum investments, check whether the market you are buying into has a historically high or low CAPE. This does not mean timing the market, but it can inform your asset allocation. If UK equities look cheap relative to US equities on a CAPE basis, you might tilt your portfolio accordingly. Our article on adding a value tilt to reduce US tech exposure explores this idea in detail.

Maintain a long-term perspective. Markets are often irrational in the short term, but over 10-20 year periods, valuations tend to revert towards historical averages. This is good news for patient investors who avoid buying at peak euphoria.

Diversify across geographies and asset classes. If one market is in a bubble, others may not be. Holding a globally diversified portfolio within your ISA or SIPP reduces the risk of being caught in a single market's mania.

Write down your investment thesis. When you buy a stock or fund, document why. When the narrative shifts, you can revisit your reasoning rather than reacting emotionally.

Conclusion

Irrational Exuberance by Robert Shiller is essential reading for any investor who wants to understand why markets periodically lose touch with reality. Shiller's analysis of narratives, feedback loops, and the CAPE ratio gives UK investors practical tools to assess whether markets are fairly valued. By questioning dominant stories, using valuation metrics, and maintaining a long-term perspective, you can avoid the worst consequences of market mania.

Frequently Asked Questions

What is Irrational Exuberance about?

Irrational Exuberance by Robert Shiller explains why stock markets periodically become wildly overvalued. Shiller argues that narratives, media feedback loops, and investor psychology drive bubbles, and he introduces the CAPE ratio as a tool for assessing whether markets are expensive relative to history.

What is the CAPE ratio?

The CAPE ratio (Cyclically Adjusted Price-to-Earnings) divides the current price of a stock market index by the average of ten years of inflation-adjusted earnings. It smooths out short-term earnings volatility and gives a more stable picture of whether the market is cheap or expensive. High CAPE readings have historically predicted lower returns over the following decade.

How can the CAPE ratio help UK investors?

UK investors can use the CAPE ratio to compare valuations across different markets. If US equities have a CAPE of 35 and UK equities have a CAPE of 14, this suggests UK stocks offer better long-term value. It is not a timing tool, but it helps with asset allocation decisions within an ISA or SIPP.

What causes a stock market bubble?

According to Shiller, bubbles form when a plausible narrative attracts investors, rising prices seem to validate the story, media coverage amplifies enthusiasm, and a feedback loop drives prices far above what fundamentals justify. The bubble bursts when something breaks the narrative and investors rush to sell.

Is Irrational Exuberance still relevant today?

Yes. The book's framework for understanding bubbles applies to any era. The specific narratives change - AI, cryptocurrency, clean energy - but the psychological mechanisms that inflate and burst bubbles remain the same. Shiller's CAPE ratio continues to be widely used by professional and retail investors alike.

Further Reading:

Devil Take the Hindmost - Edward Chancellor - A gripping history of financial speculation from the 1600s to the modern era, covering the same bubble dynamics Shiller analyses from a historical perspective. (Affiliate link - we may earn a small commission at no extra cost to you.)

A Short History of Financial Euphoria - John Kenneth Galbraith - Galbraith's concise account of recurring financial manias, a perfect complement to Shiller's deeper analysis of why investors keep making the same mistakes. (Affiliate link - we may earn a small commission at no extra cost to you.)

Read Next:

• What Is Speculation?
• Don't Time the Market: Lessons From the Iran Crisis
• Thinking Fast and Slow: How Human Thinking Affects Your Investments
• Predictably Irrational: Hidden Forces Shaping Financial Decisions