Survivorship bias

Survivorship Bias

Survivorship bias is a logical error that focuses on things that *succeeded* in a particular process, overlooking those that did *not*. This leads to a skewed and often overly optimistic view of the situation, as it ignores the failures that are crucial for a complete understanding. It’s a pervasive cognitive bias impacting fields as diverse as finance, history, medicine, and even everyday decision-making. This article will delve into the concept of survivorship bias, its implications, and how to mitigate its effects, especially within the context of Technical Analysis.

Understanding the Core Concept

At its heart, survivorship bias arises because failures are often hidden or less visible. Think of it this way: you only hear about the successful startups, the winning lottery tickets, or the long-lived individuals. You rarely hear about the vast majority that failed, didn't win, or passed away prematurely. This incomplete data set creates a distorted perception of reality.

The classic example used to illustrate survivorship bias dates back to World War II. The Statistical Analysis section of the Allied forces was tasked with reinforcing bomber planes. They examined planes returning from missions, noting the areas where they had been hit by enemy fire. The intention was to add armor to the areas that showed the most damage. However, statistician Abraham Wald recognized a crucial flaw in this reasoning.

The planes they were examining were the *survivors* – those that had made it back. The areas *not* showing damage were likely the critical areas. If a plane was hit in one of those areas, it didn’t return to be studied; it was shot down. Therefore, reinforcing the areas that *didn’t* show damage would actually increase the planes’ survivability. This is a powerful illustration of how focusing solely on survivors can lead to incorrect conclusions.

Survivorship Bias in Finance and Investing

The financial world is particularly susceptible to survivorship bias. Here are several key areas where it manifests:

Mutual Fund Performance: The most prominent example is in the evaluation of Mutual Funds. Fund databases often only include funds that are currently active. Funds that have performed poorly and subsequently been merged or liquidated are removed from the dataset. This creates a bias towards higher-performing funds, making the overall average performance appear better than it actually is. Investors using past performance as a guide to future returns are thus misled. This is particularly relevant when analyzing Long-Term Investing strategies.
Hedge Fund Indices: Similar to mutual funds, hedge fund indices often suffer from survivorship bias. Underperforming hedge funds often close down, and are then removed from the index, artificially inflating the average returns of the remaining funds. This impacts the perception of Alternative Investments.
Backtesting Trading Strategies: When backtesting a Trading Strategy, it's crucial to account for all possible outcomes, including those that would have led to the strategy being abandoned. Many backtests only consider hypothetical continuation of the strategy, ignoring the reality that a losing streak would likely have caused a trader to stop using it. This can lead to overestimation of the strategy’s profitability. Careful Risk Management is essential when backtesting.
Company Analysis: Looking at currently successful companies and attempting to identify the "keys to success" can be misleading. For every successful company, there are countless failed ones that attempted similar strategies. Ignoring these failures leads to a biased understanding of what truly drives success. Fundamental Analysis must consider both successes and failures.
Stock Market Indices: Indices like the S&P 500 are constantly adjusted. Companies that go bankrupt or are acquired are removed and replaced with new ones. This "dynamic survivorship" means the index only reflects the performance of companies that have survived and thrived, excluding those that have failed. This impacts Index Investing strategies.
Venture Capital: Venture capitalists are aware of survivorship bias. A small number of investments often generate the majority of returns, while many others fail. The reported success rates of venture capital funds are often inflated because they only highlight the winners. A comprehensive understanding of Portfolio Diversification is vital.

Identifying and Mitigating Survivorship Bias

Recognizing the potential for survivorship bias is the first step in mitigating its effects. Here are some strategies:

Seek Complete Data: When evaluating performance, strive to include data for all entities that existed at the beginning of the period, regardless of their current status. In the case of fund performance, look for databases that track the historical performance of *all* funds, including those that have been liquidated or merged.
Consider the "Graveyard": Actively search for information about failures. In the context of startups, investigate why companies failed. In finance, look for data on closed hedge funds or liquidated mutual funds. This provides a more balanced perspective. A review of Market Crashes can reveal patterns of failure.
Adjust Backtesting: When backtesting trading strategies, incorporate rules for abandoning the strategy if it experiences significant losses. This simulates real-world trading conditions more accurately. Employ a robust Position Sizing strategy.
Be Skeptical of Success Stories: Question the narratives surrounding successful outcomes. Ask yourself what factors contributed to the success, and whether those factors are truly unique or simply a matter of luck. Consider the potential for Confirmation Bias in interpreting success stories.
Look for Counterexamples: Actively seek out examples that contradict the prevailing narrative. If everyone is talking about a particular investment strategy, look for evidence of strategies that have failed.
Understand the Time Horizon: Survivorship bias is more pronounced over longer time horizons. The longer the period being considered, the more opportunities there are for entities to fail and be removed from the dataset.
Focus on Risk-Adjusted Returns: Evaluate performance based on risk-adjusted returns, rather than simply absolute returns. This helps to account for the fact that higher returns often come with higher risk. Sharpe Ratio is a useful metric.
Apply Statistical Rigor: Employ statistical techniques to assess the significance of observed results. Avoid drawing conclusions based on small sample sizes or anecdotal evidence. Familiarize yourself with Regression Analysis.
Consider Different Data Sources: Don’t rely on a single source of information. Cross-reference data from multiple sources to verify its accuracy and completeness. Utilize Economic Indicators for broader context.
Beware of "Data Mining" Bias: This is closely related to survivorship bias. Data mining involves searching for patterns in data without a pre-defined hypothesis. This can lead to the identification of spurious correlations that are not actually meaningful. Be cautious of False Signals.

Survivorship Bias and Technical Analysis Indicators

Many Technical Indicators are susceptible to survivorship bias when applied to historical data. For example:

Moving Averages: If a stock has experienced a significant decline and then recovered, the moving average may appear to be a more effective indicator than it actually is, as it doesn’t reflect the period of decline.
Trend Lines: Drawing trend lines on a chart can be subjective, and the choice of where to draw the line can be influenced by the desire to identify a trend that confirms a pre-existing belief. This is exacerbated by survivorship bias, as analysts tend to focus on charts of companies that have survived and thrived.
Fibonacci Retracements: The levels identified by Fibonacci retracements are often chosen retrospectively, based on the observed price movements. This can create the illusion that the indicator is more accurate than it actually is.
Bollinger Bands: The width of Bollinger Bands is based on the standard deviation of price movements. If a stock has experienced a period of low volatility followed by a period of high volatility, the bands may appear to be more effective at identifying breakouts than they actually are.
Relative Strength Index (RSI): RSI can be affected by survivorship bias if it's applied to a limited set of stocks that have survived a market downturn. The RSI values may appear to be more reliable than they actually are, as they don’t reflect the performance of stocks that have gone bankrupt. Understanding Overbought and Oversold Conditions is crucial.
MACD (Moving Average Convergence Divergence): Similar to RSI, MACD can be influenced by survivorship bias when analyzing historical data of surviving companies.

To mitigate this, when using technical indicators, always:

Use Long-Term Data: Analyze data spanning a considerable period, including periods of market stress and economic downturns.
Test on Multiple Assets: Apply the indicator to a diverse range of assets, not just the current market leaders.
Combine with Other Indicators: Don't rely on a single indicator. Use a combination of indicators to confirm signals and reduce the risk of false positives. Explore Candlestick Patterns.
Consider Fundamental Factors: Don’t ignore fundamental analysis. Technical indicators should be used in conjunction with an understanding of the underlying business and economic conditions.

Conclusion

Survivorship bias is a subtle but powerful cognitive bias that can lead to flawed decision-making in a wide range of fields. By understanding the nature of this bias and implementing strategies to mitigate its effects, we can improve our ability to make informed judgments and avoid costly mistakes. In the world of finance and investing, recognizing and accounting for survivorship bias is essential for achieving long-term success. A commitment to Continuous Learning and critical thinking is paramount.

Risk Assessment Trading Psychology Market Sentiment Value Investing Growth Investing Day Trading Swing Trading Algorithmic Trading Quantitative Analysis Portfolio Management

Start Trading Now

Sign up at IQ Option (Minimum deposit $10) Open an account at Pocket Option (Minimum deposit $5)

Join Our Community

Subscribe to our Telegram channel @strategybin to receive: ✓ Daily trading signals ✓ Exclusive strategy analysis ✓ Market trend alerts ✓ Educational materials for beginners