Due Diligence and Selecting Managers — Cases in Tail Risk

Due Diligence and Selecting Managers — Cases in Tail Risk

CAIA Level II Study Guide

What Is It?

1. What is this topic?
   Evaluating hedge fund and private equity managers for hidden tail risks—extreme, low-probability events that can wipe out returns—using due diligence frameworks, stress tests, and behavioral analysis.
2. How is it tested, applied, or used?
   Tested via case studies on manager selection failures (e.g., LTCM, Amaranth). Applied in fund-of-funds due diligence, regulatory audits, and risk committees. Used to avoid blow-ups from leverage, liquidity mismatches, or model risk.

Why Does the Exam Ask This?

CAIA tests this to assess your ability to: - Detect operational red flags (e.g., fraud, style drift, concentration risk) before they manifest as tail events. - Translate qualitative due diligence (e.g., manager interviews, process documentation) into quantitative risk adjustments (e.g., haircuts to expected returns). - Balance Type I vs. Type II errors in manager selection: rejecting good managers (costly) vs. accepting bad ones (catastrophic). - Apply regulatory expectations (e.g., SEC’s "Compliance Rule" 206(4)-7, AIFMD) to due diligence documentation and oversight.

What Do I Need to Know First?

1. Tail risk definitions: Fat tails, VaR vs. CVaR, stress testing.
2. Hedge fund strategies: Directional (e.g., global macro) vs. non-directional (e.g., market-neutral) and their tail-risk profiles.
3. Operational due diligence (ODD): Key areas (e.g., valuation, counterparty risk, IT controls).
4. Behavioral finance: Overconfidence, herding, and how they distort manager risk assessments.
5. Regulatory frameworks: SEC, AIFMD, and UCITS requirements for manager oversight.

Topic Snapshot

This topic sits at the intersection of risk management and manager selection in CAIA Level II. It’s critical because: - 70% of hedge fund failures stem from operational (not investment) risks—often tail events (e.g., Madoff’s fraud, Archegos’ leverage). - Due diligence is the first line of defense against blow-ups, but most allocators focus on past returns (a lagging indicator) over process (a leading indicator). - Regulators now demand documented due diligence (e.g., SEC’s "Compliance Rule" requires annual reviews of service providers).

Exam / Job / Audit Weighting

• Frequency: High (appears in 15–20% of Level II questions, often in case studies).
• Difficulty Rating: Advanced (requires synthesis of qualitative and quantitative analysis).
• Question Type:
• Exam: Case-based MCQs, 5-mark "explain and apply" questions, and scenario-driven due diligence audits.
• Job: Writing due diligence reports, presenting risk findings to investment committees, or auditing a fund’s compliance with AIFMD.
• Audit: Reviewing a fund’s stress-testing methodology or counterparty exposure limits.

Difficulty Level

Advanced

Must-Know Rules, Formulas, Standards, or Principles

1. The "Three Lines of Defense" Model (for due diligence):
2. First line: Manager’s own risk controls (e.g., VaR limits, leverage caps).
3. Second line: Fund-of-funds/consultant due diligence (e.g., ODD, stress tests).

4. Third line: Independent audit/regulator (e.g., SEC exams, AIFMD reporting).

5. Tail Risk Haircut Formula (for adjusting expected returns):
   Adjusted Return = Expected Return × (1 – Tail Risk Haircut)

6. Tail Risk Haircut = Probability of tail event × Loss given tail event.

7. Example: If a fund has a 5% chance of a 50% drawdown, the haircut is 2.5% (0.05 × 50%).

8. AIFMD’s "Risk Management Requirements" (Article 15):

9. Managers must separate risk management from portfolio management.
10. Must stress-test for liquidity, leverage, and concentration risks at least annually.

Misconceptions

1. "Past performance predicts future tail risk."
2. Reality: Tail events are, by definition, outliers. A fund with 10 years of smooth returns may still blow up in Year 11 (e.g., LTCM).
3. "Due diligence is just checking a manager’s track record."
4. Reality: Track record is backward-looking; due diligence must assess forward-looking risks (e.g., key-person risk, model risk).
5. "Stress tests are only for quantitative funds."
6. Reality: Even discretionary managers (e.g., global macro) must stress-test for liquidity spirals or counterparty failures.
7. "Operational due diligence (ODD) is a one-time check."
8. Reality: ODD is ongoing (e.g., quarterly reviews of service providers, annual on-site visits).
9. "Tail risk is only about market crashes."
10. Reality: Tail risks include operational failures (e.g., fraud, IT outages), regulatory changes (e.g., Dodd-Frank), and geopolitical shocks (e.g., Russia-Ukraine war).

Common Mistakes

1. Overweighting recent performance in manager selection (recency bias).
2. Ignoring "soft" red flags (e.g., high turnover in risk team, vague answers in interviews).
3. Assuming liquidity matches strategy (e.g., a "liquid" hedge fund holding illiquid assets like private credit).
4. Not adjusting for leverage in stress tests (e.g., a 10% market drop → 50% fund loss due to 5x leverage).
5. Failing to document due diligence (regulators like the SEC require written records of ODD).

The Common Trap

The "Checklist Fallacy": - Believing that due diligence is just ticking boxes (e.g., "Does the manager have a risk committee? Yes → Pass"). - Reality: Due diligence is judgment-based. A manager may have all the right structures but still fail due to culture (e.g., overconfidence, siloed teams) or incentives (e.g., fee structures encouraging excessive risk-taking).

Terms to Remember

1. Tail Risk: Extreme, low-probability events with severe impact (e.g., 2008 crisis, COVID-19).
2. Operational Due Diligence (ODD): Assessment of non-investment risks (e.g., fraud, IT, counterparty).
3. Key-Person Risk: Dependency on one individual (e.g., a star PM leaving).
4. Style Drift: Manager deviating from stated strategy (e.g., a "market-neutral" fund taking directional bets).
5. Liquidity Mismatch: Holding illiquid assets (e.g., private equity) in a "liquid" fund (e.g., hedge fund).

Step-by-Step Process

1. Pre-Screening (Desk Review)

• Step 1: Check regulatory filings (e.g., Form ADV for US managers, AIFMD disclosures for EU).
• Step 2: Review track record for:
• Consistency (e.g., no "style drift").
• Drawdowns (e.g., max drawdown > 20% may indicate tail-risk exposure).
• Correlation to peers (e.g., a "market-neutral" fund with 0.8 beta to S&P 500).
• Step 3: Assess fee structure (e.g., high-water marks, hurdle rates) for misalignment of incentives.

2. Operational Due Diligence (ODD)

• Step 4: On-site visit (or virtual) to assess:
• Valuation process: Who prices illiquid assets? Are third-party administrators used?
• Counterparty risk: Are prime brokers diversified? Any concentration with one bank?
• IT/security: Are there backups for trading systems? Cybersecurity policies?
• Compliance: Is there a dedicated CCO? Are personal trading rules enforced?
• Step 5: Background checks on key personnel (e.g., past fraud, regulatory violations).

3. Tail Risk Assessment

• Step 6: Stress-test the portfolio for:
• Market shocks (e.g., 20% drop in equities, 300bps rise in rates).
• Liquidity shocks (e.g., 50% of investors redeem in 30 days).
• Counterparty failure (e.g., prime broker goes bankrupt).
• Step 7: Behavioral analysis:
• Does the manager overtrade (high turnover)?
• Are there incentives to take tail risk (e.g., performance fees with no clawbacks)?
• Step 8: Apply tail-risk haircut to expected returns (see formula above).

4. Documentation & Monitoring

• Step 9: Write a due diligence report covering:
• Strengths/weaknesses of the manager’s process.
• Red flags (e.g., "No independent valuation for Level 3 assets").
• Recommended actions (e.g., "Reduce allocation by 20% due to leverage risk").
• Step 10: Ongoing monitoring:
• Quarterly reviews of ODD findings.
• Annual on-site visits.
• Real-time alerts for breaches (e.g., leverage limits exceeded).

Exam Answer Builder

1-Mark Question (Single-Best-Answer MCQ)

What it tests: Recognition of tail-risk definitions. Example Question: Which of the following is the BEST example of a tail risk for a global macro hedge fund? A) A 1% daily loss due to minor FX fluctuations. B) A 30% loss from a sudden 500bps rise in US Treasury yields. C) A 5% drawdown from a bad stock pick. D) A 10% annual underperformance vs. the S&P 500.

Correct Answer: B Key Tip: Tail risks are extreme, low-probability events with severe impact. Eliminate options that describe normal volatility (A, C, D).

3-Mark Question (Short Answer)

What it tests: Application of tail-risk haircuts. Example Question: A hedge fund has an expected return of 12% and a 3% probability of a 60% drawdown. Calculate the tail-risk-adjusted return.

Correct Answer: Tail Risk Haircut = 0.03 × 60% = 1.8% Adjusted Return = 12% × (1 – 0.018) = 11.78%

Key Tip: - Show the formula: Haircut = Probability × Loss Given Event. - Apply the haircut to the expected return: Adjusted Return = Expected Return × (1 – Haircut).

5-Mark Question (Case Study)

What it tests: Due diligence judgment in a real-world scenario. Example Question: You are conducting due diligence on a market-neutral hedge fund that claims to have zero beta to equities. During your review, you notice: - The fund’s largest position is a 15% allocation to a single illiquid convertible bond. - The CIO has a history of working at a firm that was fined for mispricing assets. - The fund’s VaR model assumes normal distributions for returns.

Identify three red flags and explain how each could lead to tail risk. Propose one action for each.

Model Answer: 1. Concentration in illiquid asset (15% in one bond):
- Risk: Liquidity mismatch → forced selling in a crisis → fire-sale losses.
- Action: Require the manager to reduce position size to <5% or provide a liquidity plan.

1. CIO’s history of mispricing:
2. Risk: Fraud or model risk → assets may be overvalued → sudden write-downs.

3. Action: Verify independent valuation process (e.g., third-party administrator).

4. VaR assumes normal distributions:

5. Risk: Underestimates tail risk → fund may be overleveraged.
6. Action: Require stress-testing for fat tails (e.g., CVaR instead of VaR).

Key Tip: - Link each red flag to a specific tail risk (e.g., liquidity, fraud, model risk). - Propose concrete actions (not just "monitor" or "be careful").

Scenario-Based Question (AIFMD Compliance)

What it tests: Regulatory application of due diligence. Example Question: Under AIFMD, a European fund-of-funds is required to assess the risk management of its underlying managers. During due diligence, you discover that a hedge fund: - Does not separate its risk management team from portfolio management. - Has not conducted a stress test in 18 months.

What are the two AIFMD violations here? What should the fund-of-funds do next?

Correct Answer: 1. Violations:
- Article 15(2): Risk management must be functionally separate from portfolio management.
- Article 15(3): Stress tests must be conducted at least annually. 2. Action:
- Immediate: Require the manager to remediate (e.g., hire a dedicated risk team, conduct a stress test within 30 days).
- Long-term: Reduce allocation or terminate the relationship if non-compliant.

Key Tip: - Cite the exact AIFMD article (e.g., Article 15). - Distinguish between "must" (non-negotiable) and "should" (best practice).

This vs That

Time-Saver Hack

The "5-Minute Red Flag Check": When short on time, ask these three questions to spot tail risks quickly: 1. "What’s the worst-case scenario?" (If the manager can’t answer, they haven’t stress-tested.) 2. "Who prices the illiquid assets?" (If it’s the PM, not a third party → valuation risk.) 3. "What’s your leverage limit?" (If it’s >3x for a liquid strategy → leverage risk.)

Mini Scenarios

1. Basic Scenario

You’re reviewing a long/short equity hedge fund. The manager claims to have "no tail risk" because they use stop-losses on all positions. What’s happening? - Stop-losses do not eliminate tail risk—they can amplify it during liquidity crunches (e.g., 2020 COVID crash, where stop-losses triggered cascading sell-offs). What to notice first? - Liquidity mismatch: Stop-losses work in normal markets but fail in crises when bid-ask spreads explode.

2. Applied Scenario

A global macro fund has a 10-year track record of 15% annual returns with no drawdowns >5%. Your ODD reveals: - The fund uses 5x leverage on FX trades. - The CIO is the sole decision-maker, with no risk team. - The fund’s VaR model assumes normal distributions. What’s happening? - Hidden tail risk: The "no drawdowns" record is likely due to luck or mispricing (e.g