CAIA Level II: Due Diligence and Selecting Managers — Investment Process Due Diligence

CAIA Level II: Due Diligence and Selecting Managers — Investment Process Due Diligence

What Is It?

1. What is this topic?
   A structured assessment of a manager’s investment process—philosophy, research, execution, risk controls, and alignment with stated objectives—to determine consistency, robustness, and potential for outperformance.

2. How is it tested, applied, audited, or used in the real world?
   Tested via case studies, manager selection scenarios, and process evaluation questions. Applied in fund-of-funds, institutional allocations, and compliance audits. Audited for adherence to stated processes and risk controls.

Why Does the Exam Ask This?

The exam tests your ability to: - Evaluate process integrity—distinguish between genuine skill and luck. - Assess operational risks—identify gaps in execution, risk management, or alignment. - Make allocation decisions—justify manager selection with evidence, not just past returns. - Document due diligence—structure findings for compliance, audits, or investment committees. - Detect style drift or process decay—spot inconsistencies between stated and actual practices.

What Do I Need to Know First?

1. Investment styles (value, growth, quantitative, etc.) and their key drivers.
2. Risk-adjusted performance metrics (Sharpe ratio, Sortino ratio, alpha, tracking error).
3. Operational due diligence basics (fees, custody, compliance, reporting).
4. Behavioral biases in investment decision-making (overconfidence, herding, confirmation bias).
5. Regulatory frameworks (GIPS, UCITS, AIFMD) governing process disclosure.

Topic Snapshot

This topic sits at the intersection of manager selection and operational risk in CAIA Level II. It bridges qualitative judgment (e.g., "Does the process make sense?") with quantitative validation (e.g., "Does the process deliver consistent alpha?"). Mastery is critical for roles in fund-of-funds, institutional consulting, and compliance, where poor process due diligence can lead to style drift, fraud, or underperformance.

Exam / Job / Audit Weighting

• Frequency: High (appears in ~15-20% of Level II questions, often in case studies).
• Difficulty Rating: Intermediate (requires synthesis of qualitative and quantitative data).
• Question Type or Real-World Task Type:
• Exam: Case-based MCQs, short-answer process evaluations, and long-form manager selection reports.
• Real World: Manager interviews, process documentation reviews, risk committee presentations, and audit trails for compliance.

Difficulty Level

Intermediate

Must-Know Rules, Formulas, Standards, or Principles

1. The "Three P’s" Framework
2. Philosophy: Clear, repeatable investment thesis (e.g., "We buy undervalued stocks with strong balance sheets").
3. Process: Documented steps from idea generation to execution (e.g., "Screen for P/B < 1.5, then fundamental analysis").

4. People: Team structure, incentives, and turnover (e.g., "Portfolio managers have 10+ years of experience; compensation is 80% performance-based").

5. Process Consistency Test

6. Formula: Consistency Score = (Actual Process Adherence / Stated Process) × 100

7. Rule: A score < 80% signals style drift or operational risk.

8. GIPS (Global Investment Performance Standards) Compliance

9. Key Rule: Managers must disclose composite construction, benchmark selection, and risk controls to claim GIPS compliance.
10. Audit Trigger: Inconsistent benchmarking or undisclosed leverage violates GIPS.

Misconceptions

1. "Past performance predicts future process quality."

2. Reality: Outperformance may stem from luck, market conditions, or undisclosed leverage—not process.

3. "Quantitative managers don’t need qualitative due diligence."

4. Reality: Even quant funds can suffer from overfitting, data mining, or model decay.

5. "A long track record means the process is robust."

6. Reality: Track records can hide survivorship bias, backfill bias, or style drift.

7. "Due diligence is only about returns."

8. Reality: Operational risks (e.g., custody, valuation, key-person risk) often cause failures, not poor returns.

9. "Interviewing the manager is enough."

10. Reality: Third-party verification (e.g., audits, trade logs, risk reports) is critical to validate claims.

Common Mistakes

1. Overweighting recent performance without assessing process consistency.
2. Ignoring key-person risk (e.g., relying on a single portfolio manager’s expertise).
3. Assuming "black box" quant models are infallible without testing for overfitting.
4. Failing to check for style drift (e.g., a "value" manager holding growth stocks).
5. Not verifying GIPS compliance or composite construction (e.g., cherry-picking accounts).

The Common Trap

Confusing "process" with "outcome." - Trap: Assuming a manager with strong returns has a strong process. - Why it happens: Humans overweight recent results (recency bias) and underweight structural risks. - How to avoid: Reverse-engineer the process—ask, "Could this return have been generated by luck, leverage, or market conditions?" Use holdings-based analysis (e.g., sector exposures, factor tilts) to test consistency.

Terms to Remember

1. Style Drift – Deviation from stated investment process (e.g., a "deep value" manager buying growth stocks).
2. Key-Person Risk – Over-reliance on one individual (e.g., a star portfolio manager leaving).
3. GIPS Compliance – Global standard for performance reporting; non-compliance is a red flag.
4. Process Decay – Gradual erosion of discipline (e.g., increasing position sizes, ignoring risk limits).
5. Operational Alpha – Outperformance derived from process efficiency (e.g., faster trade execution, better risk management).

Step-by-Step Process

1. Define the Objective

• What is the mandate? (e.g., "Generate 5% alpha with < 10% tracking error vs. S&P 500").
• What is the benchmark? (e.g., Russell 1000 Value).

2. Gather Documentation

• Investment Policy Statement (IPS) – Stated philosophy, constraints, and risk limits.
• Process Manual – Step-by-step workflow (e.g., "Screen → Analyze → Approve → Execute").
• Risk Reports – Position limits, leverage, liquidity constraints.
• Trade Logs – Verify execution consistency (e.g., no front-running, no late trading).
• GIPS Reports – Check composite construction and benchmarking.

3. Assess Philosophy & Process

• Philosophy: Is it clear, repeatable, and backed by research? (e.g., "We exploit the low-volatility anomaly.")
• Process:
  • Idea Generation: How are opportunities identified? (e.g., screens, fundamental research, quant models).
  • Decision-Making: Who approves trades? (e.g., investment committee, PM discretion).
  • Execution: How are trades implemented? (e.g., algorithmic, block trades).
  • Risk Controls: What stops losses? (e.g., stop-losses, VaR limits, concentration caps).

4. Validate with Data

• Holdings-Based Analysis:
  • Compare current holdings to stated style (e.g., P/B ratios for a value manager).
  • Check for style drift (e.g., sector exposures, factor tilts).
• Performance Attribution:
  • Decompose returns (e.g., sector allocation, stock selection, timing).
  • Test for consistent alpha (e.g., does it persist across market regimes?).
• Risk Metrics:
  • Tracking Error: Is it within mandate limits?
  • Leverage: Is it disclosed and stable?
  • Liquidity: Can positions be exited without market impact?

5. Interview the Manager

• Key Questions:
  • "Walk me through your process for a recent trade."
  • "How do you handle drawdowns?" (Tests risk management.)
  • "What’s your biggest mistake, and how did you adjust?" (Tests learning culture.)
  • "How do you ensure your team follows the process?" (Tests governance.)
• Red Flags:
  • Vague answers (e.g., "We have a proprietary model").
  • Inconsistencies between stated and actual process.
  • High turnover in key roles.

6. Third-Party Verification

• Audits: Review SOC 1/2 reports for operational controls.
• Custody: Confirm assets are held with a reputable custodian.
• Valuation: Check pricing sources (e.g., independent vs. manager-provided).
• Compliance: Verify adherence to regulations (e.g., UCITS, AIFMD).

7. Document & Decide

• Strengths: What’s working? (e.g., "Strong risk controls, low turnover").
• Weaknesses: What’s missing? (e.g., "No stop-loss mechanism").
• Risks: What could go wrong? (e.g., "Key-person risk if PM leaves").
• Recommendation: Allocate, monitor, or reject.

Exam Answer Builder

1-Mark Question (MCQ)

What it tests: Recognition of process due diligence components. Example Question: "Which of the following is LEAST likely to be part of investment process due diligence?" A) Reviewing the manager’s trade execution logs B) Analyzing the manager’s personal credit score C) Assessing the consistency of the manager’s sector exposures D) Verifying the manager’s GIPS compliance

Key Tip: Eliminate options that are clearly operational (A, C, D). Personal credit scores are irrelevant.

Correct Answer: B

2-Mark Question (Short Answer)

What it tests: Ability to identify process risks. Example Question: "A value manager’s portfolio has recently shifted from low P/B stocks to high-growth tech stocks. What risk does this pose, and what due diligence step should be taken?"

Key Tip: 1. Name the risk: Style drift. 2. Explain the impact: May violate mandate, increase tracking error, or signal process decay. 3. Due diligence step: Compare current holdings to stated philosophy; interview the manager to understand the change.

Sample Answer: "This shift indicates style drift, which may violate the mandate and increase tracking error. The next step is to compare current holdings to the stated value philosophy and interview the manager to determine if the change is temporary or a permanent shift."

3-Mark Question (Calculation + Judgment)

What it tests: Quantitative validation of process consistency. Example Question: "A manager claims to follow a low-volatility strategy. The portfolio’s beta to the S&P 500 is 0.8, but the trailing 12-month volatility is 22% (vs. the benchmark’s 18%). What does this suggest, and what due diligence action should you take?"

Key Tip: 1. Calculate the inconsistency: Beta (0.8) suggests lower volatility, but actual volatility (22%) is higher than the benchmark (18%). 2. Explain the mismatch: The manager may be taking hidden risks (e.g., leverage, concentrated positions). 3. Action: Request holdings data to check for concentration or leverage; review risk reports for undisclosed exposures.

Sample Answer: "The beta of 0.8 suggests lower volatility, but the actual volatility of 22% (vs. benchmark 18%) indicates the manager may be taking hidden risks. Due diligence should include reviewing holdings for concentration or leverage and requesting risk reports to identify undisclosed exposures."

5-Mark Question (Case Study)

What it tests: Comprehensive process evaluation. Example Question: "You are evaluating a hedge fund that claims to generate alpha through a ‘market-neutral, statistical arbitrage’ strategy. The fund has delivered 8% annualized returns with 5% volatility over 5 years. However, in the last 6 months, returns have turned negative (-3%). The manager attributes this to ‘temporary market dislocation.’ 1. What due diligence steps would you take to assess the manager’s explanation? 2. What red flags would you look for in the fund’s process?"

Key Tip: 1. Validate the explanation:
- Check holdings data for style drift (e.g., net exposure, sector bets).
- Review trade logs for changes in execution (e.g., increased leverage, new instruments).
- Compare recent performance to peers with similar strategies. 2. Red flags:
- Increased leverage (could amplify losses).
- Model decay (e.g., strategy worked in past regimes but not now).
- Key-person risk (e.g., lead quant left).
- Liquidity issues (e.g., holding illiquid assets).

Sample Answer: "1. Due diligence steps:
- Holdings analysis: Check for net exposure drift (e.g., from market-neutral to directional).
- Trade logs: Verify if leverage or instrument types have changed.
- Peer comparison: Compare recent performance to other market-neutral funds.
- Risk reports: Review VaR, stress tests, and liquidity metrics for hidden risks. 2. Red flags:
- Model decay: If the strategy worked in past regimes but not now, the model may need updating.
- Key-person risk: If the lead quant left, the process may be compromised.
- Liquidity mismatch: If the fund holds illiquid assets, mark-to-market losses may be temporary.
- Leverage creep: Increased leverage could explain the recent drawdown."

This vs That

Time-Saver Hack

The "3-Question Test" for Quick Process Evaluation: 1. "Can the manager explain their process in 2 minutes without jargon?" (Tests clarity.) 2. "Does the process have a ‘kill switch’ (e.g., stop-loss, risk limits)?" (Tests risk management.) 3. "Has the process changed in the last 2 years?" (Tests stability.)

If the answer to any is "no," dig deeper.

Mini Scenarios

1. Basic Scenario

"A private equity manager claims to specialize in ‘distressed debt.’ Their latest fund holds 30% in senior secured loans and 70% in high-yield bonds. What should you check first?" What’s happening: Potential style drift—distressed debt typically involves control investments (e.g., equity stakes in bankrupt firms), not just high-yield bonds. What to notice: Compare holdings to the stated strategy; ask for deal-level data to verify.

2. Applied Scenario

"A quant fund’s backtest shows 15% annualized returns with 10% volatility. Live performance is 5% with 12% volatility. The manager says, ‘Markets are different now.’ What’s your next step?" What’s happening: Possible overfitting or model decay. What to notice: - Check if the live portfolio’s factor exposures match the backtest. - Review stress-test results for robustness across regimes. - Ask for out-of-sample testing data.

3. Tricky Scenario

"A value manager’s portfolio has a P/B ratio of 1.2 (vs. benchmark 1.8). However, their top holding is a tech stock with P/B of 8. The manager says, ‘We’re flexible.’ What’s the issue?" What’s happening: Style drift masked by aggregation. What to notice: - The weighted average P/B hides the tech stock’s