UK K12 GCSE/A-Level: Year 13 A-Level Upper Sixth Mathematics - Pure Numerical Methods, Newton-Raphson

Learning Objectives

By the end of this topic, students will be able to:

• Understand the Newton-Raphson method for finding roots of a function
• Apply the Newton-Raphson method to solve equations numerically
• Analyze the convergence of the Newton-Raphson method
• Use the Newton-Raphson method to approximate the roots of a function with a given initial guess
• Evaluate the advantages and limitations of the Newton-Raphson method

Core Concepts

The Newton-Raphson method is a powerful numerical technique for finding roots of a function. It is based on the idea of iteratively improving an initial guess for the root until it converges to the actual root.

The method uses the following formula:

f(x) = 0

x_n+1 = x_n - f(x_n) / f'(x_n)

where x_n is the current estimate of the root, f(x_n) is the value of the function at x_n, and f'(x_n) is the derivative of the function at x_n.

The Newton-Raphson method can be thought of as a iterative process that refines the estimate of the root at each step. The formula can be interpreted as follows: at each step, we calculate the tangent to the function at the current estimate of the root, and then move along this tangent to the point where it intersects the x-axis. This new point is then used as the next estimate of the root.

The convergence of the Newton-Raphson method depends on the initial guess and the properties of the function. If the initial guess is close to the root, and the function is smooth and well-behaved, the method will converge rapidly. However, if the initial guess is far from the root, or the function has singularities or discontinuities, the method may not converge at all.

Types of Convergence

There are two types of convergence in the Newton-Raphson method:

• Linear convergence: The method converges linearly if the error at each step is proportional to the error at the previous step. This is the case when the function is smooth and well-behaved.
• Quadratic convergence: The method converges quadratically if the error at each step is proportional to the square of the error at the previous step. This is the case when the function is smooth and well-behaved, and the initial guess is close to the root.

Worked Examples

Example 1: Finding the root of a simple function

Find the root of the function f(x) = x^2 - 2 using the Newton-Raphson method with an initial guess of x_0 = 1.

f(x) = x^2 - 2 f'(x) = 2x

x_1 = x_0 - f(x_0) / f'(x_0) = 1 - (1^2 - 2) / (2*1) = 1.5

x_2 = x_1 - f(x_1) / f'(x_1) = 1.5 - (1.5^2 - 2) / (2*1.5) = 1.4167

x_3 = x_2 - f(x_2) / f'(x_2) = 1.4167 - (1.4167^2 - 2) / (2*1.4167) = 1.4142

The root of the function f(x) = x^2 - 2 is approximately 1.4142.

Example 2: Finding the root of a more complex function

Find the root of the function f(x) = x^3 - 2x^2 + x + 1 using the Newton-Raphson method with an initial guess of x_0 = 1.

f(x) = x^3 - 2x^2 + x + 1 f'(x) = 3x^2 - 4x + 1

x_1 = x_0 - f(x_0) / f'(x_0) = 1 - (1^3 - 21^2 + 1 + 1) / (31^2 - 4*1 + 1) = 1.25

x_2 = x_1 - f(x_1) / f'(x_1) = 1.25 - (1.25^3 - 21.25^2 + 1.25 + 1) / (31.25^2 - 4*1.25 + 1) = 1.2333

x_3 = x_2 - f(x_2) / f'(x_2) = 1.2333 - (1.2333^3 - 21.2333^2 + 1.2333 + 1) / (31.2333^2 - 4*1.2333 + 1) = 1.2308

The root of the function f(x) = x^3 - 2x^2 + x + 1 is approximately 1.2308.

Common Misconceptions

• The Newton-Raphson method always converges to the root of the function.
• The Newton-Raphson method is only useful for finding roots of simple functions.
• The Newton-Raphson method is sensitive to the initial guess.

Exam Tips

• Make sure to check the convergence of the Newton-Raphson method before using it to find the root of a function.
• Use the Newton-Raphson method with an initial guess that is close to the root of the function.
• Be aware of the limitations of the Newton-Raphson method, such as its sensitivity to the initial guess and its inability to handle singularities or discontinuities.

MCQs

MCQ 1 [F]

What is the formula for the Newton-Raphson method?

A) x_n+1 = x_n - f(x_n) / f'(x_n) B) x_n+1 = x_n + f(x_n) / f'(x_n) C) x_n+1 = x_n - f'(x_n) / f(x_n) D) x_n+1 = x_n + f'(x_n) / f(x_n)

Correct answer: A) x_n+1 = x_n - f(x_n) / f'(x_n)

Why the distractors fail:

• B) x_n+1 = x_n + f(x_n) / f'(x_n) is incorrect because the Newton-Raphson method subtracts the derivative of the function from the function value, not adds it.
• C) x_n+1 = x_n - f'(x_n) / f(x_n) is incorrect because the Newton-Raphson method divides the derivative of the function by the function value, not subtracts it.
• D) x_n+1 = x_n + f'(x_n) / f(x_n) is incorrect because the Newton-Raphson method subtracts the derivative of the function from the function value, not adds it.

MCQ 2 [H]

What is the type of convergence of the Newton-Raphson method when the function is smooth and well-behaved?

A) Linear convergence B) Quadratic convergence C) Exponential convergence D) None of the above

Correct answer: B) Quadratic convergence

Why the distractors fail:

• A) Linear convergence is incorrect because the Newton-Raphson method converges quadratically when the function is smooth and well-behaved.
• C) Exponential convergence is incorrect because the Newton-Raphson method does not converge exponentially.
• D) None of the above is incorrect because quadratic convergence is the correct answer.

MCQ 3 [F]

What is the purpose of the derivative in the Newton-Raphson method?

A) To find the root of the function B) To check the convergence of the method C) To improve the estimate of the root D) To find the maximum value of the function

Correct answer: C) To improve the estimate of the root

Why the distractors fail:

• A) To find the root of the function is incorrect because the derivative is used to improve the estimate of the root, not find it.
• B) To check the convergence of the method is incorrect because the derivative is used to improve the estimate of the root, not check convergence.
• D) To find the maximum value of the function is incorrect because the derivative is used to improve the estimate of the root, not find the maximum value.

MCQ 4 [H]

What is the limitation of the Newton-Raphson method when the function has singularities or discontinuities?

A) It may not converge at all B) It may converge slowly C) It may converge to a wrong root D) It may not converge to the correct root

Correct answer: A) It may not converge at all

Why the distractors fail:

• B) It may converge slowly is incorrect because the Newton-Raphson method may not converge at all when the function has singularities or discontinuities.
• C) It may converge to a wrong root is incorrect because the Newton-Raphson method may not converge at all when the function has singularities or discontinuities.
• D) It may not converge to the correct root is incorrect because the Newton-Raphson method may not converge at all when the function has singularities or discontinuities.

MCQ 5 [F]

What is the initial guess for the root of the function f(x) = x^2 - 2?

A) x_0 = 0 B) x_0 = 1 C) x_0 = 2 D) x_0 = 3

Correct answer: B) x_0 = 1

Why the distractors fail:

• A) x_0 = 0 is incorrect because the initial guess should be close to the root of the function.
• C) x_0 = 2 is incorrect because the initial guess should be close to the root of the function.
• D) x_0 = 3 is incorrect because the initial guess should be close to the root of the function.

Short-answer questions

1. Describe the Newton-Raphson method for finding roots of a function.

Answer: The Newton-Raphson method is a numerical technique for finding roots of a function. It uses the formula x_n+1 = x_n - f(x_n) / f'(x_n) to iteratively improve an initial guess for the root until it converges to the actual root.

1. What is the purpose of the derivative in the Newton-Raphson method?

Answer: The derivative is used to improve the estimate of the root by calculating the tangent to the function at the current estimate of the root.

1. What is the limitation of the Newton-Raphson method when the function has singularities or discontinuities?

Answer: The Newton-Raphson method may not converge at all when the function has singularities or discontinuities.

1. Describe the types of convergence of the Newton-Raphson method.

Answer: The Newton-Raphson method converges linearly when the function is smooth and well-behaved, and converges quadratically when the function is smooth and well-behaved and the initial guess is close to the root.

1. What is the initial guess for the root of the function f(x) = x^2 - 2?

Answer: The initial guess should be close to the root of the function, such as x_0 = 1.