1 / 73

Root Finding Methods: Bisection, Newton's, Secant, Fixed-point Iteration

This chapter explores different root finding methods, including the Bisection Method, Newton's Method, Secant Method, and Fixed-point Iteration. It discusses their advantages, disadvantages, convergence, error estimation, and application examples.

issacr
Download Presentation

Root Finding Methods: Bisection, Newton's, Secant, Fixed-point Iteration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Chapter 3 Root Finding

  2. 3.1 The Bisection Method • Let fbe a continues function. Suppose we know that f(a) f(b) < 0, then there is a root between a and b.

  3. Example 3.1 • A formal statement is given in Algorithm 3.1.

  4. Theorem 3.1 Bisection Convergence and Error

  5. Bisection Method • Advantage: • A global method: it always converge no matter how far you start from the actual root. • Disadvantage: • It cannot be used to find roots when the function is tangent is the axis and does not pass through the axis. • For example: • It converges slowly compared with other methods.

  6. 3.2 Newton’s Method: Derivation and Examples • Newton’s method is the classic algorithm for finding roots of functions. • Two good derivations of Newton’s method: • Geometric derivation • Analytic derivation

  7. Newton’s Method :Geometric Derivation

  8. Newton’s Method :Geometric Derivation • The fundamental idea in Newton’s method is to use the tangent line approximation to the functionf at point . • The point-slope formula for the equation of the straight line gives us: • Continue the process with another straight line to get

  9. Newton’s Method :Analytic Derivation

  10. Example 3.2

  11. Newton’s Method • Advantage: • Very fast • Disadvantage: • Not a global method • For example: Figure 3.3 (root x= 0.5) • Another example: Figure 3.4 (root x = 0.05) • In these example, the initial point should be carefully chosen. • Newton’s method will cycle indefinitely. • Newton’s method will just hop back and forth between two values. • For example: Consider (root x= 0)

  12. Initial value Wrong predictions, because the root is positive Very close to the actual root

  13. 3.3 How to Stop Newton’s Method • Ideally, we would want to stop when the error is sufficiently small. (p. 12)

  14. To make sure f(xn) is also small enough

  15. f (x) f ’(x) 3.4 Application:Division using Newton’s Method • The purpose is to illustrate the use of Newtown’s method and the analysis of the resulting iteration.

  16. Questions: • When does this iteration converge and how fast? • What initial guesses x0 will work for us? • The way that computer stores numbers:

  17. From (2.11) p.53 Initial x0 p.56

  18. Example 3.3

  19. 3.5 The Newton Error Formula

  20. Definition 3.1 • The requirement that C be nonzero and finite actually forces p to be a single unique value. • Linear convergence: p = 1 • Quadratic convergence: p = 2 • Superlinearly convergence: but

  21. Example 3.6

  22. 3.6 Newton’s Method:Theory and Convergence • Its proof is shown at pp. 106-108.

  23. 3.7 Application: Computation of the Square Root

  24. Questions: • Can we find an initial guess such that Newton’s method will always converge for bon this interval? • How rapidly will it converge? • The Newton error formula (3.12) applied to : (3.25) • The relative error satisfies (3.26)

  25. relative error

  26. How to find the initial value? • Choose the midpoint of the interval • For example: If , • Using linear interpolation • For example: bis known

  27. 3.8 The Secant Method:Derivation and Examples • An obvious drawback of Newton’s method is that it requires a formula for the derivative of f. • One obvious way to deal with this problem is to use an approximation to the derivative in the Newton formula. • For example: • Another method: the secant method • Used a secant line

  28. The Secant Method

  29. The Secant Method

  30. The Secant Method • Its advantages over Newton’s method: • It not require the derivative. • It can be coded in a way requiringonlya single function evaluation per iteration. • Newton’s requires two, one for the function and one for the derivative.

  31. Example 3.7

  32. Error Estimation • The error formula for the secant method:

  33. The Convergence • This is almost the same as Newton’s method.

  34. root 3.9 Fixed-point Iteration • The goal of this section is to use the added understanding of simple iteration to enhance our understanding of and ability to solve root-finding problems. • The root of f is equal to the fixed-point of g.

  35. Fixed-point Iteration • Because show that this kind of point is called a fixed point of the function g, and an iteration of the form (3.33) is called a fixed-point iteration for g.

  36. Fixed point Root

  37. Example 3.8

  38. g (x)

  39. Theorem 3.5

  40. Theorem 3.5 (con.)

More Related