310 likes | 602 Views
Learn how inaccuracies in calculations propagate through numerical methods. Explore error sources, significant figures, and error definitions. Understand round-off and truncation errors in calculations.
E N D
Numerical AnalysisCC413 Propagation of Errors
Propagation of Errors In numerical methods, the calculations are not made with exact numbers. How do these inaccuracies propagate through the calculations?
Source of errors • Rounding • Truncation • Inherent • Mistakes
Underflow and Overflow • Numbers occurring in calculations that have a magnitude less than 2 -1023 .(1+2 -52) result in underflow and are generally set to zero. • Numbers greater than 2 1024 .(2-2 -52) result in overflow.
Significant Figures • Number of significant figures indicates precision. Significant digits of a number are those that can be used with confidence, e.g.,the number of certain digits plus one estimated digit. 53,800 How many significant figures? 5.38 x 1043 5.380 x 1044 5.3800 x 1045
Significant Figures • Zeros are sometimes used to locate the decimal point not significant figures. 0.00001753 4 0.0001753 4 0.001753 4 • N = 3.141592653589793232 then N = 0.14159265358979232 x 10+1 t= 4 N = 0.1415 x 10+1
Error Definitions • Numerical error - use of approximations to represent exact mathematical operations and quantities • true value = approximation + error • Error = true value - approximation • Error = |N – n| Absolut error • Relative error = error / true value • R.E. = |N-n|/|N| = |N-n|/|n|
Example 1: Find the bounds for the propagation in adding two numbers. For example if one is calculating X +Y where X = 1.5 ± 0.05 Y = 3.4 ± 0.04 Solution Maximum possible value of X = 1.55 and Y = 3.44 Maximum possible value of X + Y = 1.55 + 3.44 = 4.99 Minimum possible value of X = 1.45 and Y = 3.36. Minimum possible value of X + Y = 1.45 + 3.36 = 4.81 Hence 4.81 ≤ X + Y ≤4.99.
Example 2: The strain in an axial member of a square cross-section is given by Given Find the maximum possible error in the measured strain.
Example 2: Solution http://numericalmethods.eng.usf.edu
Example Consider a problem where the true answer is 7.91712. If you report the value as 7.92, answer the following questions. • What is the true error? • What is the relative error?
Example • Determine the absolute and relative errors when approximating p by p∗ when
Solution • This example shows that the same relative error, 0.3333×10−1, occurs for widely varying absolute errors. • the absolute error can be misleading and the relative error more meaningful, because the relative error takes into consideration the size of the value.
Error Definitions cont. • Round off error – Symmetric rounding originate from the fact that computers retain only a fixed number of significant figures: y = 0.73248261 to be 0.7325 • Error = y-round(y) = 0.00001739 and relative error = error /y = -0.000024
Error Definitions cont. • Truncation errors – Chopping errors that result from using an approximation in place of an exact mathematical procedure: y = 0.73248261 to be 0.7324 • Error = 0.0008261 and relative error = 0.00011
Example • Determine the five-digit (a) chopping and (b) rounding values of the irrational number π. • Solution The number π has an infinite decimal expansion of the form π = 3.14159265. . . . • Written in normalized decimal form, we have π = 0.314159265 . . . × 10. (a) The floating-point form of π using five-digit chopping is f l(π) = 0.31415 × 10 = 3.1415. (b) The sixth digit of the decimal expansion of π is a 9, so the floating-point form of π using five-digit rounding is f l(π) = (0.31415 + 0.00001) × 10 = 3.1416.
Example • Suppose that x = 57 and y = 13. Use five-digit chopping for calculating x + y, x − y, x × y, and x ÷ y. • Solution: Note that
Use absolute value. • Computations are repeated until stopping criterion is satisfied. • If the following criterion is met you can be sure that the result is correct to at least n significant figures. Pre-specified % tolerance based on the knowledge of your solution
Round-off Errors (Error Bounds Analysis) Round down Round up fl(z) is the rounded value of z
Chopping Errors (Error Bounds Analysis) Suppose the mantissa can only support n digits. Thus the absolute and relative chopping errors are Suppose ß = 10 (base 10), what are the values of ai such that the errors are the largest?
Round-off Errors (Error Bounds Analysis)Absolute error of fl(z) When rounding down Similarly, when rounding up i.e., when
Round-off Errors (Error Bounds Analysis)Relative error of fl(z)
Summary of Error Bounds Analysis βbase n# of significant digits or # of digits in the mantissa Regardless of chopping or round-off is used to round the numbers, the absolute errors may increase as the numbers grow in magnitude but the relative errors are bounded by the same magnitude.
Numerical Stability • Rounding errors may accumulate and propagate unstably in a bad algorithm. • Can be proven that for Gaussian elimination the accumulated error is bounded
Ill-conditioned problem • If small error in data input produce large error in solution • When |f’(x)| is large • 1.0 x +3.5 y = 8 • 2.1 x + 7.0 y = 16.1 • Sol is (1.0, 2.0) if Changed to • 2.12x + 7.0 y = 16.1 • Sol is (0.8333, 2.048)
Ill-conditioned system of equations • A small deviation in the entries of A matrix, causes a large deviation in the solution.
Machine Epsilon Relative chopping error Relative round-off error eps is known as the machine epsilon – the smallest number such that 1 + eps > 1 epsilon = 1; while (1 + epsilon > 1) epsilon = epsilon / 2; epsilon = epsilon * 2; Algorithm to compute machine epsilon
Exercise Discuss to what extent (a + b)c = ac + bc is violated in machine arithmetic.
Error Propagation • Let xfl refer to the floating point representation of the real number x. • Since computer has fixed word length, there is a difference between x and xfl (round-offerror) and we would like to estimate the error in the calculation of f(x) : • Both x and f(x) are unknown. • If xfl is close to x, then we can use first order Taylor expansion and compute: Result: If f’(xfl) and Dx are known, then we can estimate the error using this formula