390 likes | 502 Views
Datum-shift, error-estimation and gross-error detection when using least-squares collocation for geoid determination. by C.C.Tscherning Department of Geophysics,.
E N D
Datum-shift, error-estimation and gross-error detection when using least-squares collocation for geoid determination. by C.C.Tscherning Department of Geophysics, C.C.Tscherning, University of Copenhagen, 2005-01-13 1
Collocation Preconditions Using LSC for gravity field modeling, initial hypothesis: • model (the approximation to the anomalous potential) is associated with a geocentric reference system, • and that the zero and first order spherical harmonic coefficients are all zero. • The data to be used to determine the model must then also refer to this system, or have to be transformed to the system. A well known example is height anomalies determined as the difference between ellipsoidal heights from GPS and normal heights determined from levelling. C.C.Tscherning, University of Copenhagen, 2005-01-13 2
Levelling datum error Error due to the fact that the zero levels have been fixed by a convention and not through a physical measurement. We will denote the error for a particular system by N0. In geodetic practice this does not cause problems, because height differences are the quantity of interest. (In oceanography, however, the absolute heights are important.) C.C.Tscherning, University of Copenhagen, 2005-01-13 3
Position errors: The ellipsoidal heights may also suffer from errors due to the fact that most positions are determined differentially, i.e. with respect to a set of reference points. If these reference points are in a non-geocentric system such as NAD83 a conversion to a geocentric system must be done, see e.g. (Smith and Milbert, 1999). This conversion is generally given as a 7-parameter similarity transformation. C.C.Tscherning, University of Copenhagen, 2005-01-13 4
Datum shift estimation: The parameters of this kind of transformation are easily estimated if we have two sets of 3-dimensional positions either the Cartesian coordinates or latitude, longitude and ellipsoidal height, using a least-squares adjustment. C.C.Tscherning, University of Copenhagen, 2005-01-13 5
DISAGREEMENT: When a purely gravimetric quasi-geoid is compared to a surface constructed from height anomalies derived from GPS and levelling one will often note that the surfaces disagree, GPS/Lev. geoid Gravimetric geoid Ellipsoid C.C.Tscherning, University of Copenhagen, 2005-01-13 6
Datum-shilf/Bias-tilt: Frequently they are related through a bias or tilt. Close agreement by estimating and applying the bias and the tilt. The 3 quantities (height bias, tilt in East and West) corresponds to a 3-parameter datum shift using a translation of the center of the reference ellipsoid (Δx, Δy, Δz), see e.g. Torge (2001). C.C.Tscherning, University of Copenhagen, 2005-01-13 7
Parameters through adjustment: • A simple adjustment used for the determination of the parameters will in general be sufficient to obtain an agreement between the gravimetric geoid and the height anomalies. • The gravimetric geoid has been used as an interpolator to construct a height reference surface. C.C.Tscherning, University of Copenhagen, 2005-01-13 8
Physical correlation: • This procedure does not take into account that the two data types are physically correlated, so that both the gravimetric geoid and the height reference surface may be improved. • A 3 or 7-parameter adjustment does not take into account the spatially varying quality of the gravimetric geoid or the spatial distribution of GPS/levelling derived height anomalies. C.C.Tscherning, University of Copenhagen, 2005-01-13 9
Use Collocation: • Correlations may be accounted for using LSC • LSC can be used to estimate a gravimetric geoid, a corresponding height reference surface and N0 or datum-shift parameters. • The reference surface may be used to convert GPS ellipsoidal heights to normal heights in the used height system. C.C.Tscherning, University of Copenhagen, 2005-01-13 10
Accounting for Errors: • Errors in the data must be taken into account. • In many cases are the errors not known, and the data may include gross-errors. • The error estimates of leveled heights are generally only known as the error of the height differences relative to set of higher order bench marks. • (See http://www.ngs.noaa.gov/GEOID/GPSonBM99/format99.txt ). C.C.Tscherning, University of Copenhagen, 2005-01-13 11
GPS errors: • For ellipsoidal heights determined using GPS the error estimates available are also relative errors. • These heights are frequently in error due to erroneous identification of the reference point or the antenna height. C.C.Tscherning, University of Copenhagen, 2005-01-13 12
Error detection: • LSC filters the data . • We may as done in geodetic network adjustment inspect the residuals by using LSC for the prediction and comparison with the data used to determine the model. • Large difference – possible gross error. Outlier Predicted C.C.Tscherning, University of Copenhagen, 2005-01-13 13
Bias must be removed/estimated: • This requires that we have unbiased estimates, which we will not have due to the N0-problem and the possibly non-geocentric datum. • Consequently we have to estimate N0 and the datum shift parameters simultaneously with the determination of the model. C.C.Tscherning, University of Copenhagen, 2005-01-13 14
Statistical homogeiety: • We should have a statistically homogeneous data distribution. Unfortunately this is often not true, but there are anyway possibilities for using the residuals for gross-error detection. • In the following the theory will be briefly reviewed without proofs. • Then the theory is exemplified using the New Mexico test data plus GPS/levelling height anomalies from the area obtained from http://www.ngs.noaa.gov/GEOID/GPSonBM99/gpsbm99.html . C.C.Tscherning, University of Copenhagen, 2005-01-13 15
Parameter and error-estimation Observations: • Parameter is equal to N0 • Ai = 1 • for all values of i which are associated with height anomalies . C.C.Tscherning, University of Copenhagen, 2005-01-13 16
Parameter estimate • Then an estimate of T and of the parameters X are obtained as • where W is the a-priori weight matrix for the parameters (Generally the zero matrix). C.C.Tscherning, University of Copenhagen, 2005-01-13 17
Error-estimates • The associated error estimates are with • the mean square error of the parameter vector • and the mean square error of an estimated quantity . C.C.Tscherning, University of Copenhagen, 2005-01-13 18
Datum shift and N0 estimation. GEOCOL estimate a gravity field model and components of a 7-parameter similarity transformation datum-shift If parameters are (x, y, z) we have (in spherical approximation) C.C.Tscherning, University of Copenhagen, 2005-01-13 19
N0 estimation • Height system bias may be determined. • The determination of a datum-shift requires data which covers a large area, see http://cct.gfy.ku.dk/geoidschool/figure1.jpg • If the area is not large, this will be reflected in large error estimates . • This will be illustrated using 2920 gravity data and 20 height anomalies from the New Mexico test area. C.C.Tscherning, University of Copenhagen, 2005-01-13 20
Height-anomalies • Height anomalies obtained from ellipsoidal heights, h, determined by GPS and orthometric heights, H, in the North Americal Vertical Datum 1988 (NAVD88) converted to normal heights, N*. http://cct.gfy.ku.dk/geoidschool/nmzeta83.dat • Ellipsoidal heights were available both in the continental North American Datum 1983 (NAD83) and the global ITRF94 datum. • The contribution from EGM96 and residual topography was subtracted.http://cct.gfy.ku.dk/geoidschool/nmzeta.rd C.C.Tscherning, University of Copenhagen, 2005-01-13 21
Smoothing C.C.Tscherning, University of Copenhagen, 2005-01-13 22
Exercise D1. Predict reduced height anomalies http://cct.gfy.ku.dk/geoidschool/nmzeta.rd from reduced gravity anomalies, http://cct.gfy.ku.dk/geoidschool/nmfa_egm96_tc.dat See job-file http://cct.gfy.ku.dk/geoidschool/nmlscfa3.job C.C.Tscherning, University of Copenhagen, 2005-01-13 23
Prediction result Good agreement But large bias ! C.C.Tscherning, University of Copenhagen, 2005-01-13 24
Exercise D2: Datum-shift Add 20 residual height anomalies http://cct.gfy.ku.dk/geoidschool/nmzeta.rd to the gravity anomalies and determine a new model together with a 3-parameter translational datum-shift or a height bias shift, respectively, see http://cct.gfy.ku.dk/geoidschool/nmlscfaz3.job C.C.Tscherning, University of Copenhagen, 2005-01-13 25
Results of datum shift determination C.C.Tscherning, University of Copenhagen, 2005-01-13 26
Results • Large error-estimates. • We can not expect better results using data from such a small area. • Formally the error of the estimated quasi-geoid was improved from 0.07 m to 0.02 m when only N0 was determined, • see http://cct.gfy.ku.dk/geoidschool/figure2.jpg • http://cct.gfy.ku.dk/geoidschool/figure3.jpg • but it should be interpreted as the improvement of the height anomaly differences. C.C.Tscherning, University of Copenhagen, 2005-01-13 27
Verification of error-estimates and gross-error search. • The detection of possible gross-errors using the differences between observed values and values calculated using LSC may applied • Using GEOCOL we may compute the estimates of the data used as input as well as the error-estimates. • http://cct.gfy.ku.dk/geoidschool/nmlscfae.job • These a-posteriori error-estimates will generally be smaller than the a-priori ("input") error estimates. The estimate of the error of the difference will then be the Gaussian sum of the a-priori error and the a-posteriori error. C.C.Tscherning, University of Copenhagen, 2005-01-13 28
Suspected gross-error • LSC will perform a filtering, so that if closely correlated data differ from a value of a specific measurement, a residual larger than the error estimate of the difference will occur. • If this is the case, we have found a "suspected gross error". • A threshold may be defined, equal to e.g. 3 times the error of the difference. • Now different factors play a role: we may have under or over-estimated the a-priori error. C.C.Tscherning, University of Copenhagen, 2005-01-13 29
Error-estimates • If the original data (supposed to be distributed in a regular manner in space) follow a normal distribution (may be verified from a histogram), • then the ratio between the absolute value of the difference observed minus predicted and the a-posteriori error estimate should follow a t-distribution. • If it does not do this, something is wrong. C.C.Tscherning, University of Copenhagen, 2005-01-13 30
Error-distribution • GEOCOL will as output bin the residuals divided by the a-posteriori error in 50 % intervals. • The percentages of values in each bin may then be used as an indicator of the quality of the a-priori error-estimate. C.C.Tscherning, University of Copenhagen, 2005-01-13 31
Smooth and non-smooth areas • Unfortunately the error-estimates does not take into regard that the error will be small in areas with a smooth gravity field and large where the gravity field varies much. • The inspection of residuals is therefore quite problematic, and should only be used with great caution. C.C.Tscherning, University of Copenhagen, 2005-01-13 32
Change of weight • Only residuals 5 or more times larger than the error of the difference should be regarded as gross-errors. • These values should not necessarily be deleted, but they should have assigned a much larger a-priori error, and the model should be determined again. C.C.Tscherning, University of Copenhagen, 2005-01-13 33
Errors • Number of suspected gross-errors as a function of a-priori data noise standard deviation and percentage of residuals divided by the a-posteriori error in 0.5 bins. • Suspected gross errors are defined as measurements where the residual is 4.0 times larger than the a-posteriori error (mgal). C.C.Tscherning, University of Copenhagen, 2005-01-13 34
T-distribution ? It seem like the residuals for a-priori-error 1.0 mgal is most close to a t-distribution. The error estimates of the height anomalies did also increase from 0.02 m to 0.05 m, which seems realistic. There are however too many (56) suspected gross-errors. One would normally expect below 1 %. The values of the differences observed minus predicted which are more than 6 mgal are: C.C.Tscherning, University of Copenhagen, 2005-01-13 35
Suspected Gross-errors C.C.Tscherning, University of Copenhagen, 2005-01-13 36
Conclusion • LSC may be used for datum shift determination or height system bias estimation by combining gravity data and height anomalies. • However, in order to determine reliable estimates of a datum-shift a large area is needed. This limits the applicability of the method. C.C.Tscherning, University of Copenhagen, 2005-01-13 37
Conclusion (II) • It is required that we know the error standard deviations of the data and that gross-errors have been deleted or down-weighted. • The validity of the a-priori error estimates as well as the occurrence of outliers may be investigated by comparing the a-posteriori determined differences between observed and predicted values with the error estimate of the difference obtained using LSC. C.C.Tscherning, University of Copenhagen, 2005-01-13 38
Conclusion (III) It C.C.Tscherning, University of Copenhagen, 2005-01-13 39