1 / 34

Some Metrological Aspects of Ordinal Quality Data Treatment

Some Metrological Aspects of Ordinal Quality Data Treatment. *Emil Bashkansky Tamar Gadrich ORT Braude College of Engineering, Israel ENBIS-11 Coimbra, Portugal, September 2011, 11:50 – 13:20. Presentation Outline-stage I. Presentation Outline-stage II. Presentation Outline-stage III.

howie
Download Presentation

Some Metrological Aspects of Ordinal Quality Data Treatment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Some Metrological Aspects of Ordinal Quality Data Treatment *Emil Bashkansky Tamar Gadrich ORT Braude College of Engineering, Israel ENBIS-11 Coimbra, Portugal, September 2011, 11:50 – 13:20

  2. Presentation Outline-stage I

  3. Presentation Outline-stage II

  4. Presentation Outline-stage III

  5. Examples of ordinal scale usage

  6. Why revision of MC for ordinal measurements is needed? * ISO/IEC Guide 99: International vocabulary of metrology — “Basic and general concepts and associated terms (VIM)”

  7. Error description Classic continual: The probability density function pdf (Y/X) of receiving result Y, given the true value of the measurandX , in it's simplest form: pdf (Y/X) = Normal(X+bias, ) Ordinal: The conditional probabilities that an object will be classified as level j, given that its actual/true level is i.

  8. Error -free ordinal measurement

  9. Error –binary case

  10. Some examples

  11. Uncertainty-general case • The likelihood that a measured level jis received, whereas the true level is i

  12. Uncertainty matrix- binary case

  13. Inaccuracy- Error matrix :

  14. Repeatability Blair & Lacy (2000)

  15. Repeatability - the expected cumulative frequency of data/items classified up to the k-th category, given that its actual/true level is i

  16. ORDANOVA:DECOMPOSITION OF TOTAL DISPERSION AFTER MEASUREMENT/CLASSIFICATION - the expected cumulative frequency of items belonging up to the k-th category after measurement

  17. Reproducibility

  18. Some definitions - conditional joint probability of sorting the measured object to the a-th level by the first MS (called A), and the b-th level by the second MS (called B), given the actual/true category i

  19. A & B MSs classification matrices

  20. Joint probability matrix pi- the probability that an object being measured relates to category i, ( ) - the joint probability of sorting the item as a by the first measurement system (A) and b by the second measurement system (B).

  21. Modified Kappa measure of Agreement When a half of all items are correctly classified:

  22. 1. Reproducibility - reference standard is known

  23. 2. Reproducibility - reference standard is unknown

  24. Binary case example

  25. Typical relation between quality level and commonly used chemical/physical features for yellow-flesh nectarines

  26. Ternary scale example (fruit quality classification) weighted total kappa equals 0.734

  27. Repeated measurements-general case Let's consider arbitrary ordinal scale with m categories and suppose, that nrepeated measurements of the same object were performed resulting in vector: (n=n1+n2+…+nm)

  28. Repeated measurements-general case The maximum likelihood estimation must be made in favor of such, most plausiblei , that maximizes the scalar product:

  29. General case example-single measurement

  30. General case example: after 10 repititions

  31. SUMMARY On an ordinal measurement scale the essential for evaluating the error, repeatability and uncertainty of the measurement result base knowledge must be the classification/measurement matrix. Given this matrix, authors introduced a way to calculate the classification/measurement system’s accuracy, precision (repeatability & reproducibility) and uncertainty matrix. In order to estimate comparability and equivalence between measurement results received on an ordinal scale basis, the modified kappa measure is suggested. Three of the most suitable usages of the measure were thoroughly analyzed. The advantage of the proposed measure vs. the traditional one lies in the fact that the former follows the superposition principle: the total measure equals the weighted sum of partial measures for every ordinal category. As it is well known, repeated measurements may improve the quality of the measurement result. When decisions are ML based, one can find how many repetitions are necessary in order to achieve the desired accuracy level using the algorithm suggested by the authors,.

  32. Thank Youfor your attention! E-mail: ebashkan@braude.ac.il

More Related