1 / 24

Software Validation in Measurment&Testing

Software Validation in Measurment&Testing. Roman Flegar , Tanasko Tasić. Speakers details. Roman Flegar, B.Sc Tanasko Tasić, M.Sc Metrology Institute of The Republic Of Slovenia Laboratory for IT in Metrology Email: roman.flegar@gov.si tanasko.tasic@gov.si. LITM in few words.

ramona
Download Presentation

Software Validation in Measurment&Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Software Validation in Measurment&Testing Roman Flegar, Tanasko Tasić

  2. Speakers details • Roman Flegar, B.Sc • Tanasko Tasić, M.Sc • Metrology Institute of The Republic Of Slovenia • Laboratory for IT in Metrology • Email: roman.flegar@gov.si tanasko.tasic@gov.si

  3. LITM in few words • Key activities: • software validation • software in legal metrology • measuring systems under legal control • Participating in several international projects and working groups: MID-Software, Welmec 7.1, OIML TC5/SC2, … • Accreditation in Q2 2004

  4. Agenda • Introduction & Validation requirements • Case study • Background • Validation plan • Practical problems • Software separation • Testing Interface • Automation • Conclusions

  5. Software - The most significant part of MI Responsibilities: Control of MI Data acquisition Processing & Analysis Storage Visualisation Communication HARDWARE SOFTWARE Software Hardware/Software Time

  6. Legal metrology instruments Metrological regulations: National International Harmonised EU directives OIML recomendations Testing & Calibration laboratories ISO/IEC 17025 ISO/IEC 45004   Software validation SOFTWARE

  7. Future guidance documents • Legal metrology: • Fifth EU framework project MID-SOFTWARE – cover Measuring instruments directive • OIML TC5/SC2 “software” • Scientific, Measurement and Testing metrology: • Fifth EU framework project SoftTools – Metronet • EA – EUROMET – EUROLAB – EURACHEM guideline for use IT within testing laboratories

  8. What is validation • Is function “fit for purpose”? • Case: Calculation of fuel price, USA Price [€] Modified Price Function Price = c x Quantity 45 € 30 € Customer is extra charged 15 € Quantity [l] 10 l 20 l 30 l

  9. Case study

  10. Automated level gauge Measurement instrument under legal control OIML R85 Output: liquid level in tanks Used for volume calculation ALG Case study S(DV,Dh) hl V = S(SV,hl)

  11. ALG ALG ALG Case study Big probe Fixture Single probe hl

  12. Case study • Questions: • Can we trust measured level from big probe? CorrectedOffsetLL=(OffsetLL + OffesetC)(1+(T – Tref)* hLL = OffsetLL + CorrectedOffsetLL • Can we trust calculated volume? Si = {h, V} k = [ S2(V) – S1(V)] / [ S2(h) – S1(h)] Vg = V(hLL) = k * (hLL - S1(h)) + S1(V)

  13. Validation plan • Definition of objectives • Analysis of measuring instrument • Test environment setting • Pre-test phase • Selection of validation method • Evaluation of results • Conclusion

  14. V h h V Practical problems • Real time processing • Future updates of software Desktop PC Industry PC Desktop PC Big probe simulator Commander End user terminal 5 minutes response time

  15. Program Data Parameters OS DLL LIB EXE DLL LIB EXE GUI DB WWW Legal Relevant Program Data Parameters Software separation • Idea from legal metrology [MID - Software] • Separation of legal/non-legal relevant software functions and parameters

  16. h V V h V h Software separation • IDEA: separate functions which are going to be validated into separate library • Advantages: future updates & testing interface = + Commander CommanderDriver.dll CommanderDriver.dll BigProbe.dll

  17. V h Testing Interface Testing interface • Built by customer • Command line calling of functions in DLL • Advantages: automation & same flow like in customer software Output results Input parameters BigProbe.dll

  18. Validation with reference software 2 main functions: Liquid height Neto volume 5 sub functions How to validate reference software? Reference software Input parameters Reference software Software under test Compare &Evaluate

  19. A lot of different situations to test: Temperature Density Levels of gasoline & water Probe and tank configuration Automation & Reference software in LabView 6.1 SIMULATOR Automation of testing Input parameters BigProbe.dll Configuration DLL INI TXT Output results TXT

  20. Automation of testing BigProbe.dll DLL Configuration INI Output results TXT Input parameters TXT

  21. Reference sets: Input parameters Configurations Reference output results: Future validation of new DLL versions Performance of test Input parameters Configuration INI TXT INI TXT R001 INI R001 TXT Output results Reference sets TXT TXT R001 TXT

  22. SIMULATOR Performance of test Reference Configurations Reference Output results INI INI TXT R001 INI TXT R001 TXT Reference sets Reference Input parameters TXT TXT R001 TXT Comparation New version BigProbe.dll Output results SUT TXT DLL TXT TXT

  23. Conclusion • Validation: level, volume • Software separation • Testing interface • Reference software • Reference data sets • Automation

  24. Questions & Answers

More Related