260 likes | 415 Views
Idaho National Laboratory Experimental Program to Support Validation of CFD Codes. Hugh M. McIlroy Jr 2008 RELAP5 International User’s Seminar November 19, 2008. Objectives. INL Policy Review Lab Notebooks QA requirements Uncertainty Analysis AIAA Guide Other sources
E N D
Idaho National Laboratory Experimental Program to Support Validation of CFD Codes Hugh M. McIlroy Jr 2008 RELAP5 International User’s Seminar November 19, 2008
Objectives • INL Policy Review • Lab Notebooks • QA requirements • Uncertainty Analysis • AIAA Guide • Other sources • Generally accepted principles • NGNP VHTR LP standard problem overview
INL Policy on Lab Notebooks • MCP-2875 • Accurate records • Instruction and Best Management Practices
INL Policy on Lab Notebooks • MCP-2875 • Accurate records • Instruction and Best Management Practices • Registered through EDMS • Policy on entries
Lab Notebook Entries • Sufficiently complete to allow duplication by a skilled researcher • Experimental Plans • Experimental and theoretical information • Data • Interpretations • Printouts, photographs, charts • Reference location of archival recording media (computer disks, backup tapes, hard drives, etc.)
INL Policy on Lab Notebooks • MCP-2875 • Accurate records • Instruction and Best Management Practices • Registered through EDMS • Policy on entries • Protection as required
INL Quality Assurance Requirements for Research and Development • LRD-13010 • Quality • A condition achieved when an item, service or process meets or exceeds requirements • Quality Assurance • All actions that provide adequate confidence that quality is achieved • Procedures • Were procedures in place • Were procedures used
INL Quality Assurance Requirements for Research and Development • Application rigor depends on type of research and quality level • Normally basic or applied research
Typical QA Requirements for Basic and Applied Research • Defined organization • Procurement IAW QL-standards • Training and qualification of personnel • Logistics and property management • Dealing with suspect/counterfeit items • Assessments and quality improvements • Document control • Design control
Typical QA Requirements for Basic and Applied Research • Peer reviews • Work process/fabrication/assembly control • Material research, selection and control • Software development and use • Test control • Data reduction and analysis • Measuring and test equipment • Records management
Other Issues • Calibration • PDD-13450 Calibration and Data Integrity • Establishes calibration requirements • LWP-13455 Control of Measurement and Test Equipment • Program for all “portable”, non-rad MT & E • MCP-6303 Calibration of Facility Process and Control • Intended to cover fixed, installed instruments • QA initiated issue regarding application to MT&
Calibration and Data Integrity (PDD-13450) • Proper selection and use of MT & E • Type • Range • Accuracy • Tolerance • MT & E calibrated and controlled • Only MT & E with current calibration used • Proper handling and storage
Other Issues • Ethics • Committee on Science, Engineering, and Public Policy, National Academy of Sciences National Academy of Engineering, Institute of Medicine, National Academy Press, Wash DC, 1995, 2nd Ed. • Minimize influence of individual bias • Produce results others can easily reproduce • Use generally accepted methods • Clearly identify methods used to gather and analyze data • Continuously scrutinize for possible errors
AIAA Requirements for Experimental Data • AIAA G-077-1998 “Guide for the Verification and Validation of Computational Fluid Dynamics Simulations” • Joint design by experimentalists and code developers • Work together throughout the project • Experiment must capture essential flow physics, modeling data, initial conditions and boundary conditions required by the code • Experiment must emphasize synergism between computational and experimental approaches • Independent results • Hierarchy of experimental measurements of increasing difficulty • Uncertainty analysis must delineate and quantify systematic and random errors by type
Uncertainty Analysis • No specific technique prescribed • Journal policy statements in • ASME Journal of Fluids • ASME Journal of Heat Transfer • International Journal for Numerical Methods in Fluids • AIAA Journal • ASME Journal of Fluids Engineering
General Journal Principles • Experimental uncertainties should be set at the scale at which comparisons (validation) will be attempted • Uncertainties must address total error • Precision (random) • Bias (fixed, systematic) • Bias can come from • Calibration errors • Data acquisition errors • Data reduction errors • Test technique errors, etc.
Workshops, Conferences, Schools, Seminars • INL V&V Workshop July 08 • Frederick Joliot and Otto Hahn Summer School, Aix-en-Provence, France, Aug-Sep 08 • XCFD4NRS Grenoble, France, Sep 08
Other Sources • International Integral Experiments Databases in Support of Nuclear data and Code Validation • See Briggs, J. B., Gado, J., Hunter, H., Kodeli, I., Salavatores, M. and Sartori, E., 2002, “International Integral Experiments Databases in Support of Nuclear Data and Code Validation,” J. Nuc Sci and Tech, Suplmnt 2, p 854.
Other Sources • International Criticality Safety Benchmark Experiments Project Handbook (ICSBEP) principles • Describe data handling method • Specification of corrections, if any • Specific handling of technological uncertainty • Estimation of biases • Compliance with formal requirements • Presentation of sample calculations
Generally Accepted Principles • Defined geometry • Description of important physical phenomena • Scalable to full-size • Measurements that can be compared to code • Description of dominant physics • Description of data reduction methodology • Comprehensive uncertainty analysis • Adherence to Quality Assurance requirements
INL NGNP VHTR Lower Plenum Experimental Program • Conducted at Matched Index-of-Refraction Lab • Documented Design • Documented geometry (designed and as-built) • Scaled • Instrumented (temperature, flow rates, position, etc.) • Controlled • Repeatable • Documented measurement and data reduction techniques • Uncertainty Analysis • Quality Assurance
Matched-Index-of-Refraction Facility (MIR) Located at the INL Research Center INL Engineering Demonstration Facility (IEDF) Bldg IF657 Bays E-1 & E-2 Idaho Falls, Idaho (208) 526-6176 email Hugh.McIlroy@inl.gov website http://www.inl.gov/physics/mir/