ASPRS Panel on USGS Progress on Remote Sensing Calibration and Quality Assurance

1. ASPRSPanel on USGS Progress on Remote Sensing Calibration and Quality Assurance Commercial Remote Sensing (CRS) Characterization, Calibration, Verification, and Validation (C2V2) May 26, 2004

2. Background • USGS Geography Discipline mission is to provide quality cartographic information for the United States • Responsible for calibration of airborne film mapping cameras • Recognized as a Center of Excellence by the National and International community • 1952 - Multi-collimator built by National Bureau of Standards • 1973 – USGS Optical Science Lab begins camera calibration • 2000 - ASPRS panel of experts recognized the need for digital camera calibration

3. Background (cont.) • 2002 - USGS HQ Commercial Imagery Project established, Dr. Lee pushing calibration requirements, the project is currently called CRS C2V2 Project • 2003 – USGS EROS Data Center (EDC) digital camera calibration cage and software established • 2003 – USGS w/NASA Stennis perform in situ evaluation of digital mapping sensor vendors • 2003 – CEOS/ISRPS Joint Task Force on Calibration/Validation, developed Cal Val Terms of Reference • 2004 – USGS EDC established an in situ range to compare/characterize digital sensors

4. ASPRS 10 Year Forecast • “…Industry members hold an optimistic view of the future industry growth, estimating that it will increase by 9 - 14% per year.” • Estimated Aerial Sales (approx.): 2004 - $2B, 2010 - $4B • Estimated Space Sales (approx.): 2004 - $1B, 2010 - $2B • “The development of new analytic methods and new geospatial technologies will lead to future growth, … Data customers especially desire higher resolution and improved positional accuracy.” • “Federal government policies . . . have had a major influence over over the development of the market for remote sensing data, new technologies and other applications within the geospatial industry.”

5. C2V2 Project Mission and Tasks • Support government & science user mapping mission requirements • Support a broad range of airborne & satellite CRS data sources • Systems and sources must be adequately characterized so the data can be reliably used • Analog Camera Calibration - OSL Operations and Maintenance • Perform analog film camera calibration and certification • Digital Camera Characterization and Calibration (Lab and In Situ) • Partner with Federal, State, and Local agencies, industry, and academia in understanding digital camera cal val processes • Expand and develop calibration laboratories, in-situ test ranges, methodologies, and develop cal/valsoftware • Continue data access and procurement of CRS data sets • Remotely Sensed Data Procurement • Procurement, and data sales services and provide system level evaluation of the contractor products

6. C2V2 Project Mission and Tasks • Remotely sensed data, the quality of the data, and utility of data must be established for the community and The National Map • System Characterization/Calibration and Product Verification/Validation • Provide independent system characterization, product validation, and utility/application development/assessment of satellite and aerial based mapping sensors and products • Create a coordinated center of excellence for Land Remote Sensing Data within USGS and the community • Instrumentation and In Situ Calibration Range Support and Analysis • Provide instrumentation and analysis support in accordance with established interagency agreements with NASA, NOAA, USDA, and other USGS groups. • Analyze, establish, maintain in-situ test ranges

7. C2V2 Project Mission and Tasks • Digital Imagery Policy and Standards Development • Partner with Federal, State, and Local agencies, industry, and academia in developing, testing, and implementing advanced techniques, policies, and standards • Develop digital camera calibration policies and standards • Support The National Map Quality Assurance Program • Provide support for the development, transition, and implementation of system data quality requirements and applications for TNM • National remote sensing policy in support of the civil community • Combination of System Characterization and Policy Development Tasks • Support the CRS Space Policy Implementation Project with respect to C2V2 and Joint Agency Commercial Imagery Evaluation (JACIE) • Calibration support for future systems; i.e., LDCM

8. C2V2 Team • Phil Rufe/Mike Duncan/Tim Saultz • Mid-Continent Mapping Center • George Lee • Western Region Geography • Greg Stensaas, Ron Parsons, Jon Christopherson • EROS Data Center and SAIC • Jeff Sloan • Rocky Mountain Mapping Center • Jay Storey • Eastern Region Geography • NASA Stennis • Vicki Zanoni

9. Lack of knowledge about calibration procedures different system designs different procedures used from manufacturers Complete system has to be considered multi-sensor system installations (i.e. GPS/inertial components) calibration process under review laboratory calibration and calibration by users/certified sites using test field calibration procedures Establish test sites for evaluation of digital camera products Goal: Does data meet contract requirements and standards USGS Research of Digital Sensors

10. Digital Sensor Calibration Assessment • Development of policy and standards required • Development and testing of procedures required • In situ calibration testing • Self-calibration solution to increase flexibility • Calibration evaluation software, training/documentation necessary • Recommendations on calibration flight and process design • Assess geometry, radiometry and spatial quality • Assess stability and repeatability aspects • Perform laboratory comparison • Processing effects on data products; re-sampling

11. Calibration Implementation Plan • The USGS understands the importance of national data completeness, consistency, and accuracy • Characterization and calibration is key to consistent and accurate data • To ensure quality of digital mapping data, we must: • Develop policies and standards • Standardize Government contract Statements of Work • Devise and implement quality assurance procedures • Promote process certification criteria for providers • Work with Federal and State organizations via ASPRS, digital sensor calibration consortium, and Mapping Partner Offices

12. EuroSDR network Digital Camera Calibration briefing • European Spatial Data Research • 18 country network pushing for digital camera calibration • Concerted integrated effort • Michael Cramer (Project leader), Institute for Photogrammetry (ifp) – University of Stuttgart • “There is a definite need to deal with calibration tasks” • “Does standard calibration fulfil digital sensor needs?” • International community has the same questions and issues with digital system calibration and product validation

13. JACIE • Joint team - NASA, NGA, and USGS • Formed to leverage government agencies' CRS data characterization capabilities • Each agency purchases/uses commercial imagery to support its research and applications. Data accuracy and utility assessment is critical. • Analysis of IKONOS, SPOT, QuickBird, L-7, ORBVIEW • Comparison with high resolution aerial data • USGS established partnerships with local governments to evaluate usefulness and application of JACIE imagery • Results: Presented at JACIE workshop, USGS Open File Report, NASA and NGA reports, JACIE journal papers, • 8-10 November 2004 - JACIE 2004 Workshop at USGS HQ in Reston, VA

14. Consortium Development Strategy • Establish a North America Digital Sensor Data Consortium • Include Federal Civil and Military agencies, academia, and industry • Use ASPRS and CEOS groups for support • In close cooperation with EuroSDR and other international activities • Use CEOS/ISPRS Forum and Task Force • Panel on digital sensor calibration and product validation standards • Panel on establishment of international test ranges • develop range standards and available ranges

15. Contact Information • Interested • in the project tasks • in supporting a digital sensor calibration consortium • Contact USGS EROS Data Centerhttp://edc.usgs.gov/ Gregory L Stensaas stensaas@usgs.gov (605) 594-2569