1 / 24

Data Management

Data Management. Provide quality data and data products to our users as quickly as possible. Becky Olson Database Administrator Web programmer. Web Presentation. How to give our users access to all our data? Correction files Data products Quality control codes. New design.

urielle-salinas
Download Presentation

Data Management

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Management Provide quality data and data products to our users as quickly as possible Becky Olson Database Administrator Web programmer Becky Olson/UVB Radiation Project

  2. Web Presentation • How to give our • users access to • all our data? • Correction files • Data products • Quality control codes Becky Olson/UVB Radiation Project

  3. New design Changing only Climatalogical Network

  4. New categories * *

  5. Choose data type first, then location

  6. All data will be viewed as a plot with option to download plot or actual data

  7. Database Design Have a 3 minute raw voltage come in for every site for every hour of every day. Currently operating 30 sites, 90 instruments. How to manage that volume of data and provide quick access to our users through our web page and by data requests. Using the Oracle database. Becky Olson/UVB Radiation Project

  8. Database Design- Channel Data Oracle database Key access fields: site_code,date, or serial number Store the channel data in temporary tables until the quality Control process has completed. Then once a month, move previous month into our production database. Also store all calibration files as well as a history of heads at the sites, and geographic information about a site.

  9. Database Design- Documentation data quality_control_codes- list of our current quality control code, with rules and description *people_info- current contacts for our UVB program *requestlog_info- history of people, and the data they have requested service_tracking- historical record of our sites

  10. Data Capture and Quality Have a 3 minute raw voltage come in for every site for every hour of every day. Currently operating 30 sites, 90 instruments. How to get the data from the instruments at the sites and verify its quality and put it in our database tables? Becky Olson/UVB Radiation Project

  11. Data capture and quality controlPolling process

  12. Data capture and qualityPolling process

  13. Data capture and qualityPolling process

  14. Data capture and qualityQuality Control flags: auxiliary

  15. Data capture and qualityQuality Control flags: Channel

  16. Data capture and qualityQuality Control flags: Channel/Gap Records Quality Control flags: Descriptive

  17. In conclusion: Recognize the dynamic nature of our project and be adaptable to the constant changes that will occur in our software and database design. We will try to predict what our users want and what the technology will be, but allow the capability for change. Becky Olson/UVB Radiation Project

More Related