170 likes | 298 Views
The Netherlands SCIAMACHY Data Center. beysens@knmi.nl sdecerff@knmi.nl R.M.van.Hees@sron.nl vegtevd@knmi.nl. KNMI Colloquium Oct 17, 2002. Contents. Part 2 (Demos): Basics How to find a data file of interest How to extract specific parameters
E N D
The Netherlands SCIAMACHY Data Center beysens@knmi.nl sdecerff@knmi.nl R.M.van.Hees@sron.nl vegtevd@knmi.nl KNMI Colloquium Oct 17, 2002
Contents Part 2 (Demos): • Basics • How to find a data file of interest • How to extract specific parameters • How to process a data file into a higher product Part 1: • Introduction • Database & Storage • Available products • Future developments
Introduction • Project in Neonet program, KNMI & SRON cooperation • From December 1997 to December 2000 • Thesis work on experimental 3D client • Bridging project from April to June 2002 • New GO proposal submitted (for 2003 to 2005) • Now version Milestone 5 (September 2002) Created for researchers at KNMI, SRON, IVM, IMAU, RIVM, etc. Reason: • More flexibility • Faster data access • Test environment for new data processors NL-SCIA-DC maintained by KNMI and SRON on a best effort basis
Introduction (II): Functionality: • Access from any computer with an Internet connection and JRE • Three selection mechanisms: • Catalogue • Browse • Query • Data extraction (into ASCII or HDF format) • (Re) processing of selected data • Downloading of data via email or FTP (depending on size)
Database & Storage • Control databaseAll instrument-, processor-, interface- and user-information is stored here. • Meta databasesOrganized by data products (current size: 25 Gb) • Archive‘Raw’ data storage (level 1 and 2 files). (current size: GOME: 450 Gb, Sciamachy: 180 Gb)
Available Products (I) GOME archive is updated when new CD/Tapes arrive. Sciamachy data is automatically stored in archive as soon as it is send to KNMI via satellite and ftp. access is limited because of ESA data policy
Available Products (II) Query products Browse products
User Interface • Use NL-SCIA-DC via an application • Or use NL-SCIA-DC inside a browser via http://neonet.knmi.nl/neoaf • Communication to the Data Center is via the Internet • Data access permissions are user specific
Future developments Follow-up GO project (from 2003 to 2005), in which: • Focus on Sciamachy • Provide access to Sciamachy data as it is offered for Gome today • Processing and downloading of more than one data file simultaneously • Processing environment for new data products • User helpdesk • Website with calendar interface for (Dutch) level 2 products • Extend the data query capabilities Data from other instruments can be added, but are not planned (yet)
Questions? http://neonet.knmi.nl/neoaf/
Select Process Download Part 2: Demos • BasicsLogin, browser or applet?, changing font, user permissions • How to find a data file of interestSelection possibilities explained • Getting the data on a local machine • How to extract specific parameters • How to process a data file into a higher product • How to use the data extractors select process download
Basics: • Login Preferably using the Application (faster, more reliable) • settings User Changing font and password • User permissions What data access rights do you have? 0 = only login, 1 = +browse,2 = +download 3 =+process • Help Access to the user manual
Data Selection: • Catalogue • Organized by instrument/level/date • File level meta data information • Query • Search the database of level 2 products • Download the ASCII data selected. • Querying large sets takes time • Browse • Use ‘outline’ to plot the center points of the satellite and zoom-in before using ‘vector’ faster! • Use ‘Manipulate data’ to play with different layers • The ‘Legend’ shows the color mapping • ‘Query’ shows all available info on a pixel
Processing • Available Processors: • GOME NRT level 1b and 2 • GOME to GIF • Sciamachy NRT level 0, 1b/1c, and 2 • Sciamachy Offline level 2 • Purpose: • data selection (time, geolocation, channel, …) • Calibration (only Level 1b -> 1c) • PDS -> ASCII, HDF5/HDF4
Hints & tips Use the Query and Browse menu to find an area of interest. Download the corresponding file (L1 or L2) using Catalogue. Use the Query menu for extracting data on the full GOME data set; then visualize the ASCII result in (e.g.) IDL Use the ‘save image’ button to save your current browse image
Note: • Files in your FTP dir are removed after 1 day • Currently the download size limited to 200 Mbyte per file • Querying large sets (>year) takes time • Use ‘outline’ to plot the center points of the satellite and zoom-in before using ‘vector’ faster!
Questions? http://neonet.knmi.nl/neoaf