1 / 13

USGS/EDC Archive Preservation Status An Update Stuart Doescher, USGS (Cheryl Greenhagen)

USGS/EDC Archive Preservation Status An Update Stuart Doescher, USGS (Cheryl Greenhagen) W GISS-18 September 2004 Beijing, China. TM and MSS Archive Conversion System (TMACS). Operations: 1992 to 2002. Number of High Density Tapes (HDT) transcribed: 32,300 Landsat MSS, TM

plato-coleman
Download Presentation

USGS/EDC Archive Preservation Status An Update Stuart Doescher, USGS (Cheryl Greenhagen)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. USGS/EDC Archive Preservation Status An Update Stuart Doescher, USGS (Cheryl Greenhagen) WGISS-18 September 2004 Beijing, China

  2. TM and MSS Archive Conversion System (TMACS) • Operations: 1992 to 2002. • Number of High Density Tapes (HDT) transcribed: 32,300 • Landsat MSS, TM • Number of DCRSi Cassette Tapes (DCT)s output: 3,200 • Mostly in Telemetry stream format (Frame sync required to read)

  3. WBVT summary • Operated: April 1999 - May 2002 • Number of HDTs converted: 21,300 • Number of Digital Linear Tape (DLT 7000) generated: 143 and an additional 143 as backup • Format: BSQ ( MSS-X) • "orphan" data (no DIAT / SLAT) : 172 HDTs • Bad input tapes: 476 (even with cleaning & baking).

  4. SPOT summary • Operated: late April 2000 - February 2002 • Number of HDTs converted: 6,100 • Number of DLT 7000 tapes generated: 901 • Format: MDA's FRED

  5. Landsat Archive Conversion System (LACS) • Planned Operations: June 2004 – June 2006 • Input: About 6000 HDTs, 3500 DCTs, plus current Landsat 5 data • Output: ~ 600 tapes of "formatted" data and ~ 700 tapes of "raw" data on 9940B. (200G/tape) • Format: BSQ

  6. Landsat Archive Conversion System (LACS) • Ingest from DCRSi Cassette Tapes (DCTs) • Multispectral Scanner Archive format (MSS-A) data • Multispectral Scanner Product format (MSS-P) data • Thematic Mapper Archive format (TM-A) data • Thematic Mapper raw (TM-R) data • Ingest TM-R data from High Density Tapes (HDTs) • Archive the data to a high-density computer-compatible digital tape: 9940B • Generate and archive browse imagery • Generate inventory information for the new archive.

  7. Data to be converted

  8. Digital Archive LTS LDBS-I LACS Transcription System LACS Database System – Part I Landsat Production Database LDBS-II LACS Database System – Part II Metadata Handler LDB LACS Database LTTAS LACS Tape Tracking and Assessment System TLS Tape Labeling Software LBGS LDBS-III LACS Browse Generation System LACS Database System – Part III Earth Explorer DORRAN NLAPS LACS Context Diagram Scene Tables HDTs, DCTs Job Histories, Metadata LDS LACS Duplicator System Interval Tables, Scene Tables, 9940B Tables Updated Tables Label Information Historic Scene Info Master 9940B Updated Metadata Metadata Label Information Working Copy 9940B All LDB Info Browse Metadata Working Copy 9940B Transcription Operators Assessment Operators Production Control Updated Tables Browse Tape EE Browse Images EE Browse Images Order Information 9940B Tapes

  9. Landsat Archive Conversion System (LACS) • Started Operations: June 2004 • Progress to Date: • Current Landsat 5 Data: 252 Intervals (5807 scenes) • DCTs: 60 Tapes (508 Intervals, 9669 scenes) • HDTs: 5499 Tapes (534 Intervals, 10073 scenes) • This is 25,549 of 960,763 scenes in 2 ½ months • Extrapolates to 94 months or 7.8 years

  10. LACS Status • Running 3 LTS strings: (LACS Transcription Subsystem) • LTS1: Current Landsat 5 data only (acquired at EDC, or received on DLT from Australia.) • LTS2: DCT Input. ( less than 1 shift a day - because LIS can't keep up) • LTS3: HDT Input. (1 to 2 shifts per day.) The HDTs are always cleaned before they are used. Many of the HDTs are baked. Some of the HDTs are tried many times before success. We try both drives; sometimes we have the tape cleaned again; sometimes we have the engineer adjust the HDTR.

  11. LACS Status • Running 1 LIS string: (LACS Integration Subsystem) on the same box as LTS1. • Performs the Automated Cloud Cover Assessment (ACCA) and Browse Generation for all 3 LTS strings. • The LIS is the bottleneck. (as expected) • LIS gives priority to current Landsat 5 data. • Plan to port the LIS to Linux and run on 3 Linux systems to relieve the bottleneck. • Hope to get the LIS port done late this calendar year • Hope approximately triple our throughput

  12. Landsat Archive Conversion System (LACS) • Issues / Problems: • Some tapes in very poor condition • Performance of ACCA and Browse Generation needs improvement • Plans: • Boost performance of ACCA, Browse Generation: • Port to Linux • Run on Multiple Linux Systems

More Related