1 / 8

ASDC LATIS Archive Status Currently 38 million files and 782 TB

sebastian
Download Presentation

ASDC LATIS Archive Status Currently 38 million files and 782 TB

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

    1. 1 ASDC LATIS Archive Status Currently +38 million files and 782 TB

    2. 2 StorNext Archive Jan. 18 – May 28, 2007

    3. 3 File retrievals via daacget May 1-28, 2007

    4. 4 Why the transition from AMASS to StorNext? StorNext is the next generation product that replaces AMASS. ASDC implemented AMASS in LATIS 10 years ago along with the ECS to leverage compatibility and utilize lessons learned. AMASS supported by vendor for bug fixes only; no future enhancements. ESDIS/EMD contractor has funded the move to StorNext to save on AMASS maintenance costs. Moving away from expensive SGI server and RAID to Linux server and commodity disk storage StorNext reads AMASS written tapes; avoids Petabytes of data migration EMD/Raytheon implemented StorNext in ECS at NSIDC last month and is planning to install in ECS at LP DAAC and ASDC over next several months.

    5. 5 Why the transition from AMASS to StorNext? Other StorNext benefits to ASDC: Takes advantage of high speed Storage Area Network (SAN) infrastructure to move data more efficiently throughout the enterprise Provides automated data integrity checking on tape I/O operations Automatically creates multiple tape copies and provides automated fail over to the backup copy when read to the primary tape fails. Can utilize a large disk cache (100s TB) to minimize reads from tapes. Facilitates the management of data across multiple storage tiers (disks, tapes, off-line) based on data access needs over time.

    6. 6 LATIS StorNext Archive Status Accessing files from the LATIS archive via daacget has been problematic for users since the transition to StorNext in Jan. 2007. Access times can be lengthy (minutes instead of seconds) File retrieval are sometimes unsuccessful ASDC staff is working intensely with Quantum/ADIC and other vendors to improve the situation.

    7. 7 LATIS StorNext Archive Status Primary technical challenges: StorNext is less forgiving of STK tape drive errors than AMASS Tape drive errors will cause StorNext to take the entire library to go off-line StorNext is not utilizing tape drives efficiently to handle read requests Over 38 million files to manage (and growing)

    8. 8 Actions taken or planned to improve the situation ASDC staff fully trained on StorNext LATIS Archive management support provided 24x7 ASDC implemented work-around solutions for some problems Utilizing Quantum 24x7 support to resolve issues as quickly as possible Having ongoing technical discussions with Quantum to resolve issues Weekly teleconferences Visit to Denver office to discuss product stability and support. Two Quantum Engineers on-site this week to observe problems first-hand and propose and help implement solutions. Will expand StorNext disk cache from 11 TB to 80 TB to reduce reads from tapes. (late summer/early fall) Continue to work with Quantum to tune and optimize StorNext for LATIS data flows.

More Related