310 likes | 447 Views
LTFS & Storage: Today and Tomorrow. Chris Wood Director of Product Management, Axiom LOB. Agenda. LTFS: Going beyond backup Storage Musings: More than Speeds and Feeds Oracle Plans: Axiom and ZFSSA . LTFS. Open Format Overview Oracle’s LTFS Offerings Use Cases LTFS vs. TAR
E N D
LTFS & Storage: Today and Tomorrow Chris Wood Director of Product Management, Axiom LOB
Agenda • LTFS: Going beyond backup • Storage Musings: More than Speeds and Feeds • Oracle Plans: Axiom and ZFSSA
LTFS • Open Format Overview • Oracle’s LTFS Offerings • Use Cases • LTFS vs. TAR • Open Edition • Library Edition
Open Formats Why Store Data in an Open Format? • How Much Confidence Do You Have in Your Archive Application? • How Do You Get to Your Data if the Application Goes Away? Say after 100 years. • Have You Written Your Data in an Open Format? • Hint: There is no such thing as an Open backup format! Oracle Statement of Direction Oracle is committed to the continued development of archive solutions based on open formats
WHAT MAKES STORAGE SELF DESCRIBING? When a file and the index that describes that file are stored together WHAT IS IT? FILE INDEX A SELF DESCRIBING SELF DESCRIBING STORAGE FORMAT LTFS WHAT IS UNIQUE ABOUT SELF DESCRIBING FILES? WHY DO WE WANT FILES TO BE ACCESSIBLE? Self Describing Files are independent of the OS and the software used to create them WHY DO WE WANT SOFTWARE INDEPENDENCE? TWO REASONS: INDEX SOFTWARE DEPENDENT 1 - Easily share files 2 - Retrieve files in the future Freedom to access files without proprietary software FILE
Access Files on Tape Just Like Disk & FlashWith Open Formats SAME STEPS TO ACCESS FILES To Access Files on Tape (Written in an Open Format) To Access Files on Flash Insert Tape Into Drive Download Driver …Access Files Insert Flash Drive Download Driver …Access Files
What are the Open Formats? The Linear Tape File System (LTFS) & TAR are open format specifications for storing files and an index of those files together on tape, just like disk & flash TAR • Open • Self Describing • 30+ Years of Development • Standard • Multiple Index Access • LTFS • Open • Self Describing • Introduced in 2010 • Standardization in Progress • Single Index Access
How Does LTFS Store Files & the File Index Together? • Tape must be LTFS formatted • LTFS formatted tapes have 2 partitions • 1st partition for the file index • 2nd partition for the files • LTO-5 was the 1st generation LTO media to support partitions LTO-5 Partitioning with LTFS Indexing INDEX 3 INDEX 2 INDEX 1 FILE INDEX PARTITION FILE PARTITION End of Tape Beginning of Tape FILE 2 FILE 1 FILE 3
TAR Format on Tape LTFS with LTO INDEX 1 FILE(S) 2… INDEX 2 FILE(S) 1 …FILE(S) 2 FILE(S) 3 INDEX 3 FILE FILE INDEX End of Tape Beginning of Tape LTFS Format on Tape INDEX 3 INDEX 2 INDEX 1 FILE INDEX PARTITION FILE PARTITION End of Tape Beginning of Tape FILE 2 FILE 1 FILE 3
Oracle is Driving LTFS Standardization Oracle Named Co-Chair of SNIA Committee Standardizing the LTFS Specification
With LTFSApplications Use Standard Interfaces to Write to Tape DISK OR FLASH POSIX / CIFS / NFS Interface APPLICATIONS Oracle’s StorageTek LTFS, Open Edition TAPE
First LTFS Driver To Support: StorageTek T10000C, HP LTO-5, & IBM LTO-5 Oracle’s Driver is Free Oracle’s Open Format Software Oracle’s StorageTek LTFS, Open Edition Software • https://oss.oracle.com/projects/ltfs/ NDA:Coming 2013 @ OOW:Oracle’s StorageTek LTFS, Library Edition
What are the limitations of LTFS, Open Edition? • To see the file metadata, the tape must be mounted • Only one tape can be mounted at a time • You have 10,000 tapes, which one do I want? What Tape is My File On?
What is StorageTek LTFS, Library Edition? LTFS, Library Edition provides a file system interface to a tape library through POSIX, CIFS or NFS commands, just like disk or flash But, also addresses the “What Tape(s) are my files on” problem…
How Does LTFS-LE Expose a standard Interface to Tape Libraries? Visibility Into All The Files in a Tape Archive INDEX 1 FILES All File Indices Stored Within LTFS-LE Appliance File Index and Files Stored Locally on Every LTFS Tape POSIX / CIFS / NFS Interface APPLICATIONS INDEX 1 INDEX 2 INDEX 3 LTFS Library Edition
Summary: • Powerful new tool to enhance the usability of tape. • But, LTFS is just infrastructure. Archives require upper level S/W to ingest, index, move, protect, access etc. etc. • The wide-spread adoption of LTFS will be driven by the ISV community, not by tape vendors.
Oracle’s Broomfield, Colorado Campus 225,000 square feet, $70M+ Labs, Over 50 ISV partnerships
Agenda • LTFS: Going beyond backup • Storage Musings: More than Speeds and Feeds • Oracle Plans: Axiom and ZFSSA
Is it all about Flash? • You would sure think so by listening to all the analyst and self-appointed pundits! • Sure, it’s great stuff: Eliminated Seek and Latency, helps to close the gap between nano-seconds (Server) and milliseconds (Disks) • But it’s pricey (8-10X HDD’s) and it wears out • Flash is not going to catch HDD prices any time soon!
Is it all about IOPS, Bandwidth and Capacity?The “My Dad can beat up your Dad” theory of Sales. • It used to be, but not anymore • 4 TB 3.5” SAS HDD = 4 Million IBM 3330 disk packs • 16 Gbit FC = 1066 IBM S/370 Block Multiplexor Channels • 1 Million IOPS was impossible 10 years ago, now it’s commonplace • Who really gives a damm anymore? • So what is it all about?
People and Money • It’s really about money: • “Stuff” is cheap, people are not. • “Healthcare” for Stuff is a whole lot cheaper than Healthcare for people • “Stuff” does not take vacations, cause HR problems, goof-off, make stupid mistakes etc. • The real value add of future storage has to be about maximizing the effectiveness of the most expensive resource: People
Wouldn’t it be nice if storage could: • Accept a single command from an application and provision itself, locate all paths to the application, constantly self-tune itself as workloads change, do whatever is necessary to protect data, never allow silent corruption etc. etc. • This is what Oracle is working on right now. • The power of developing both hardware and software has never been greater than right now.
Interesting Comments: “Our goal is to eliminate, to the greatest extent possible, all People from the day to day operation of our data centers. We simply cannot afford the TCO of humans anymore.” Storage CTO Ebay & PayPal “We simply can’t run a competitive service business which relies on significent human interaction to manage the equipment we host for others and/or the equipment we own that hosts our managed service offerings.” SVP - Rackspace
The Future? • 8.5% Unemployment; the New Normal. • “Any Storage sale under a Petabyte should probably go through the Channel.” • Executive at a very large Computer Company • “Silicon Valley adding jobs while the rest of California stagnates” • 2012 California “State of the State” report
Agenda • LTFS: Going beyond backup • Storage Musings: More than Speeds and Feeds • Oracle Plans: Axiom, ZFSSA & Tape
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Oracle Enterprise Tape Technology Roadmap 5 Year Trajectory Tape Capacity 12 – 20x Archive Capacity 14 – 24x SL8500 Enterprise Tape Library 1.4 – 2.4 Exabyte Capacity In the Lab Delivered SL8500 Enterprise Tape Library 700 – 900 PB Capacity Gen5 Enterprise Tape Drive 12 - 20 TB Capacity SL8500 Enterprise Tape Library 500 PB Capacity T10000D Enterprise Tape Drive 8 TB Capacity SL8500 Enterprise Tape Library 100 PB Capacity T10000C Enterprise Tape Drive 5 TB Capacity T10000B Enterprise Tape Drive 1 TB Capacity 2014 2015 2011 2013 2010 2012
Oracle ZFS Storage Roadmap Delivered Planned 7x20 Series 2TB DRAM 4TB Read Flash 10TB Write Flash 2.5PB Storage Capacity 2-node Systems 10GB/s 130K IO/s Z5-7 2x Faster 2x More Scalable Z3-7 1x Faster 3x More Read Flash Z4-7 2x Faster 2x More Scalable Z3-5 2x Faster 2x More Scalable 3x More Read Flash Z5-5 2x Faster 3x More Scalable Z3-3 2x Faster 2x More Scalable Full Redundancy Z5-3 2x Faster 3x More Scalable Note: ZBA is pre-racked and tested configuration of the Z*-7 system. 2012 2013 2014 2015 2016 2017 Storage OS Storage OS Storage OS 7S Storage OS • Engineered integration and global management • Global Name Space Scale • HSP Advancements • Database Dynamic-Tuning (OISP) • Dynamic management and security • Global Load Balancing • Oracle Application Provisioning • Database QoS and Analytics (OISP) • Secure Multi-tenancy • Dynamic, multi-tenantsystem management • Elastic Scale • Global Analytics • Application Auto-Tuning • Unified Storage • Analytics • Hybrid Storage Pool (HSP) • Data Services • Oracle Eng. Integration(HCC, EM, etc.)
Oracle Axiom / F1 Flash Storage System Roadmap Delivered Planned F1-102 All Oracle Hardware Base 2 CU 1-30 SSD/HDD Shelves 24 - 720 Drives Up to 12 Host 10g/16g Interfaces 80 to 416 GB RAM Cache 650k SPC-1 IOPS Up to 1M IOPS 3PB Capacity 17.4GB/s (Sequential Read) 11.5GB/s (Sequential Write) F1-108 2-8 CUs 2 - 96 SSD/HDD Shelves 24 - 2304 Drives Up to 48 Host Interfaces 416 to 1664GB Cache 2.4M SPC-1 IOPS Up to 4M IOPS IB-Enabled 9.2PB Capacity 70GB/s (Sequential Read) 45GB/s (Sequential Write) F1-216 2 - 16 Control Units 2 - 192 SSD/HDD Shelves 24 - 4608 Drives Up to 96 Host Interfaces 416 to 6656 GB Cache 5.8M SPC-1 IOPS Up to 8M IOPS Hardware Refresh 28PB Capacity 140GB/s (Sequential Read) 90GB/s (Sequential Write) Axiom 600 2–8 CU 1-64 SSD/HDD Shelves 12 – 832 Drives 2 - 128 RAID Ctlrs 192GB Cache 70k SPC-1 IOPS 2013 2014 2014 2015 2015 2016 R5.x Storage Services F1 Storage Services OS F1 Storage Services OS F1 Storage Services OS • QoS-Driven Adaptive Tiering and Application Storage Tuning • Enhanced QoS for NAS + SAN • MaxRep 3.0 w/ new HW • Oracle Business Application Profiles • VMware SRM, VASA, VAAI • Unified (SAN + NAS) in all Systems • Single Model Expanded Scale Out with Hardware Refresh • Multi-node Redundancy • Symmetric Cache • Auto Load Balance • TP Space Reclaim • Single Model Agile Scale Out with Infiniband • Multiprotocol: FC, IP, iSCSI • and IB on every system • MaxRep 3.1: One Button Site Failover • Unified (SAN + NAS + IB) • QoS • Storage Domains • MaxMan • Copy Services • Replication • Application Profiles • Oracle Integration • (HCC, EM, etc.)