840 likes | 1.09k Views
儲存技術簡介及應用. 工研院 / 南分院 / 家庭網路科技中心 莊宜璋 yczhuang@itri.org.tw. Outline. History Storage Technology File Systems Applications. Outline. History Storage Technology File Systems Applications. RAMAC (Random Access Method of Accounting and Control).
E N D
儲存技術簡介及應用 工研院/南分院/家庭網路科技中心 莊宜璋 yczhuang@itri.org.tw
Outline • History • Storage Technology • File Systems • Applications
Outline • History • Storage Technology • File Systems • Applications
RAMAC (Random Access Method of Accounting and Control) Source: http://www.zdnet.com.tw/news/pix/0,2000085677,20109608-1,00.htm
一整排 Source: http://www.zdnet.com.tw/news/pix/0,2000085677,20109608-1,00.htm
橫躺與直立 Source: http://www.zdnet.com.tw/news/pix/0,2000085677,20109608-1,00.htm
250公斤 Source: http://www.zdnet.com.tw/news/pix/0,2000085677,20109608-1,00.htm
305 Source: http://www.zdnet.com.tw/news/pix/0,2000085677,20109608-1,00.htm
50片儲存碟片 Source: http://www.zdnet.com.tw/news/pix/0,2000085677,20109608-1,00.htm
超級比一比 Source: http://www.zdnet.com.tw/news/pix/0,2000085677,20109608-1,00.htm
Quantum Bigfoot Source: Wikipedia
Outline • History • Storage Technology • File Systems • Applications
DAS (Direct-Attached Storage) • A digital storage system directly attached to a server or workstation • Well-known protocols • ATA, SATA, SCSI, SAS, Fiber channel • Simple and good performance • Sharing data is not an easy job
RAID • Redundant Array of Independent (Inexpensive) Disks • Achieve high levels of storage reliability with low-cost and less reliable disk components • Distribute data across multiple disks with/without redundancy • Present the combination of physical disk drives as a single hard drive • Different configurations give different RAID levels with different trade-offs of data loss, speed and capacity • 0, 1, 5 are most commonly found
Striped disks Improve access speed with full capacity (zero redundancy) No guarantee for data protection One disk failure will cause data corruption RAID 0 Source: Wikipedia
Mirrored disks Full duplication without parity Increase read performance if O.S. supports Very small reduced performance in write RAID 1 Source: Wikipedia
Bit-level striping with Hamming code ECC parity Disks are synchronized and striped in very small stripes in bytes/words RAID 2 Source: Wikipedia
Striped set with dedicated parity Bit (byte) level parity Parity disk is a bottleneck for writing RAID 3 Source: Wikipedia
Block level striping and block level parity Each disk operates independently Allow I/O requests to be performed in parallel RAID 4 Source: Wikipedia
Striped set with distributed parity A single drive failure will result in reduced performance RAID 5 Source: Wikipedia
RAID 6 • Striped set with dual distributed parity • Fault tolerance with two drive failure Source: Wikipedia
Mirrored-Stripe (RAID 0+1) Source: Veritas
Striped-Mirror (RAID 1+0) Source: Veritas
Mirrored-Stripe vs. Striped-Mirror Source: Veritas
JBOD (Just a Bunch Of Disks) Source: Wikipedia
Backup • Full backup • Back up all of the data • Take longer to accomplish and require the most storage space • Incremental backup • Back up all the modified files since the last full or incremental backup • The fastest backup and requires the least storage space • Require the longest time and the most tapes to restore • Differential backup • Back up all the files that have changed since the last full backup • Faster than a full backup • Requires more storage space than an incremental backup, but less than a full backup • Require more time to restore than a full backup
Incremental Backup Backup Storage User Storage T3 T4 T2 T1 T0 T0 T1 T2 T3 A2 A1 A0 A0 A1 A2 B1 B0 B0 B1 C1 C0 C0 C1 D0 D1 D0 In Recovery A0 A2 A1 B0 B1 C0 C1 D0
Differential Backup Backup Storage User Storage T3 T4 T2 T1 T0 T0 T1 T2 T3 A2 A1 A0 A0 A1 A1 A2 B1 B0 B0 B1 B1 B1 C1 C0 C0 C1 C1 D1 D0 D0 In Recovery A0 A2 B0 B1 C0 C1 D0
Automatically moves data between high-cost and low-cost storage media Data usage is monitored by the HSM system HSM (Hierarchical Storage Management) Source: Sun
Snapshot • Record the state of a storage device at any given moment • Creates a point-in-time copy of the data • Provide data protection • Offer business value • Better application availability • Fast recovery • Easier backup management of large volumes of data
Implementations of Snapshot • Copy-on-write • Redirect-on-write • Split mirror • Continuous data protection
Copy-on-Write Source: IBM
LVM (Logical Volume Management) • A kind of storage virtualization • To create a larger storage pool • Allow to resize the volumes to your needs
LVM LV1 LV2 LV2 VG1 VG2 PV1 PV2 PV3 PV4 PV5 HD1 HD2 HD3 PV: Physical Volume VG: Volume Group LV: Logical Volume
Provide block-based storage Devices appear as locally attached to the operating system Clients can use its own filesystemData sharing between clients requires non-trivial solutions SAN (Storage Area Network) Source:http://www.allsan.com/sanoverview.php3
Brief Introduction to SCSI • SCSI is a client-server architecture • Clients of a SCSI interface are called initiator • Issue SCSI command to request service from logical units of a server • Server of a SCSI interface are called target • SCSI transport maps the client-server SCSI protocol to a specific interconnect • Initiator and target are two endpoints of a SCSI transport
SCSI Architecture Model Source: T10
iSCSI (Internet SCSI) • iSCSI transports SCSI packets over TCP/IP • Provide a cost-effective transport for Storage Area Network (SAN) when compared with Fibre Channel • Take advantage of existing Internet infrastructure, Internet facilities, and address distance limitations • Reduce the TCO of shared storage solutions • Compatible with existing IP LAN and WAN infrastructures
iSCSI Illustration Endpoint Logical unit Initiator (client) Target (server) SCSI command Internet Transport
iSCSI Layers Source: Addison Wesley
iSCSI Session Source: Addison Wesley
NAS (Network-Attached Storage) • File-level data storage connected to a computer network with common protocols • NFS, SMB/CIFS • Provide data access to heterogeneous network clients
NAS Products Source: QNAP, Synology, D-Link, Thecus
SCSI Standards Architecture Source: T10