200 likes | 366 Views
Storage Trends: DoITT Enterprise Storage. Gregory Neuhaus – Assistant Commissioner: Enterprise Systems Matthew Sims – Director of Critical Infrastructure. Overview Traditional Storage Offering Current Storage Offering Emerging Technologies / Future Offerings. Overview: Environments.
E N D
Storage Trends:DoITT Enterprise Storage Gregory Neuhaus – Assistant Commissioner: Enterprise Systems Matthew Sims – Director of Critical Infrastructure
Overview • Traditional Storage Offering • Current Storage Offering • Emerging Technologies / Future Offerings
Overview: Environments • Enterprise Systems – Mission Critical Storage Solutions provided as agency-wide service offering. • Platforms include: Solaris, Linux, Windows, AIX, VMware, Mainframe • Environments Included are: • 311 – City Services Call Center • NYC.gov – Public Web Portal • NYCSERV – Department of Finance Revenue Application • Exchange – Citywide Email Solution • Cityshare – Employee Internal Web Portal • GIS – City Geographical Information Services • Interwoven – Content Deployment System • Analytics – Enterprise Reporting System
Overview: Data Storage Highlights • Disaster Recovery Solutions – Multi-site redundancy • Data Replication – Block and File level for high availability • DWDM Fiber Channel connection between three sites • 311 Call Center Data • Data Types: Flat Files, Block Devices, Exchange, Oracle, SQL • GIS Citywide Geographical Imaging
Enterprise Storage: Traditional Offering (prior to 2004) • Silo approach • Most systems – static-size internal disk • Dedicated direct attached array for additional needs • Limited “shared array” solutions • Standalone arrays
Traditional Storage Offering: Issues • Rapidly growing data sets • Risk of data loss • Multiple array failures – risk of data loss • Extensive downtime due to disk failure • Extensive maintenance windows • “Ad-Hoc” replication, file copy strategies for DR • Inability to forecast and meet storage demand • High cost due to dedicated storage procurements
Solution: Enterprise Storage Area Network (2004 – 2006) • Ability to quickly grow data sets • Implement Shared Fabric • Centralize critical storage • Enhanced capacity planning and provisioning • Lower overall costs • Increased security, manageability
Overview: Technology Solutions • Storage: • Hitachi Storage Array • NetApp Filers • Shark Storage Array • SATA Storage Array • Data Protection: • Veritas Netbackup • Traditional Tape Backup and Archiving • Offsite Vaulting • StorageTek Tape Silos
Current Offerings: SAN / Fabric • Fabric Architecture – Brocade 12k, 48k, 4900 • “Core-Edge” Topology. Bandwidth 1 to 4 Gbps • High performance, redundant • Robust, highly reliable / scalable • Established Fibre Channel Infrastructure • Based on best practices and industry experience • Increasing demand for more bandwidth • Expanding requirements for greater port density • Greater need for Fabric / Storage segregation
Enterprise Storage: Hitachi 9990 / 9980 Series • Consolidated Approach for Data Center Storage • Highly Integrated Service Offering • Reduced Cost per unit of Storage • Enhanced and streamlined supportability • Efficient Utilization of Costly Disk Resources • Simplified Provisioning, Virtualization, and Data Migration • Enhanced Accessibility to Data Sets for SOA initiatives
Enterprise Storage: Tiered Storage • Transition to Tiered Storage Model • Continue “Core” Enterprise-class Storage - Mission-critical data • Implement SATA technologies for 2nd Tier Data • SAN Segregation allows N-level Storage Tiers • Facilitates data migration, Lifecycle Management
Enterprise Systems: NetApp Filers • Windows Systems – Due to unique replication and storage needs particular to the Exchange environment, NetApp Filer Technology will be used to house the Windows environments. • This approach allows Exchange to run in a storage environment that has been optimized and supported by Microsoft. • Environments Included are: • Exchange – Citywide Email • SQL Server – Microsoft Database Solutions • Windows Hosting – Other Application Systems hosted on Windows
Security • Fabric Security – Brocade Secure OS under implementation • Access Control Lists • Restricted Access • Centralized and Consolidated Storage Administration
Current Offerings: Backup & Recovery • Traditional tape backup & recovery • Highly robust, reliable • Mature technology • Based on best practices and industry experience • Increasing need for faster backup, recovery times • Need to minimize backup windows, increase data availability
Planned Expansion: Backup & Recovery • Virtual Tape Library (VTL) • Faster Backup and Restore Times • Reduced Application Impact • Smaller Backup Windows • Potential for Continuous Backup and Recovery Windows • Allows for Disk-level Replication (DR strategy)
Planned Expansion: Backup & Recovery • Enhanced Offsite / DR Capability • Cluster-enabled Backups • “Offsite capabilities to FISA” • Immediate availability of DR Backup Environment • Immediate availability of Offsite Tape / Disk • Integrate with VTL to enhance Recovery Time
Emerging Technologies: Storage Resource Management • Need for Enterprise-scale Solution • Must be heterogenous, vendor neutral • Allow end-to-end management • Allow end-to-end problem isolation • AppIQ, EMC offer promising solutions (among others) • Reduces “Shelf-ware” effect of disparate tools • Information Lifecycle Management
Emerging Technologies: Virtualization • Optimized Provisioning • Facilitates tiered storage model • Multi-protocol access points: NAS, FC, iSCSI • Multiple vendor offerings in this space • Technology in infancy stage • Multiple approaches: • Appliance approach • “Core” approach
Contact Information Gregory Neuhaus Assistant Commissioner – Enterprise Systems Office: 718-403-8633 Email: gneuhaus@doitt.nyc.gov Matthew Sims Director of Critical Infrastructure Office: 718-403-8129 Email: msims@doitt.nyc.gov