1 / 19

Building Secure, Stable and Scalable Infrastructures using Clustering and Storage Area Networks

Building Secure, Stable and Scalable Infrastructures using Clustering and Storage Area Networks. Tom Vosseler ( vosseler@admin.rutgers.edu ) John Amodeo ( amodeo@admin.rutgers.edu ) Faculty of Arts and Sciences March 1, 2006. FAS IT :: Logical Server Architecture.

norina
Download Presentation

Building Secure, Stable and Scalable Infrastructures using Clustering and Storage Area Networks

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Building Secure, Stable and Scalable Infrastructures using Clustering and Storage Area Networks Tom Vosseler (vosseler@admin.rutgers.edu) John Amodeo (amodeo@admin.rutgers.edu) Faculty of Arts and Sciences March 1, 2006

  2. FAS IT :: Logical Server Architecture Prior to the purchase of the SAN, FAS servers were deployed in a standard fashion FAS-ADMIN 4912 FAS-ENGLISH FAS-SOCIOLOGY FAS-DGLS1 • One server per unit • Local RAID 5 storage • Backups to tape robot • Server failure required immediate attention • Upgrades, patching & repair required downtime (after hours) FAS-CAC1 FAS-CAC2 FAS-ECON-MC 2948G EMAIL.FAS EMAIL.DGLS1 Backup Server EMAIL.LIV1 EMAIL.CAC1 Tape Robot STARGATE (WEB) FAS-MCS (TECH) ETC….

  3. FAS IT :: Logical Server Architecture Individual servers caused growth problems. We needed a new system with… 157 GB FAS-ADMIN 4912 157 GB FAS-ENGLISH 75 GB FAS-SOCIOLOGY • Increased contiguous storage • High speed access (I/O) • Expandability • Connectivity • Cluster ability • Reliability 75 GB FAS-DGLS1 75 GB FAS-CAC1 75 GB FAS-CAC2 75 GB FAS-ECON-MC 2948G 75 GB EMAIL.FAS 75 GB EMAIL.DGLS1 Backup Server 75 GB EMAIL.LIV1 Our options & their cost…. 75 GB EMAIL.CAC1 Tape Robot 75 GB STARGATE (WEB) • NAS (TCP/IP) ~ $40 - $65K • SAN (FC or iSCSI) ~ $95K 75 GB FAS-MCS (TECH) ….GB ETC….

  4. We chose the SAN. Our $95K purchased the following equipment and services…. • SAN chassis (fully populated) with 15 x 73G drives, 2 Storage Processors (SPs) & redundant batteries • 2 Brocade Silkworm 2Gig FibreChannel switches • 8 Host Bus Adapters (HBAs) • Onsite installation (Dell/EMC requirement) • 4 Hour Parts Replacement / Gold Support Queue

  5. Installation & Deployment • Dell/EMC schedules a certified SAN engineer to come to your location and install the unit for you • You must provide OS details and desired configuration prior to onsite setup • Technician provides full installation services and deploys SAN into production • Technician is scheduled to be onsite for up to a week to complete the installation • We chose to have the SAN engineer configure example nodes in a test environment. We would handle configuration in the production environment.

  6. 73Gb 73Gb 73Gb 73Gb 73Gb 73Gb 73Gb 73Gb 73Gb 73Gb 73Gb 73Gb 73Gb 73Gb SAN OS SAN OS SAN OS SAN OS HOT SPARE Provisioning the space…. • First 4 drives contain the SAN OS • LUN0 – Novell NAS Storage – 302 GB • LUN1 – E-mail Storage - 266 GB • LUN3 – Novell Primary Storage - 333 GB • LUN99 – Hot Spare

  7. Zone NC_A = SPA1, SPB1, NC1, NC3, XR1 Zone IMAP_A = SPA1, SPB1, IMAP1, XR1 Zone NC_B = SPA2, SPB2, NC2, NC4, XR2 Zone IMAP_B = SPA2, SPB2, IMAP2, XR2 SPA1 NC1 IMAP1 SPB2 NC3 XR1 SPA2 NC2 IMAP2 SPB1 NC4 XR2 Switch A Switch B Securely connecting the servers… • Switches provide security and connectivity • Zoning protects the data • Improper or no zoning is very dangerous • Operating systems also provides protection.

  8. Novell Deployment FAS-ADMIN FAS-ENGLISH FAS-SOCIOLOGY Backup Server Novell Cluster NC1 FAS-DGLS1 NC2 NC3 NC4 FAS-CAC1 Tape Robot FAS-CAC2 Connecting servers and migrating to the new system… FAS-ECON-MC EMAIL.FAS EMAIL.DGLS1 • Installed one HBA per server • Installed OS with cluster support • Migrated data and users • Added two additional nodes to cluster • Backup server was reconnected EMAIL.LIV1 EMAIL.CAC1 STARGATE (WEB) FAS-MCS (TECH) ETC….

  9. Red Hat Deployment Backup Server Network Services Cluster E-mail Cluster Novell Cluster NSS 1 IMAP 1 NC1 NSS 2 IMAP 2 NC2 NC3 NC4 Tape Robot • Installed one HBA per server • Configured heartbeat for high availability • Configured STONITH for data integrity • EMC Powerpath failed to meet minimum requirements for use on FAS servers • Engineered open sourced multi-pathing solution for SAN connectivity • Connected NSS cluster and migrated mail services EMAIL.FAS EMAIL.DGLS1 EMAIL.LIV1 EMAIL.CAC1 STARGATE (WEB) FAS-MCS (TECH) ETC….

  10. Apple Backup SAN Apple SAN (3.5 TB) Backup Server Network Services Cluster E-mail Cluster Novell Cluster NSS 1 IMAP 1 NC1 NSS 2 IMAP 2 NC2 NC3 NC4 Tape Robot • 1TB SAN expansion was purchased • Tape backups were an ongoing problem • Installed XRAID SAN as a replacement • NC4 & IMAP2 became backup servers • Removed the old backup server and tape drive from infrastructure STARGATE (WEB) FAS-MCS (TECH) ETC….

  11. Apple Backup SAN Apple SAN (3.5 TB) Network Services Cluster E-mail Cluster Novell Cluster NSS 1 IMAP 1 NC1 NSS 2 IMAP 2 NC2 NC3 NC4 Administrative Web Cluster PostgreSQL Cluster ICE 1 SQL 1 ICE 2 SQL 2 User Web Cluster WWW 1 Installed new clusters to handle remaining services…. WWW 2 MySQL Cluster MySQL 1 MySQL 2 • ICE: Administrative Web Cluster • SQL: Administrative PostgreSQL Cluster • WWW: Departmental Web Cluster • MySQL: Departmental MySQL Cluster STARGATE (WEB) FAS-MCS (TECH) ETC….

  12. Apple Backup SAN Apple SAN (3.4 TB) Network Services Cluster E-mail Cluster Novell Cluster NSS 1 IMAP 1 NC1 NSS 2 IMAP 2 NC2 NC3 NC4 Administrative Web Cluster PostgreSQL Cluster ICE 1 SQL 1 ICE 2 SQL 2 User Web Cluster WWW 1 WWW 2 Novell as a NAS: Novell/Linux Integration MySQL Cluster MySQL 1 MySQL 2 • Novell provides NCP, CIFS, NFS and AFP native access • ICE and WWW clusters mount data from the SAN through Novell cluster STARGATE (WEB) FAS-MCS (TECH) ETC….

  13. Using Novell as a NAS Front End: A Server Example… • User web pages reside on (VOL2) and are mounted by WWW cluster via CIFS • Departmental web pages reside on the Novell NAS volume and are mounted by the WWW cluster using NFS • Administrative web applications reside on the Novell NAS volume and are mounted by ICE cluster via NFS • Clusters can be expanded without additional direct SAN connections SAN Novell Novell NAS WebDAV IMAP NCP AFP VOL1 CIFS VOL2 User Web Cluster Administrative Web Cluster WWW 1 ICE 1 User Web Cluster Administrative Web Cluster WWW 2 WWW 1 ICE 1 ICE 2 User Web Cluster Administrative Web Cluster WWW 1 WWW 2 WWW 3 ICE 1 ICE 3 ICE 2 NFS WWW 3 WWW 2 WWW 4 ICE 3 ICE 2 ICE 4 VOL3

  14. Using Novell’s Protocol Support: Client Examples… • Windows can connect via: • WebDAV (HTTPS) • NCP (w/Novell Client) • CIFS (w/o Novell Client) SAN Novell Novell NAS WebDAV • Mac can connect via: • WebDAV (HTTPS) • AFP • CIFS • NFS IMAP NCP AFP VOL1 CIFS VOL2 Linux gateway connects via CIFS and NFS to provide shell access NFS VOL3

  15. Apple SAN (3.5 TB) Apple Offsite Backup SAN Apple Backup SAN Network Services Cluster E-mail Cluster Novell Cluster STARGATE NSS 1 IMAP 1 NC1 NSS 2 IMAP 2 NC2 NC3 NC4 Administrative Web Cluster PostgreSQL Cluster ICE 1 SQL 1 ICE 2 SQL 2 User Web Cluster WWW 1 WWW 2 Migration of remaining services.... • Data migrated to SAN (served by WWW and ICE) • Stargate redeployed - gateway system • Will install new AX100 7.5 TB SAN • XRAID will become offsite backup mySQL Cluster mySQL 1 mySQL 2 STARGATE (WEB) FAS-MCS (TECH) ETC….

  16. Our new infrastructure provides… • High availability • Load balancing between cluster nodes • Increased data integrity • More efficient backups • Expandability • Easier administration • Easier upgrades • Increased security

  17. The bad news… • SAN deployments are expensive • Everything relies on the SAN • Users expect zero downtime • Significantly more complex

  18. Physical Network Diagram Updated2/27/06 • - All systems are located in Room 109 of New Jersey Hall on the College Avenue Campus • One spare 2948G and one spare 4912G are also located in room 109 as standby replacements in the event of device failure. RUNet Departmental Web Servers Departmental SQL Servers WWW1.FAS MYSQL1.FAS LISTS.FAS FAS-DB FAS-MCS WWW2.FAS MYSQL2.FAS Cisco 4912G Cisco 2948G Cisco 3512G Cisco 3512G 2 Gig Fiber Gig Fiber 10Base-T 100 Base-T 1000 Base-T Serial Other Novell Cluster NC1-FAS NC2-FAS Network Services Cluster E-mail Cluster Administrative Web Cluster Administrative SQL Server NSS1.FAS IMAP1.FAS ICE1.FAS SQL1.FAS NC3-FAS Novell Netware 6 NC4-FAS NSS2.FAS IMAP2.FAS ICE2.FAS SQL2.FAS RedHat Linux Windows 2000 SAN (CX400) Clustered Systems APPLE X-RAID SPARE FC-SW1 FC-SW2

  19. Breakout Sessions Tom Vosseler (122AB) Discussion group about Novell Clustering, Integration and SANs John Amodeo (120AB) Discussion group about Linux Clustering, Integration and SANs

More Related