1 / 20

Project Overview:

Project Overview:. Longhorn Project Overview. Project Program: NSF XD Vis Purpose: Provide remote interactive visualization and data analysis services to the national science community Project Duration: August 1, 2009 – July 31, 2012 Partners and Roles: Kelly Gaither (TACC, PI)

kateb
Download Presentation

Project Overview:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Project Overview:

  2. Longhorn Project Overview • Project Program: • NSF XD Vis • Purpose: • Provide remote interactive visualization and data analysis services to the national science community • Project Duration: • August 1, 2009 – July 31, 2012 • Partners and Roles: • Kelly Gaither (TACC, PI) • Valerio Pascucci, Chuck Hansen (University of Utah, co-PI) • David Ebert (Purdue University, co-PI) • John Clyne (NCAR, co-PI) • Hank Childs (UC Davis/LBL, Software) • Linda Akli (SURA, MSI Outreach)

  3. Longhorn Configuration:

  4. LonghornFirst NSF XD Visualization Resource 256 Nodes, 2048 Cores, 512 GPUs, 14.5 TB Memory • 256 Dell Dual Socket, Quad Core Intel Nehalem Nodes • 240 with 48 GB shared memory/node (6 GB/core) • 16 with 144 GB shared memory/node (18 GB/core) • 73 GB Local Disk • 2 Nvidia GPUs/Node (FX 5800 – 4GB RAM) • ~14.5 TB aggregate memory • QDR InfiniBand Interconnect • Direct Connection to Ranger’s Lustre Parallel File System • 10G Connection to 210 TB Local Lustre Parallel File System • Jobs launched through SGE

  5. Longhorn’s Lustre File System ($SCRATCH) • OSS’s on Longhorn are built on Dell Nehalem Servers Connected to MD10000 Storage Vaults • 15 Drives Total Configured into 2 Raid5 pairs with a Wandering Spare • Peak Throughput Speed of the File System is 5.86 GB/sec • Peak Aggregate Speed of the File System is 5.43 GB/sec

  6. Longhorn Usage Modalities: • Remote/Interactive Visualization • Highest priority jobs • Remote/Interactive capabilities facilitated through VNC • Run on 3 hour queue limit boundary • GPGPU jobs • Run on a lower priority than the remote/interactive jobs • Run on a 12 hour queue limit boundary • CPU jobs with higher memory requirements • Run on lowest priority when neither remote/interactive nor GPGPU jobs are waiting in the queue • Run on a 12 hour queue limit boundary

  7. Longhorn Queue Structure Example: qsub -q normal -P vis

  8. Software Available on Longhorn • Programming APIs: OpenGL, vtk (Not natively parallel) • OpenGL – low level primitives, useful for programming at a relatively low level with respect to graphics • VTK (Visualization Toolkit) – open source software system for 3D computer graphics, image processing, and visualization • IDL • Visualization Turnkey Systems • VisIt – free open source parallel visualization and graphical analysis tool • ParaView – free open source general purpose parallel visualization system • VAPOR – free flow visualization package developed out of NCAR • EnSight – commercial turnkey parallel visualization package targeted at CFD visualization • Amira – commercial turnkey visualization package targeted at visualizing scanned medical data (CAT scan, MRI, etc..)

  9. Accessing Longhorn:

  10. Connecting to Longhorn Using VNC Without SSH Tunneling: longhorn qsub /share/sge/default/pe_scripts/job.vnctouch ~/vncserver.outtail –f ~/vncserver.out laptoporworkstation ssh <user>@longhorn.tacc.utexas.edu contains vnc portinfo after job launches VNC server on vis node ivis[1-7|big] With SSH Tunneling: ssh –L <port>:longhorn.tacc.utexas.edu:<port> <user>@longhorn.tacc.utexas.edu (1) establishessecure tunnel to longhorn vnc port laptoporworkstation longhorn (2) laptoporworkstation vncviewer localhost::<port> longhorn automaticport forwardingto vis node localhost connection forwarded to longhorn via ssh tunnel

  11. Longhorn Visualization Portalportal.longhorn.tacc.utexas.edu • Developed to provide easy access to Longhorn and abstract away complexities involved with command line access • Developed in conjunction with TeraGrid user portal and employs a fraction of TGUP developers to ensure continuity • Used for all in-person Longhorn training

  12. Longhorn Visualization Portalportal.longhorn.tacc.utexas.edu • Specify type of session • Specify resolution of vnc session • Specify number of nodes needed and the wayness of the nodes • Provides graphic of machine load

  13. Longhorn Visualization Portalportal.longhorn.tacc.utexas.edu • Vnc session opens up in java enabled browser • Behaves as if user had gotten a remote desktop into Longhorn.

  14. Longhorn Visualization Portalportal.longhorn.tacc.utexas.edu 8/2009 11/2009 2/2010 7/2010 8/2010 11/2010 All Vis Training on Longhorn Submits through the Longhorn Portal 3453 Jobs Submitted through Portal

  15. Longhorn Documentation and Training:

  16. Longhorn User Guides and Training Dates: • http://services.tacc.utexas.edu/longhorn-user-guide

  17. Training Statistics: 1/4/2010 – 12/31/2010 8/2009 11/2009 2/2010 7/2010 8/2010 11/2010 155 People Trained In Person

  18. Longhorn Usage Statistics:

  19. Usage on Longhorn: 1/4/2010 – 1/18/2011 8/2009 11/2009 2/2010 7/2010 8/2010 11/2010 8/2009 11/2009 2/2010 7/2010 8/2010 11/2010 • 526 active projects • 48,457 jobs run on the system • 5,456,155 SUs expended on the system

  20. Usage by Job Type: 1/4/2010 – 1/18/2011 Numbers at Top Indicate Snapshot in Time

More Related