1 / 15

TeraGrid Arch Meeting RP Update: ORNL/NSTG

TeraGrid Arch Meeting RP Update: ORNL/NSTG. TeraGrid Arch Meeting RP Update: ORNL/NSTG. August 1, 2008. John W. Cobb. Outline. NSTG Purpose SNS Background and Status Neutron Science Portal Progress Report on Neutron Science Portal TeraGrid integration with Neutron Science Portal

celine
Download Presentation

TeraGrid Arch Meeting RP Update: ORNL/NSTG

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TeraGrid Arch MeetingRP Update: ORNL/NSTG TeraGrid Arch MeetingRP Update: ORNL/NSTG August 1, 2008 John W. Cobb

  2. Outline • NSTG Purpose • SNS Background and Status • Neutron Science Portal • Progress Report on Neutron Science Portal • TeraGrid integration with Neutron Science Portal • NSTG Cluster Operations update

  3. NSTG Purpose • NSTG = Neutron Science TeraGrid Gateway • Goals. Seek to build/improve • Bridging: between SNS and TeraGrid • Facility integration (especially large science facilities) • Neutron scattering science focus area • Instruments/ExperimentsInst/Exp was left out of new IPP, missing WBS areas were remapped to primarily {HPC-ops, SGW, EOT} areas. • Close association with Spallation Neutron Source (SNS) • Other interests: • Other neutron sources (LENS, IPNS, NCNR, ISIS, J-SNS, ANSTO/OPAL, … • Other large experimental user facilities (Diamond, APS, … • Discipline based SW efforts (DANSE, …) • CI software efforts (CIMA, …

  4. SNS Background and Status • SNS – Spallation Neutron Source (http://neutrons.ornl.gov) • Located in Oak Ridge • Pulsed neutron source: 1.4 MW, 1.4 GeV proton beam onto a mercury target. Up to 24 beam lines. • Construction 1999-2006 • Current Operations • 6 instruments in SNS user program http://neutrons.ornl.gov/instrument_systems/sns_instruments.shtml • Power ramping up • User days increasing http://neutrons.ornl.gov/proj_status/sns_long_schedule.shtml • High Flux Isotope Reactor now also part of org.http://neutrons.ornl.gov/hfir/hfir_facilities.shtml

  5. Neutron Science Portal • Location: http://neutronsr.us/portal • Developed by SNS Software Group (ASG) • SNS-ASG is collaboration contact point for NSTG • SNS ASG highly leverages NSTG effort • NS Portal uses wide mix of back-end CI, including TG • Instrument local computers • ASG centralized servers and storage • OIC (ORNL’s version of campus clusters) • TG via NSTG • User’s desktops and home machines (portal thick client under development via SBIR with TechX Corp, Buffalo office)

  6. SNS data access via portal(Reduction, analysis, and simulation as well) Function deployment order • First: Data acquisitionand storage/stewardship • Then: Reduction, analysis, simulation, proposalsfor one-stop access Acknowledgement: S. Miller and SNS ASG;J. Kohl, S. Vazhkudai and ORNL/CSM division)

  7. NS Portal architecture: (stylized)“flows from requirements”

  8. NS Portal Identity Management • Identity created and maintained by SNS facility • XCAMS – an external implementation of ORNL internal Unified accounts management system • “X” for External (inadvertent, unfortunate Google search space collisions) • X - lower identity proofing, suitable for user facilities (NIST level 1) • NS portal maps identity (as needed) to access other CI resources using the “Application Manager” subsystem for execution orchestration. • For TeraGrid integration, NS portal invokes “Jimmy Neutron” Community access • Ack: Lynch, Vazhkudai, Kohl, Trater, Miller

  9. NS Portal and TG Community Accounts • TeraGrid jobs executed in community account • NS Portal application manager archives in DB community user “reach back” according to {SGW,SEC} WG policy • TG Community account use from NS portal • Installed for: • McStas instrument simulation • Generic (NL2SOL) fitting service • Future possible installation for: • Distributed data reduction • Others • Current TG use • Increasing • Still dominated by development experimental use • SU use low, job count higher • Ack: Lynch, Ren, Kohl, Miller

  10. Progress Report on Neutron Science Portal Use Ack: S. Miller & SNS ASG

  11. SNS Facility Data Storage

  12. End User Network Quality of Service (Not TG network) Within ORNL At LENS From Home From Hotel in Bloomington Informs decision on portal versus Thick client access

  13. Neutron Science Discipline Science Areas • Full instrument/experiment simulation studies conducted by E. Farhi (ILL) • Emerging interest by neutron imaging instrument design team (particularly data intensive). CI requirements being solicited • Collaboration on diffused scattering data analysis project to improve software tools

  14. Other NSTG areas • ESG (with NCAR) working to facilitate ESG data transfer over TG network between ORNL and NCAR (2 important ESG sites) • OSG. • NSTG cluster available as both TG and OSG resource to demonstrate feasibility. • Motivated by “Should I use TG or OSG” question from a Neutron Scattering software project. A: Either, we support both. • NSTG Status now “green” after a period of red following sys-admin transition

  15. NSTG Cluster Operations Update • Usage update: • Breckenridge meeting noted that NSTG cluster usage was increasing. Suspected cause was overflow from TG oversubscription. • Recent usage trends by non neutron science related users down • Suspected explanation: TeraGrid resources much larger • Operations status : still good ( but – we lost /users due to NFS problem 2 weeks ago) • Some system Admin changeover issues still linger - thanks • Ack : Giles

More Related