1 / 17

TeraGrid User Portal

TeraGrid User Portal. Status (4Q06) and Future Plans Eric Roberts, Maytal Dahan, Jay Boisseau. TeraGrid Quarterly Meeting December 2006. TeraGrid User Portal Motivation. Motivation Launch-pad for new TG users Control panel for TG users with accounts

cili
Download Presentation

TeraGrid User Portal

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TeraGrid User Portal Status (4Q06) and Future Plans Eric Roberts, Maytal Dahan, Jay Boisseau TeraGrid Quarterly Meeting December 2006

  2. TeraGrid User Portal Motivation • Motivation • Launch-pad for new TG users • Control panel for TG users with accounts • Make using TG simple, just like your online bank account makes managing your bank account easy. • Increase productivity of TeraGrid researchers – do more science! • Vision • The TeraGrid User Portal integrates important user capabilities in one place for new and experienced users: • Allocations and accounts: creation, monitoring, management • User services: documentation, consulting, and training • RP resource information services: HPC, visualization, gateways, data collections • Web-based usage RP resources & GIG grid services: submitting jobs, interactive data mining, remote/collaborative visualization, etc. (planned) • Comprehensive and enhanced user services: surveys, online training, real-time consulting, etc. (planned) • In addition, with personalization and customization, it can be a foundation for application portals and (some) science gateways.

  3. TGUP v1.1 Features(Released Nov 7, 2006) • Account Management Services • View projects and allocation services • View system accounts and usernames • Portal password reset • Distinguished name listing • Add/Remove users • Resource Services • View comprehensive list of TG resources • View job queues, load and status for each resource • View static resources attributes • View TG Data Collections • View TG Science Gateways • * New v1.1 features are in italics

  4. TGUP v1.1 Features(Released Nov 7, 2006) • Documentation Services • Consume current User Info documentation page • Contextual help for all interfaces • Consulting Services • Consulting ticket submission • Portal feedback channel • Backend Services • Portal Usage Auditing System • * New v1.1 features are in italics

  5. Q4FY06 Accomplishments • Added new portal features • Add/Remove User Form • Consulting form • Data Collections View • Science Gateways View • Interface Updates • Portal Auditing • Developed Queue Prediction Portlet • Deadline and Wait time prediction based on work by Rich Wolski (UCSB) • Will be released in Beta next week (12/11) • Progress towards integration of MDS Information Services • Testbed being developed on TACC, ANL and IU systems • This will replace the custom providers that the portal uses for Job and Load information • Developed TeraGrid Science Mashup as high level tool for NSF, Directors, PR, etc. • Started policy plan “Scaling Account Creation and Management through the TeraGrid User Portal“ • GSISSH/MyProxy access method • Password/Public SSH key management through portal • Utilization of Campus Shibboleth integration (long term) • Publications, Presentations and Press Releases • Paper accepted and presented at GCE Workshop at SC06 “TeraGrid User Portal v1.0: Architecture, Design, and Technologies” • Profile on Eric Roberts at International Science Grid This Week (iSGTW)

  6. Top 10 Portal Users

  7. TeraGrid Systems Monitor • TeraGrid Systems Monitor displays live status and usage of all TG systems • HPC systems: users can see what capabilities TG offers (performance, memory, etc.), how busy they are, get info on them, etc. • Visualization systems: should help make users more aware that TG offers more than HPC; expect increased awareness to lead to more TG vis (remote) usage • Need to add storage systems! And eventually instruments • Default tab on TGUP Resources page, which now also has tabs for other ‘non-system’ resource types (Science Gateways, Data Collections) • Most popular page in TGUP • http://portal.teragrid.org/sysmon • Need to improve status indicator to convey down, up-but-not-accepting-logins, up-but-queues-off, etc.

  8. Top User Portal Applications

  9. Top Users Per-Application Access

  10. Portal Usage Statistics: Q3 & Q4 • Portal Accounts • 5059 total portal accounts created • 875 users have logged into the portal at least once • Downtimes Q3 Summary: • Total Number Of Downtimes: 9 (6 scheduled/3 unscheduled) • Total Time Down: 19 hours 52 minutes • Total Scheduled: 19 hours 20 minutes • Total Unscheduled: 0 hours 32 minutes Q4 Summary: • Total Number Of Downtimes: 9 (3 scheduled/6 unscheduled) • Total Time Down: 15 hours 38 minutes • Total Scheduled: 0 hours 20 minutes • Total Unscheduled: 15 hours 18 minutes • Detailed reports at https://repo.teragrid.org/head/portals/doc/reports/TGUP_Downtime_Report.html

  11. Batch Queue Predictor • Users with allocations on multiple systems should be able to get minimum time-to-solution • Without grid scheduler and workflow tools, users can use batch predictions to make decisions about where to run • Batch Queue Predictor leverages work of Rich Wolksi, and (in future) Warren Smith • Eventually, ‘Solution Predictor:’ • Queue wait time • Application execution time • Data transfer times (to & from)

  12. TeraGrid Science/Job Map • TeraGrid Science/Job Map shows current national usage of HPC resources • Project initiated from desire to showcase TeraGrid as a national, science facility on NSF monitors (and elsewhere) • Current shows jobs at user locations, by RP, with filters for RPs, job size • Tremendous future potential for information presentation and analysis of TG user jobs • Only in alpha right now! • http://portal.teragrid.org/map • Collecting requirements, suggestions, ideas now • Thanks to Maytal Dahan for exceptional effort in preparing this

  13. TeraGrid Science/Job Map

  14. Future Plans: 1Q07 Activities • Allocations & Accounts Management • Complete policy plan “Scaling Account Creation and Management through the TeraGrid User Portal “ and start implementation • Add user responsibility form which user’s must read and accept • User profile updates - email, phone, address • Information Services • Automatic synchronization of resource information with TGCDB • Pull system monitor information from MDS • More info presented, and analysis added, to science/job map mashup • Documentation Services • Add documentation regarding citing TG in user proposals and publications • Training calendar • Display RSS feed for user news and information on how to subscribe • Other Services • Automated monthly reporting from auditing service (Nov ‘06 reports at end of slides)

  15. Future Plans: Medium Term • Resource Reservations • Advanced Reservation form and calendar • Software Services • List software hosted/available on TeraGrid resources • Domain/community apps, libraries, tools, etc. • Provide purpose, domain, platforms, etc • Add Software to Resources page • Notification Services • Automatic notification of user news, downtimes, job monitoring • Downtime Calendar • Science Gateways • Login to gateways with TGUP username/password • Transparent access to science gateways from portal

  16. Future Plans: Longer Term • Utilize Campus Authentication/Authorization when available • Domain Views of TGUP • Important! Customize a user’s view based on domain • Example: Quantum Chemistry user should be able to customize user portal to have a custom quantum chemistry view - view their jobs, notifications and downtimes for systems they are interested in, software tools available to them, data collections relevant to their domain, training classes that are relevant. • Collaborative Capabilities • Collaborate among users within a single project • Share Code via CVS, Share Data, Project Calendar, Chat, etc. • Interactive Services • File Management/Data Movement • Job submission • Workflow Management • Interactive remote visualization

  17. Summary • TeraGrid User Portal is providing useful capabilities and is used on a regular basis by a subset of TG users • Usage of the portal can be greatly enhanced with: • Integration of allocations process (hence, all new/renewing PIs) • Implementation as sole online interface for new back-end consulting system (hence, all users ever having a question) • We’ve done this at TACC--works very well by ensuring all relevant data is submitted • Capabilities of portal will be greatly enhanced through • Additional information presented: Science map, etc. • Additional user services integrated: allocations, online consulting & training, etc. • Interactive web-based usage of grid resources: job submission with grid scheduling, etc. • New web-based services that exist possibly only in the user portal • Domain views that enable communities to be more effective • Personalization & customization • True “MyTeraGrid” view • Potential for quick creation of gateways

More Related