Directory Service Operational Issues

1. Directory Service Operational Issues Transaction Performance Monitoring at the University of Notre Dame Brendan Bellina, University of Notre Dame

2. Presentation Overview • Why Monitor Performance Metrics • What Performance Metrics To Monitor • How To Monitor Performance Metrics • Notre Dame EDS Performance Monitoring Middleware: Directories

3. Why Monitor Performance Metrics • Availability • It’s up… isn’t it? • Responsiveness • It’s fast enough… maybe. • Scalability • We can handle that… I think. Middleware: Directories

4. What Performance Metrics To Monitor Bind response time Search response time Current connections Avg connection length Current binds Current searches Peaks • Response time • Connection requests • Bind requests • Bind errors • Search requests • Search errors • Avg count & size of search results Middleware: Directories

5. How To Monitor Performance Metrics • Directory internal query (iPlanet, OpenLDAP?) • base search on cn=monitor • base search on cn=monitor,cn=ldbm • Log File Analysis • Perl (PerLDAP) Middleware: Directories

6. How To Monitor Performance Metrics • NMS (Network Management System) • HP OpenView • CA/UniCenter TNG • IBM NetView • others • Operating System Tools • Win NT Event Viewer • Sun Solaris SE Toolkit Middleware: Directories

7. Notre Dame EDS Performance Monitoring • Directory Probing via HP/OpenView (Jrodent) • ORCA • Operating System Performance via Orcallator • Log File Analysis – trending & troubleshooting Middleware: Directories

8. Directory Probing • Ping • Query to directory service • Bind to directory service • Automatic alert to operations center • Cycle every 5 minutes Middleware: Directories

9. ORCA (http://www.orcaware.com) • About ORCA: • Generates web friendly performance graphs based on collected statistical data. • Free (will take donations) • Open Source • Perl • Used by Yahoo!/Geocities • Used at Notre Dame on 100+ servers • Hourly, Daily, Weekly, Monthly, Quarterly, Yearly, All • Did I say free? Middleware: Directories

10. ORCA @ Notre Dame • CRON job runs every 15 minutes to regen graphs • Orcallator (SymbEL script included with ORCA) • Written to monitor web servers and Solaris stats • Requires Sun Solaris SE Toolkit (free from http://www.setoolkit.com) • Runs on each directory server to collect statistics – 5 minute averages, 30 second peaks • Data is consolidated on one server for ORCA processing • Modifications by ND to read iPlanet Dir Server 4.16 log Middleware: Directories

11. ORCA @ Notre Dame • ND Modifications by Jeremy McCarty • LDAP connection rate • LDAP Bind rate • LDAP Bind error rate • LDAP search rate • LDAP search error rate • LDAP search results returned rate • Picture is worth 1000 words: • <http://www.nd.edu/~eds/perfmon> Middleware: Directories

12. ORCA @ Notre Dame • Planned enhancements: • Stats for search response, bind response • Split LDAP log processing into separate Perl script • - Portability • - Maintainability • - Removes requirement for SE Toolkit Middleware: Directories

13. Links • Notre Dame Enterprise Directory Service • http://www.nd.edu/~eds • Notre Dame EDS Performance Statistics • http://www.nd.edu/~eds/perfmon • ORCA software • http://www.orcaware.com • Presentation Authors: • Brendan Bellina (mailto:Brendan.T.Bellina.1@nd.edu) • <http://www3.nd.edu/~eds/cgi-bin/nd_ldap_search.pl?ldapfilter=uid=bbellina> • Jeremy McCarty (mailto:Jeremy.McCarty.5@nd.edu) • <http://www3.nd.edu/~eds/cgi-bin/nd_ldap_search.pl?ldapfilter=uid=jeremy> Middleware: Directories