890 likes | 1.22k Views
HP OpenView Data Extraction and Reporting. Bill Emmett Software Design Engineer HP OpenView Integration Lab Hewlett-Packard Company. The Reporting Challenge. Measure the success of delivering more IT services while using less resources. Corporate Management.
E N D
HP OpenView Data Extraction and Reporting Bill Emmett Software Design Engineer HP OpenView Integration Lab Hewlett-Packard Company
The Reporting Challenge Measure the success of delivering more IT services while using less resources Corporate Management Reports to help make informed infrastructure design decisions for future needs Planning Department Business Management • More bandwidth • New IT Services • Redesign infrastructure Reports measuring quality and volume of IT services
Reasons to extract and mine data using PC-based reporting tools • Answer specific questions about your environment • The report can be shared in a common format • Separate roles of report designer and report user • Use currently existing talent and tools • Opportunity to merge multiple sources of data into a single report
Agenda • Concepts - tools and methods • HP OpenView product reporting • Network Node Manager • IT/Operations • MeasureWare and PerfView • Service Reporter • Strategic reporting concepts
Objectives • Understand why data extraction and reporting is beneficial • Understand the concepts, tools, and processes involved in HP OpenView data extraction and reporting • Gain additional insight on the reporting capabilities of NNM, ITO, MeasureWare, PerfView, and Service Reporter
Tools and Methods Overview OpenView Product Flat Text File Export to file Import from file DSI Log file ODBC or CGI/ HTTP Data Warehouse/ SQL Database Non-SQL OpenView Data Stores Query requests and responses Client PC • Examples: • Binary data files • Log files
Microsoft Excel97 • Powerful import/export capability • Run queries against ODBC source and display it in spreadsheet • Perform statistics analysis, graphing, summarization using spreadsheet functionality
Seagate Crystal Reports • Develop a template once, then run reports based on a template • Export reports to HTML format • Powerful wizards to generate SQL queries • Capable of generating many types of graphs, and formatting data in many ways
Business Objects • Powerful software which allows users to create ad-hoc and periodic reports • Administrators can customize Business Objects so that users enter real-world queries, and do not have to use SQL • Available on NT and Unix platforms
Microsoft Access • Relational Database Management System (RDBMS) for Windows 95/98/NT platform • Includes query and reporting capabilities • Ideal for integrating business and network/system/service management data
Custom Applications • IT departments build, test, and deploy “homegrown” applications • Could be developed using MS Visual Studio or one of many other application development environments • Decouples data from application
Oracle RDBMS • Used by IT/Operations and Network Node Manager • HP OpenView supports Oracle 7 and 8 • PC Clients use SQL*NET or Net8 to access the database across the network • Considered the most complex of the OV-supported databases
Microsoft SQL Server • Supported by Network Node Manager and ManageX products • Version 6.5 is currently supported • Customers install and perform basic configuration of SQL Server -- HP OpenView creates database once this is performed
Microsoft Access/Jet Database • Jet database embedded in ManageX and Service Reporter • Lightweight database -- ideal for staging data for report generation • Easy to generate your own reports using Microsoft Access
ODBC - Open Database Connectivity • The bridge between data source and query tool • Used for connecting locally or across the network • Standards based • Much more prevalent on Windows 95/98/NT platform than on Unix • Data Sources are defined on a system, and users log in to other databases using these Data Source Names (DSN)
ODBC Issues • ODBC driver version conflicts • Using ODBC across the network • Application behavior and consistency • Performance, and less “rich” data
HTTP and CGI • Access to OV databases over the web • CGI scripts pass SQL queries to the RDBMS and return results to the process/user which invoked the CGI script • This technology is available in Network Node Manager 6.0
Command-line Executables • Used to export/extract data from an OV application and process it further • Often used as input to shell or PERL scripts • Examples include ovtopodump(NNM) and extract (MeasureWare)
HP OpenView Database Documentation • Entity-Relationship diagrams identify and relate tables to each other • Data dictionaries describe the contents of each table • Between these two sources, IT departments should be able to make their own reports
Data Sources • NNM and ITO documents usually installed on management station • MeasureWare document is not referring to a RDBMS, but is still worth referencing • All of these documents available on the web at http://www.openview.hp.com
HP OpenView Network Node Manager • Layout of network and system topology • Status of systems and network devices • Measurement of network devices using SNMP • Integrates with over 300 partner applications
Data Available in NNM • Topology • Events • SNMP Information
NNM Topology Data • Basic information regarding nodes and interfaces of the devices on a network • The “inventory” of your network • Examples include system nodes, IP addresses, and router interface information
NNM Event Data • Information regarding the status of the devices on a network • Information regarding the status of NNM and third-party applications • Information regarding threshold violations based on SNMP-based data
NNM SNMP Trend Data • SNMP-based data gathered via snmpCollect, focused on a specific attribute • Trend data is the basis for setting performance thresholds, which generate events when exceeded • Examples include %Interface Utilization and network collisions
Accessing NNM Data • Out-of-the-box reporting, which will be part of NNM 6.1 • Use the NNM Data Warehouse, introduced in NNM 6.0 • Use command-line executables, which have been available for many releases
NNM Out-of-box Reporting Web-based reporting package shipping with NNM 6.1 Tightly integrated with the NNM Data Warehouse Reports in the area of availability, exception, inventory, and performance
Configuring NNM Out-of-the-box Reports Follow the wizard through the steps. The last step reviews your report parameters Select the report that you want to begin seeing on a scheduled basis
Excel (1-2-3) MS Access Data Warehouse Operational Data ODBC Export, Aggregate and Trim NNM Embedded RDBMS Data Collector Crystal Reports Topology Manager Customer RDBMS (Oracle or MS SQL Server) Out-of-box rpts Events System NNM Reporting Architecture Flow of data
NNM Database Environments - Databases • Embedded Database • Windows NT and UNIX • Oracle • Windows NT and UNIX • MS SQL Server • Windows NT Only
NNM Embedded Database • Completely integrated into NNM (Backup, start/stop, configuration) • Little customer interaction required -- for customers not interested in database administration, just report generation • Same embedded database technology as found in other HP OpenView products
NNM and Oracle • NNM 6.0 can configure Oracle 7.2.3, 7.3.4, and 8.0.4 to be the analytical repository (Data Warehouse) • Customer-supplied Oracle can coexist with other HP OpenView applications • Customers can readily use SQL*Plus and Oracle Reports to create reports based on the Data Warehouse • Best suited for customers with strong database backgrounds and enterprise-level requirements
NNM and SQL Server • NNM 6.0 can configure MS SQL Server 6.5 to be the analytical repository (Data Warehouse) • Uses ODBC drivers supplied with MS SQL Server • Best suited for customers with strong database backgrounds and enterprise-level requirements
NNM Interfaces - ODBC • ODBC acts as the “bridge” between the Data Warehouse and the reporting tool • ODBC is pervasive in NT environments, but is much less common in Unix environments • The NNM Data Warehouse supports ODBC drivers from database vendors on Windows NT • NNM 6.0 supplies the ODBC environment on UNIX
NNM Interfaces - ovwebdata • CGI program running on a web server that passes SQL commands from the client to the Data Warehouse and returns the results of that query to the user • Underlying technology used in Excel97 contrib templates • Possible interface for customers who want to write web-based tools to retrieve data from the NNM Data Warehouse • Currently, this interface is not documented
Sample Reports - Excel97 Network exceptions and events
NNM Sample Reports - Excel97 Performance and availability
NNM Sample Reports - Excel97 Network and system inventory
HP OpenView IT/Operations • Distributed system management solution • Agents monitor many aspects of managed systems • Events are sent to management console, where operators or automated processes handle them
Data Available in ITO • Many types of events, originating from many sources • Status of managed nodes • Information regarding ITO operators and administrators
ITO Database Environments and Interfaces • Oracle 7.3.4, Oracle 8.0.4, Oracle 8.0.5 • ODBC Access is available with the use of Oracle SQL*NET or Oracle Net8 • Use ITO documents to navigate through ITO schema
ITO Data Access • Use the ITO GUI • Build your own reports, using your preferred PC based query tool • Use HP OpenView Service Reporter
ITO Data Access Using the GUI • 27 predefined reports for administrators, 12 predefined reports for operators • Use the Actions pull-down menu for ITO • Report output can be directed to the screen, printer, or file
Adding your own reports using the ITO GUI • Develop an SQL query • Save the SQL query to the following location:/etc/opt/OV/share/conf/OpC/mgmt_sv/reports/<lang>/ \<unique filename>.sql • Edit the configuration file which indexes reports in the Reports menu:/etc/opt/OV/share/conf/OpC/mgmt_sv/reports/<lang>/admin.rpts/etc/opt/OV/share/conf/OpC/mgmt_sv/reports/<lang>/oper.rpts
Building your own ITO reports using PC-based query tools Query requests and responses ODBC using Oracle SQL* NET ITO Database SQL*NET client with ODBC DSN configured SQL*NET listener process configured and running on server
Accessing the ITO Database using ODBC • Use preconfigured ODBC DSN “ov_net” • Default report (read-only) user is opc_report • Default password is OpC_report