1 / 109

IMS Performance Update

IMS Performance Update. Janet LeBlanc IBM Silicon Valley Laboratory. End to End Management. Utility Management. Recovery Management. Data Base Administration. IMS TOOLS. TM Management. Application Management. Performance Management. Fast Path IMS High Performance Fast Path Utilities

agullette
Download Presentation

IMS Performance Update

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. IMS Performance Update Janet LeBlanc IBM Silicon Valley Laboratory

  2. End to End Management Utility Management Recovery Management Data Base Administration IMS TOOLS TM Management Application Management Performance Management Fast Path • IMS High Performance Fast Path Utilities Full Function • IMS High Performance Load, • IMS High Performance Pointer Checker • IMS High Performance Prefix Resolution • IMS High Performance Unload • IMS Index Builder • IMS Parallel Reorganization • IMS Online Reorganization Facility Administration • IMS Database Control Suite IMS Command Control Facility IMS ETO Support IMS HP Sysgen Tools IMS Queue Control Facility IMS Workload Router IBM Data Encryption for IMS and DB2 Databases IMS Database Repair Facility IMS HALDB Conversion and Maintenance Aid IMS HD Compression- Extended IMS Library Integrity Utilities IMS Parameter Manager IMS Sequential Randomizer Generator IMS Buffer Pool Analyzer IMS Network Compression Facility IMS Performance Analyzer IMS Problem Investigator IMS Sysplex Manager IBM Tivoli OMEGAMON XE for IMS IBM Application Recovery Tool for IMS and DB2 Databases IMS Database Recovery Facility IMS DataPropagator MS DEDB Fast Recovery IMS High Perf Image Copy IMS High Perf Change Accumulation MS Batch Terminal Simulator IMS Batch Backout Manager IMS Connect Extensions IMS MFS Reversal Utilities IMS Program Restart Facility

  3. IMS Tools – Performance Management IMS Connect Ext IMS Performance Analyzer, V3.3 5655-E15 IMS Problem Investigator, V1.2 5655-K50 IBM Sysplex Manager End to End Management Utility Management Recovery Management Data Base Administration IMS TOOLS TM Management Application Management Performance Management

  4. Introduction IMS Connect Extensions • Provides instrumentation and performance reporting for IMS Connect • Creates detailed IMS Connect reports in conjunction with IMS Performance Analyzer • Solves IMS Connect problems in conjunction with IMS Problem Investigator • Displays IMS Connect activity and utilization in real time • Enhances IMS Connect availability with dynamic workload management • Improves system security with flexible access control

  5. Features Event collection • IMS Connect Extensions collects significant IMS Connect events • Events are recorded on Active Journals • Active journals are archived when full • Archive journals can be used for: • Producing summary and detail activity reports • Extensive reporting using IMS Performance Analyzer

  6. Event collection Advanced reporting - IMS PA Connect reports • IMS PA V3.3 provides IMS Connect Extensions reporting • Transaction transit reports: • Transit Analysis - Summarized Connect activity • Transit Log - Detailed information for every Connect transaction • Transit Extract - Export data to DB2 or spreadsheet • Resource usage: • Port Usage - Measure Port usage for over-utilization • Resume Tpipe - Monitor Resume Tpipe activity • ACK/NAK - Summarize transaction success and failure • Exception Events - See why transactions are failing • Trace reports • Trace transaction events - Track individual transaction events • IMS PA V4.1 provides combined IMS Connect and IMS Log reporting GA June 2006

  7. Event collection IMS PA V3: Transit analysis report Input IMS internal response time Output Total response time

  8. Event collection IMS PA V4 : Combined Transit analysis report OTMA response time Connect Input IMS internal response time IMS transit breakdown and resource usage IMS Connect response time Connect Output • Combined IMS Connect and IMS log metrics • Design a Form to include required information only • No restriction on report page width • Export to CSV or DB2 as an alternative to reporting

  9. Event collection IMS PA V4 : Combined Connect Trace Start of Connect transaction IMS log data merged to show IMS transaction End of Connect transaction

  10. Event collection Interactive problem determination with IMS PI V2 Start of Connect transaction Start of IMS transaction Connect resumes Connect transaction ends after 0.278 seconds

  11. Status monitor Status Monitor - System overview Global view of activity across IMS Connect system, by system or port File Menu Form Help ──────────────────────────────────────────────────────────────────── Status Monitor - System Overview Row 1 of 12 Command ===> Scroll ===> CSR  Interval . . . 31. 20 Seconds 3. 01-15 Minutes 5. 31-45 Minutes 7. Hour 2. Minute 4. 16-30 Minutes 6. 46-60 Minutes 12.41.45 Input Input Input Input Accepted ACK Message Length Length Bytes Message Message Name Type Total Total Max Per Sec %Total Total -------- ---- -------- -------- -------- -------- -------- -------- PAPI04 HWS 240 24640 120 27.38 100% 120 IMD3 DS 0 0 0 0.00 0% 0 IMD4 DS 240 24640 120 27.38 100% 120 I9DV DS 0 0 0 0.00 0% 0 HWSJAVA0 EXIT 0 0 0 0.00 0% 0 HWSSMPL0 EXIT 240 24640 120 27.38 100% 120 HWSSMPL1 EXIT 0 0 0 0.00 0% 0 HWSIMSO1 EXIT 0 0 0 0.00 0% 0 HWSIMSO0 EXIT 0 0 0 0.00 0% 0 Input Messages Resume TPIPEs Send Only Messages Sent Unsuccessful Sent Successful Accepted Messages Rejected Messages Routed Messages ACK Count NAK Count DEALLOC Count Returned Messages Rejected by EXER Rejected by security Rejected by pacing Rejected by routing Message requests Messages ignored INPUT RTPIPE SENDONLY SENTERR SENTOK ACCEPTED REJECTED ROUTED ACK NAK DEALLOC RETURNED REJEXER REJSEC REJPACE REJROUTE REQUEST IGNORE Display historical information for the following definition types: HWS IMS Connect system Exit User Exits DG Datastore Groups DS Datastores

  12. Active sessions Active sessions Client ID TranCode User ID Port Socket Event Session Start Time Session Wait Time Original Datastore Target Datastore • View a snapshot of all active sessions • Identify sessions with long wait times • Use filters to select sessions based on conditions • Use forms to customize the display Filter sessions displayed by time in current status Show or hide persistent sockets in Read Prepare status Sort by any column

  13. Active sessions Status view View details based on the state of the session. . . • Identify the predicted socket state • List up to the last 30 events for the session View the predicted socket state Trace of last 30 events

  14. Other IMS Connect Extensions features • User Exit management • ADD, RELOAD, DELETE, DISABLE, ENABLE exits • Resource Tracing • Trace messages based on Port, Client, Transaction Code, Exit, Userid, Lterm, IP address • Workload management • Transaction Routing redirects transactions from the original datastore as specified by the client to another datastore • Workload Balancing redirects transactions based on the capabilities of the individual datastores rather than the destination of the transactions • Transaction Pacing protects datastores from surges. Can automatically reject incoming message requests • Alternate routing • Alter the original datastore of an incoming message to a nominated primary datastore • If the primary datastore is unavailable, reroute to an alternate datastore • Enhances SYSPLEX distributor • The same definitions can be shared across multiple sites • Publisher API • Coming soon, Omegamon to use Connect Extensions API for real-time Connect monitoring • Security • Userid and password validation with caching • Connect resource validation

  15. Introduction IMS Performance Analyzer • Provides comprehensive performance analysis and tuning assistance • Delivers end-to-end transit analysis for all types of transaction workloads, including shared-queues by merging sysplex log files • Delivers end-to-end IMS Connect and IMS log reporting, providing a complete picture of the life-cycle of transactions as they pass through Connect and into IMS • Comprehensive IMS monitor reporting including Fast Path (introduced in V7) • Offers DBRC Log selection for quick and easy log report requests • OLDS selection supported • Report Forms allow you to design your own reports • Alternatively extract to DB2 or CSV • Transit reporting improvements: • More accurate transit times by exploiting additional log record types • Micro-second precision for all elapsed times • Additional transit time breakdown, including SYNCPOINT • Report Forms allow you to tailor the contents of transit reports to include only required metrics New in V4 GA June 2006

  16. Introduction How do I use IMS PA? • Daily reporting • Dashboard • Transit response time reports • Performance problem? Drill down with more reports! • Bad response time? Transit reports • IMS resource constraint? Resource Utilization reports • Long-term Capacity Planning and Service Levels • Transaction History File – daily transaction performance • Load into DB2 to build a Performance Database • Report on host or workstation using your favorite SQL reporting tool

  17. Forms Form-based reporting – Part 1 • Tailor transaction transit reporting to meet your specific requirements • IMS Log and Connect transit reports, including combined reports • Choose from any of the 20 supplied samples

  18. Forms Form-based reporting- Part 2 • Design your own reports and extracts • Extract to CSV for off-host spreadsheet analysis • Export to DB2 • Page width, formatting, precision (up to microsecond) options available • Statistical functions include average, standard deviation, peak percentile, minimum, maximum, total, count

  19. Forms Form-based reporting- Part 3 • Include as little or as much information as required in the Form

  20. Forms Form-based reporting- Part 4 • Report displays only the fields you selected in the Form • Alternate sequencing shows problem transactions at the top of the report List all Transactions LIST0001 Printed at 16:03:51 17Apr2006 Data from 08.51.35 07Jan2005 Page 1 Org DB Call IMS Tran CPU Output InputQ Process OutputQ Total IMS Resp LTERM Trancode Program PST Cls Pr Count Start Time Userid LTERM Time Time Time Time Time T0883E04 CCAD1 BCAEDE01 107 - 1 0 08.51.35.298 3 - T0883E04 4 30 2 36 36 RVM60900 YNT35 BNETNT35 30 - 1 0 08.51.35.356 7 RVM60900 3 25 0 28 21 RVM60900 YNT04 BNETNT04 37 - 1 0 08.51.35.357 34 RVM60900 5 51 0 56 48 T4313E03 YSR02 BSAGY001 166 - 1 0 08.51.35.436 15 - T4313E03 3 25 0 28 27 RVM60900 YNT06 BNETNT06 38 - 1 3 08.51.35.357 79 RVM60900 4 110 0 114 106 9000 YWK01 BWRKSF01 152 - 1 0 08.51.35.469 7 M411376 9000 4 14 0 18 12 T8086E04 YNN06 BAAANN06 25 - 1 0 08.51.35.448 17 - T8086E04 3 37 0 40 34 Bad Transaction Response Time SUMM0001 Printed at 16:03:51 17Apr2006 Data from 08.51.35 07Jan2005 to 09.05.36 07Jan2005 Page 2 Avg Avg Avg Avg Avg 90% 90% 90% 90% 90% Avg Avg Tran InputQ Process OutputQ Total IMS Resp InputQ Process OutputQ Total IMS Resp CPU DB Call Trancode Count Time Time Time Time Time Time Time Time Time Time Time Count YCM74 7 4 11536 1 11541 11534 11 43169 2 43172 43170 2025 1052 YDV01 6 41 2298 1 2340 2338 144 9216 5 9361 9354 923 0 SVS12 8 12 1558 0 1569 1557 34 1709 0 1720 1711 23 0 YCM71 5 9 1525 0 1534 1532 20 3952 0 3965 3962 103 1473 YGA02 11 5 1522 0 1527 1518 11 1856 0 1861 1846 367 8 YSRNE 17 4 1459 0 1463 1454 7 4281 0 4285 4277 705 115 YVI56 1 20 1360 0 1380 1365 20 1360 0 1380 1365 540 6 YOR05 3 5 1208 0 1212 1200 8 1887 0 1889 1874 113 0 Design a Form to include the information you want to see in the report Report sorted in descending response time sequence, not the usual transaction code

  21. Forms Form-based reporting- Part 5 • Summarize transaction activity based on any criteria, for example Region Type • Statistical functions include average and peak percentile (to measure SLA adherence) Transaction Dashboard DASH Printed at 14:34:54 05May2006 Data from 16.03.39 29Dec2005 to 16.17.33 29Dec2005 Avg Avg Avg Avg Avg Avg 90% 90% 90% 90% 90% 90% Reg Tran InputQ Process OutputQ Total IMS Resp CPU InputQ Process OutputQ Total IMS Resp CPU Typ Count Time Time Time Time Time Time Time Time Time Time Time Time BMP 287 200 409 0 607 0 0 819 1282 0 1543 0 0 DBC 1 0 5 0 5 0 0 0 5 0 5 0 0 MPP 47017 118 63 8 189 183 18 3550 982 26 3827 3908 227 MSC 204 0 97 14 111 111 0 0 267 35 280 280 0 Summarization by Region Type Transit time breakdown (averages) Transit time breakdown (90% SLA) Transaction volume for the day CPU time Design a report to meet your needs

  22. Introduction IMS Problem Investigator • The complete tool for IMS problem investigation, providing enhanced levels of problem determination services • Merge IMS log (sysplex), CQS, IMS Monitor and Connect data for complete end-to-end diagnosis • ISPF Dialog utility with a powerful viewing facility that enables easy navigation and formatted or ISPF Browse log data presentation. You can drill-down to display information at the field level • REXX interface for customized reporting and diagnosis • Batch reporting utility that lets you produce personalized formatted reports • Extract function can be used to produce a reduced log file for easier online analysis • Record Forms lets you design a customized record reporting layout, so you view only the information you require • Filtering Criteria lets you select records by field name, avoiding field-offset calculations; conditional logic adds flexibility by allowing record selection using complex criteria • DBRC Log Selection automatically selects the required log files for the specified reporting period New in V2 GA June 2006

  23. Introduction Why choose IMS PI? • Get the information you need quickly, without having to review large volumes of hexadecimal record dumps • Provides an insight into all IMS log record fields - from the bit settings of flag bytes to the text content of messages and database updates • ISPF dialog makes log file navigation quick and easy • Easy to use, minimal setup required • Supports IMS versions 7, 8, and 9

  24. Introduction IMS PI overview • Analyze IMS problems from the various IMS data sources using the advanced features of IMS PI • Merge IMS Log and Monitor, CQS and IMS Connect data for the complete end-to-end picture • ISPF dialog with powerful record formatting and navigation aids

  25. Display Record display – formatted browse session 1. Compact mode showing time of day 2. Expanded mode showing more information and time 3. Expanded mode showing LSN instead of time Use F10/F11 to switch modes

  26. Features Navigation and Tracking 2. Find the offending transaction 1. Navigate to point-in-time 3. Start tracking • 4. Notice delay in transaction processing. • Display time as: • Relative to a base • Event latencies • Normal time of day 5. Select record to look for problem

  27. Merging Merged Log and Monitor Transaction arrives and put onto the shared queue Transaction on back-end DLI database call starts Database open Long elapsed time VSAM IWAIT IRLM IWAIT Database updates logged Output message issued and sent back to front-end Output message received and transaction completes

  28. Formatting View the Formatted Record – Part 1 Every IMS Log record type (including Traces) is formatted

  29. Formatting View the Formatted Record – Part 2 Notice the APPC data in this 01 message record. IMSPI “understands” the information contained in every IMS Log record and makes it available to you.

  30. Formatting View the Formatted Record – Part 3 IMSPI presents the information logically, breaking down sub-component sections in the Log record

  31. Formatting View the Formatted Record – Part 4 Position cursor on field and press enter to Zoom Data like message text and database updates are dumped

  32. Drill-down Zoom to a Character or Hex field • Zoom allows you to drill down to obtain more information about a log record fields • From the Formatted Record display simply position the cursor at any field of interest and press Enter • Zoom provides addition field analysis and detailed field description.

  33. Drill-down Zoom to a Flag field IMSPI “knows” about Flags. Zoom to see which bits are on or off.

  34. Forms Record Formatting using a Form Only those fields requested by the Form are displayed Output Message Lterm User id Message Text

  35. Filtering Filtering Criteria – Record Selection Use Filtering Criteria to select only the records of interest Filter records by log record code and by setting conditions Format record using a Form Special customized record processing using a REXX EXEC

  36. Filtering Filtering Criteria – Conditions Part 1 • Set conditions by comparing: • Specialized field names, e.g. Trancode, Userid, Database etc. • Field names from the IMS macros, eg. MSGODSTN • Supports offsets similar to DFSERA10

  37. Filtering Filtering Criteria – Conditions Part 2 • Use: • Bit fields • Actual field names and symbolic names • Masking and position searching

  38. REXX REXX Programming Interface TRANSACT CODE=(ADDINV), AOI=NO,DCLWA=YES,EDIT=UC, FASTPATH=NO,INQUIRY=NO,MODE=SNGL, MSGTYPE=(MULTSEG,NONRESPONSE,1), PARLIM=65535,PROCLIM=(65535,65535), PRTY=(7,10,2),ROUTING=NO, SCHD=1,SEGNO=0,SEGSIZE=0,SERIAL=NO Customized diagnosis and presentation using the REXX Programming Interface

  39. More information • IMS Connect Extensions • http://www-306.ibm.com/software/data/db2imstools/imstools/imsconnectext.html • Version 1.2 available now • IMS Performance Analyzer • http://www-306.ibm.com/software/data/db2imstools/imstools/imspa.html • Version 4.1 available June 2006 • IMS Problem Investigator • http://www-306.ibm.com/software/data/db2imstools/imstools/imsprobleminvest.html • Version 2.1 available June 2006

  40. IMS Sysplex Manager

  41. IMS Sysplex Manager v1.1 5655-P01 • Real-time management of IMS Sysplex • Single system image for operation of IMS in Sysplex environment • Aggregated or local view • Simplified User Interface to reduce operational complexity • Structured displays of IMS related address spaces, CF structures, and resources • Recorded System Exceptions and Console alerts • IMS Type 1 "/" local and global command support • IMS Type 2 integrated SPOC support • IMS Data Sharing • IMS Shared Queues • IMS Operations Manager • IMS Resource Manager • Support IMS DB/TM, DBCTL, and DCCTL for IMS V8, V9, and ongoing

  42. IMS Sysplex Environment • Improves IMS availability and scalability • Redundancy helps to eliminate single point of failure • Scalability through additional IMS system images • Flexibility in configuring • Data Sharing • Shared Message Queues • IMSPLEX • Diagram 1, Diagram 2 • Operational Challenges • Many address spaces - IRLMs, CQSs, OMs, RMs, SCIs in addition to Control Regions, DBRCs, DLIs, MPRs, BMPs, Connects, etc. • CF structures - Lock, Cache, VSO, Shared queues, Logger, RM • Tools for specific tasks: QCF, SPOC, Omegamon for IMS • Lack of integrated management tools to present single system image • Still some voids in IMS base function: RM and CQS structure management

  43. Real time Sysplex Management • Integrated snapshot of current environment and critical resources • Data extracted from live IMS systems • Multiple IMS system support Sysplex or IMSPLEX • Auto-refresh mode • System exception alerts for auto-ops • Integration with SPOC and group constructs • IMS classic command interface • RACF/SAF secured

  44. System Exceptions • SM defined IMS system anomalies • Shared Queue events • Structure rebuild • Structure status change • Structure overflow • Data Sharing long-lock notification • SCI events • Logged for later review • Interested SM users are notified • Sample user exit to customize exceptions processing • More in the future based on requirements

  45. IMS Sysplex Manager Components User Interface Server • One or more per PLEX • Resides on any MVS system within Sysplex • Start or terminate at any time Data Collector • One per MVS system • Resides on same MVS system as IMS,CQS,SCI • Start or terminate anytime IMS Control Region, DBCTL, DCCTL • Presence via physical logger user exit (DFSFLGX0) • Seamless interface to customer DFSFLGX0 exit • Execution/Isolation under IMS CTX task • Dynamic Re-initialization TSO/ISPF Client As many as you like Resides on any MVS system within Sysplex More information

  46. IMS Sysplex Manager ISPF Dialog • User Interface to SM • Access to information in real-time • Access to logged systems exceptions information • Drill-down and direct access to detailed information • Customizable dashboard with user definable thresholds • Pull-down menus for efficient navigation • Ability to switch view of target IMS system or groups • Logon anywhere in the Sysplex • Split-screen mode support • Auto-refresh capability • Column sort capability • Online help

  47. IMS Sysplex Manager usage scenarios • Taking Inventory • Managing IMS System Parameters • Verifying IMS Resource Definitions • CSL Resource Management Structure • IMS CF Structures • Data Sharing Long Locks • Real-time IRLM Locking Display • Managing Dependent Regions • Aggregated IRLM Statistics • IMS Commands • CQS Shared Message Queues • Aggregated SCI, RM, OM Statistics • Dashboard Sysplex at a Glance

  48. Summary • IMS Tools from IBM provide, integrated, easy-to-use solutions that fit your company’s needs • Reorganization, Recovery, Performance and Tuning, Fast Path, and Systems and Data Administration • IBM is dedicated to the continued success and support of IMS and the mainframe. We’re invested for the long term, right beside you. • We are continuing to invest in our IMS Tools technology and have a vision for our IMS Tools that centers around autonomic computing. • Service and Support from IBM can help reduce your time-to-value by getting you up and running quickly and helping you maintain your investment.

  49. Deep Dive • The following slides represent more detail for the individual products that make up the IMS Tools solution families.

  50. System Administration Solution

More Related