Batch Modernization through BaaS ( Batch as a Service) and BoD ( Batch on Demand ) Marco Passerini Las Vegas Feb

1. BatchModernizationthrough BaaS (Batchas a Service) and BoD (Batch on Demand) Marco Passerini Las Vegas Feb 28 2011 – Room 109

2. Modernchallenges in the batch processing BATCH MODERNIZATION • Set of tooling, processes and best practices to transform existing assets and reusing them through modern technologies, so achieving tomorrow’s challenges Thispageis part ofan IBM presentation, permittedforthisspecificconference

3. Tivoli Workload Automation and batch modernization Scenario • Many organizations are adopting tactical or strategic approach to “modernize” their applications, to reach the imperative of flexible and agile maintenance of existing application portfolio and the ability to rapidly change to adapt to new business requirements. Some customers are gradually converting a portion of the totality of legacy applications into modern languages, others are integrating legacy applications with modern applications… • What does this mean to Tivoli Workload Automation? Thispageis part ofan IBM presentation, permittedforthisspecificconference

4. Modern challenges for Tivoli Workload Automation Fit-for-purpose Adapt to a fit-for-purpose distribution of workloads Elastic automation Absorb new modern workloads (FTP, SQL, analytics, Web Services, ...) with minimum additional cost/effort Embrace Java Integrate Java batch with traditional batch, and offload applications to Java Consolidation and operation transfer Accomodate the transition of operations Thispageis part ofan IBM presentation, permittedforthisspecificconference

5. Batchapplications: the Visiant Arcares standpoint An oftenoverlookedwealthoffeatures. The process of modernization tends to underestimate the potential of many batch applications which have been built over time and in fact already incorporate many of the features that you will have to develop on new platforms (i.e. report generation) • With the appropriate techonologicalinfrastructure, existingbatchapplicationscould, withoutmodification: • Be invoked and controlledby the end userthrough a modern web interface • Be seamlesslyintegratedwithnew web applications and at the sametimebecompletelytransparentto the userthrough the useofspecialized web services • Receive data from the user, or business applications, and deliveran output in the formoffiles (data, PDF, etc.)

6. Batch applications: An often overlooked wealth of features. An example: suppose there is a batch process that prints some information to output/printer for a series of accounts and that the input for the process is a file containing a list of accounts to be queried…. • In a traditional (old?) environment a typicalprocessmightbeasfollows: • someone (or some task) prepares the input file containing account info • a batchschedulingtool or someonesubmits the JCL thatexecutes the process • the processgenerates the output information for a output/printer • the output data isthenprinted or shippedthrough a print delivery tool • Usersreceive the output data

7. Batchapplications: An oftenoverlookedwealthoffeatures. Batch on Demand in a TraditionalEnvironment Execrequest Execrequest JOB/Script BatchSched. Operator ISREDDE2 CV1AA10.LIB.JCR(CHGMGMT) - 01.00 Columns 00001 00072 Command ===> Scroll ===> CSR ****** ***************************** Top of Data ****************************** 000001 //JJCRIVP9 JOB (XM99999999999),CLASS=5, 000002 // MSGCLASS=9,REGION=0M, 000003 // MSGLEVEL=(1,1) 000007 //*STRCMSTP----------------------------------------------------------- 000009 //* DATASTORE USAGE 000011 //* DDNAME/DL1DB/DB2TAB I/O DATASET NAME 000012 //*DB2 BKDICRDF O 000018 //*FLS DD1 O CV1AA03.SK.ABBA 000019 //*FLS DD2 I CV1AA03.SK.GFX 000020 //*ENDCMSTP----------------------------------------------------------- 000021 //S031 EXEC PGM=IKJEFT01,DYNAMNBR=50 000025 //DD1 DD DISP=OLD,DSN=CV1AA03.SK.ABBA 000026 //DD2 DD DISP=OLD,DSN=CV1AA03.SK.GFX 000023 //SYSTSIN DD DSN=CV1AA03.SKLIB.JCR(SKRUN21),DISP=SHR 000007 //*STRCMSTP----------------------------------------------------------- End User Input file parameters Print delivery system TWS Console Input File TWS Current Plan z/TWS – TWS Open sys Appl.Output File

8. Batch applications: An often overlooked wealth of features. • If we imagine that the requester (end-user) today normally works on a web interface, the new process could be the following (without any change to the batch component) • usercreates the input on a web interface (using a “batch-on-demand” tool or a business applicationthatinvokes the related SOA services) • the BOD infrastructure (with or without SOA services) • sends the input in the formof a flat file, then • invokes the sctipt/JCL or anapplicationthrough a standard batchschedulingtool (e.g. TWS) • when the batch script/JCL executionisfinished, itreturns the output data in the formof a file (whichcouldeventuallybeconvertedto PDF format) for the end user • the user can read data directly via the web interface (of the custom application or of the BOD tool) asifhewasworkingwithan online transaction

9. Batchapplications: An oftenoverlookedwealthoffeatures. Batch on DemandUsinga BoDProcess&Tool BatchModernization JOB/Script BoDDashboard Business Appl. ISREDDE2 CV1AA10.LIB.JCR(CHGMGMT) - 01.00 Columns 00001 00072 Command ===> Scroll ===> CSR ****** ***************************** Top of Data ****************************** 000001 //JJCRIVP9 JOB (XM99999999999),CLASS=5, 000002 // MSGCLASS=9,REGION=0M, 000003 // MSGLEVEL=(1,1) 000007 //*STRCMSTP----------------------------------------------------------- 000009 //* DATASTORE USAGE 000011 //* DDNAME/DL1DB/DB2TAB I/O DATASET NAME 000012 //*DB2 BKDICRDF O 000018 //*FLS DD1 O CV1AA03.SK.ABBA 000019 //*FLS DD2 I CV1AA03.SK.GFX 000020 //*ENDCMSTP----------------------------------------------------------- 000021 //S031 EXEC PGM=IKJEFT01,DYNAMNBR=50 000025 //DD1 DD DISP=OLD,DSN=CV1AA03.SK.ABBA 000026 //DD2 DD DISP=OLD,DSN=CV1AA03.SK.GFX 000023 //SYSTSIN DD DSN=CV1AA03.SKLIB.JCR(SKRUN21),DISP=SHR 000007 //*STRCMSTP----------------------------------------------------------- End User Output File User Input File User Input File SOA Services ParametersCheck & Data Customization Appl.Output File z/TWS TWS Open sys BoDProcess & Tool Input File

10. Batch applications: An often overlooked wealth of features. Thissolutionprovidesadditionalvaluebecause: • Whendoingbatchmodernization, itprovides a costsaving on the developmentofspecificfunctionsbyre-usingexistingones • Speeds up the batchmodernizationbyavoiding the needtodevelop and test software components • Reduces the numberoferrors (in Testing and Production environments), thanksto the usageofalreadyavailable (and welltested) SW components • In certaincases (SW componentsfor output data generation) decrease the impact ofchangesto information appearance

11. UpTown/MP: Userautonomy in the management ofbatchprocesses UpTown/MP, a part of the Visiant RES Suite, is the multi-platform solution for the implementation of on-demand batch applications • Givesusers the abilitytoautonomouslymanage the submissionof on-demandbatchjobs/scripts or scheduleswithouthavingto involve the production staff, through the useoftoolsfor: • Executeon-demandbatchprocesses • Monitor their status • Send/receive data filesto/from the central system • Guarantees a centralizedcontrolthrough the direct interface with TWS • Allows web applicationstoeasily integrate batchfunctionalitythroughSOAservices

12. UpTown/MP: Userautonomy in the management of batch processes Definitionofvariables and formalrulesfordefinedprocesses Allowusertosubmitthrough a WEB interface the definedpocesses under the controlof TWS (Z/Os and on Open Systems) Allowuserto monitor the resultofprocesess Catalogofuserbatchprocesses and userprofilefor security purposes Allowusertosend and receivefilesto and fromdefinedprocessesalongwithpre and post treatment (eg. PDF) Can beeasilyadaptedto client organizationespecially in complexenvironments Can beeasilyintegrated in business applicationthrough SOA services (*) (*) UpTown SOA services, differentlyfromthoseof TWS, makesitsfeaturesavailablethrough a WEB interface (catalogofprocesses, checkof formal and business relatedrulesforvariables etc.)

13. UpTown/MP: Userautonomy in the management ofbatchprocesses Main Features: • Highlyconfigurablemulti-platformarchitecture (DB, server, agents, ….) • Controlofon-demandbatchapplicationsthrough the web browser (platformtransparencyfor the user) • Web menu dynamicallybased on userprofiling • Controlofexecutions via the web • Transferringoffilesfrom and to the central system (pre and post processing) • Connectivityto TWS (or directsubmissionof JCL/Scripts) • Combiningofobjectsbased on System and Subsystemdefinition in the configurationphase

14. UpTown/MP: Userautonomy in the management ofbatchprocesses MainFeatures: highlyconfigurable • Through the use of JAVA, the following is possible: • Add checks during the set up of parameters and files • Apply modifications to output files • Availability of exit points and JAVA classes for: • Implementation of security • Dynamically change the name of a JOB or Script or of the Batch Schedule before submission • Invoke a tool for alternative file transfers • Numerous ways to verify permissions and implement profiles: • z/OS environment: • SAF groups (Racf/TopSecret/ACF2/…) • SAF resources (existing classes or ad hoc) • Open systems: • LDAP • Platform independent • Profiles provided at the startup of the invoking of an application • Custom User Exit • UpTown internal security

15. UpTown/MP: Userautonomy in the management ofbatchprocesses Main features: flexibility in the use of variables • Independence in the definition and useofvariablescomparedto the way in whichthey are used • Ampleopportunitesfordefinitions and calculations • Numerousformats and editmasks • Possiblitytodefinecomplexformulastocalculatevalues • Possiblitytoconstructexitsfordynamicupdates • Variables can be: • Referenceddirectly in the JCL/Script • Dynamicallybuilt via in-streamstatementswithcomplexconfigurations, with a specific off-set • Substituedbytailoringfilesusingpre-bulitskeletons

16. UpTown/MP: Userautonomy in the management ofbatchprocesses Mainfeatures: through Web services SOA (Service OrientedApplication) • AbilitytoinvokeservicesofUpTown in web applicationsthrough SOA services: • Requesting the listofvariables and theircharacteristicsfor a givenprocess • Submitting the process (withautomaticvalidationof the valuesof the variable) • Send and receive file to / from the system • Verificationof the status of the process EX: Stringmessage = ""; try { Callcall = (Call) new Service().createCall(); call.setTargetEndpointAddress(new URL("http://127.0.0.1:8084/UptAxisWs3/services/")); //parameterslistacquisition call.setOperationName(newQName("UptBatchExec", "getParameterList")); message = (String)call.invoke(newObject[] {request.getParameter("user"), request.getParameter("system"), request.getParameter("subsystem"), request.getParameter("process")}); //start request (parameters are in HashMap) call.setOperationName(newQName("UptBatchExec", "execute")); message = (String)call.invoke(newObject[] {request.getParameter("user"), request.getParameter("system"), request.getParameter("subsystem"), request.getParameter("process"), (java.util.HashMap)parms, request.getParameter("type")}); //status requestacquisition call.setOperationName(newQName("UptBatchExec", "getStatus")); message = (String)call.invoke(newObject[] {request.getParameter("token")}); }

17. UpTown/MP: UserLog-on and processselection Menu & processes available to the end user Dynamic composition of Menus and submenus based on profiling

18. UpTown/MP: Userautonomy in the management ofbatchprocesses Users can customizetheir UpTown environment

19. UpTown/MP: Userautonomy in providing input parameters Request and controlparameters Parameters can also be selected from a master list or from the calendar

20. UpTown/MP: Userautonomy in providing input files User can sendhis own data file

21. UpTown/MP: Userautonomy in monitoring the status ofprocesses The user can check the status ofprocesses

22. UpTown/MP: Processstatus Ended Ended, generic error Ended, waiting for file transfer Ended, file transfer error Running (the icon moves) Running, in wait for application Process submitted Parameters calculation failure Parset preparation failed Submit failed Multi-schid check failure Application control failure In waiting In waiting, postponed process submission In waiting for parameters calculation In waiting for parset preparation In waiting for submission In waiting for input file transfer Invalid status

23. UpTown/MP: Processstructuredefinition UpTown-A&D Menus, Processes & Parameters Structure definition

24. UpTown/MP: Userautonomy in the management ofbatchprocesses The UpTown Components • Administration GUI • client-server component (windows) for the definition of all the elements (processes, variables, etc.) • UpTown WAS (Web Application Server) • manages the web dialog • J2EE compliant • UpTown Server • performs GUI administrative services • manages requests made by the WAS • is activated internally in a TCS z/OS or JAVA task • UpTown Agents • submit processes directly (JCL/script) or through automatic scheduling • is activated internally in a TCS z/OS or JAVA task • May exist within the same z/OS STC or JAVA Server Task • UpTown Utilities • Import/Export processes/variables to support the change cycle • computing services and batch update • activation of batch requests • UpTown DB • ability to move a Z/OS database to a departmental platform • support for DB2 UDB, MySQL, Oracle and SQL Server

25. UpTown/MP: ManyBuilt-InFunctions

26. UpTown/MP: Userautonomy in the management ofbatchprocesses Web Browser Uptown-WAS The transfer offiles and the tailoringofvariables (z/OS JCL, Shell/scripts) TWS UpTown-Agent UpTown-SRV VariablesTailoring //JOB0001 JOB (AAA),CLASS=A //* //*UPTOWN-SCAN-START //STEP01 EXEC PGM=PGM001,PARM=‘&VAR’ //DDIN DD DSN=&SYSTEM..&USER.FILEIN, // DISP=SHR //DDOU DD DSN=&SYSTEM..&USER.FILEOU, // DISP=(,CATLG) //*UPTOWN-SCAN-END File tailoring Input File Select SEND //JOB0001 JOB (AAA),CLASS=A //* //*UPTOWN-SCAN-START //STEP01 EXEC PGM=PGM001,PARM=‘ABC’ //DDIN DD DSN=PROD.XRAD.FILEIN, // DISP=SHR //DDOU DD DSN=PROD.XRAD.FILEOU, // DISP=(,CATLG) //*UPTOWN-SCAN-END Output File Save File tailoring RECEIVE

27. UpTown/MP: WEB services flow activities Flow of activites when a web application issues an on demand request • The application invokes the web services to verify the user’s permission to execute a specific process or to display a list of available processes • MH verification is through the connection via the authorized sub-processes • The web application calls the list of files/parameters for that process • MH prepares and submits the application as appropriate • The web application invokes the execution of the service by providing the appropriate parameters/required files • FH manages any file transfers via the MH, which calls the P2P FTP service • MH adds an event to RH • RH sends the request to invoke the batch scheduler (or run directly) doing the appropriate tailoring of any JOBs/Scripts • RH adds an event to the FH if there is any output file • FH calls the P2P through the MH and the P2P sends the output file(s) (if any are generated) • UpTown-WAS does tailoring of the output files, if required (via user JAVA classes) • The web application periodically checks the status of the process and when it is completed, can request to receive files from a secondary FTP Server

28. VisiantArcares • Visiant Arcares • Visiant Arcares is a leading company focused in improving the capacity for governance of complex IT systems, with skills and products (Res Suite) specialised in: • Managing application components • Optimising and automating software development processes • Assessing and controlling software quality • Mission • Our mission is helping enterprises to achieve maximum efficiency and quality in managing their own IT systems. • Target market • Target markets for Visiant Arcares are Banks, Insurance Companies, Large Enterprise and Outsourcers with complex IT Systems characterised by: • Multi-centred and multi-platform computer processing architecture • Necessity to manage multiple instances of IT systems • Well constructed software life cycle enough

29. VisiantArcares • A complete • value proposition based on • skills • suite of solutions • services • Skills • Visiant Arcares expresses the best of its knowledge and expertise in two primary areas of Enterprise IT Management: Process Engineering and System Governance. • Extensive experience, over twenty years in this specific industry, an international presence besides a deep knowledge of both mainframe environment and distributed systems makes Visiant Arcares a point of reference for automation and optimization of software development processes and for management of application components. • Res Suite • Visiant Arcares approach to the IT market based on competence, standardization but also customization capabilities is ensured by Res Suite a comprehensive, modular and integrated solution for Enterprise IT Management. • Res Suite provides a wide range of products, independent and synergistic with each other, based on a comprehensive and efficient "DB of Knowledge" around which the whole Suite is built. • Services • As part of its technological offering, Visiant Arcares provides a full range of Professional Services: Consulting, Project Management, Service Management, Help Desk, Maintenance and Training.

30. VisiantArcaresoffering Specializations and areas of intervention • Specializations: • For main IT issues such as Process Engineering, System Governance, Data & Data Quality Management, Cost Reduction, etc., Visiant Res brings to the market its reputation with: • Technologies for optimizing, automating and reducing costs of development and management of IT Systems • An approach that encompasses the processes of the entire software life cycle, at all levels of company responsibility • Consolidated methodologies and guidelines that provide reliable results and a rapid return on investment • Areas of intervention: • Management of knowledge and control of IT System • Quality control of application software and prevention/elimination of inefficiencies • Software documentation and Impact analysis • Data & Data Quality Management • Re-engineering of batch processing • Identification and removal of unused and spare components: data and applications • Identification and optimization of critical processes • Reduction of human resource and technological requirements

31. VisiantArcares Enterprise IT Management Strategic and IT Management Change Management and Quality Application Management Facility Management Data & Data Quality Management Enterprise IT Management ProcessEngineering • Application Portfolio Management • Software quality analysis • Change management extended to data structures and to objects of “production” • Identification and storage of outdata software components • Impact analysis • Mass software update projects • Batch processes • Automation of on Demand processes • Performance optimization • Generation of batch processes • Conversion and cloning • Re-engineering of batch networks • Subsetting • Storage • Data logging • Modernisation • Data Masking • Data Retrieval System Governance • Software assessment andcertification • Support in evaluating AM and FM costs • Performance validation and Standard enforcement • Quality control of Change Packages • Verification of performances • Documentation of components and correlations • Impact analysis • Management and Control of On Demand processes • Analysis and prevention of delays in scheduling batch Jobs • Documentation of information assets • Control of data quality • Understanding of relations between data • Control of performance of access to data

32. VisiantArcares Res Suite Strategic and IT Management Change Management and Quality Application Management Facility Management Data & Data Quality Management Enterprise IT Management ProcessEngineering • DOCET MP • WIC MP DB ofknowledge and supportto APM • QA/Me Measurementof software quality • J/Man, DDL ChangerChange management of JCL Objects, Batch networks, DDL • ARPAIdentifying and storing obsolete objects and data • DOCET IAU Impact Analysis and support of Mass Update projects • JADE • Stream batch IDE • UPTOWN MP Request, execution, and processing controls On Demand • J/Man, JADE, Re-engineering • Generation, cloning and optimisation of stream and batch networks • ED/Man MP • Know-how and qualityof data • ED/Man DLC • Storage, Data logging, Modernisation • DAISY • DAISY DM • Subsetting and Data Masking System Governance • DOCET MP • QA/Me • Software assessment andcertification • Support in evaluating AMcosts • HPL/Qa, • PE/Qa, • DBIQ/Qa DBIQ/Qa+, • QA/Me • Performance and quality controls within the change management cycle • DOCET MP • WIC MP • Documentation of components and correlations • Support for Maint. Appl • UPTOWN MP Management and Control of On Demand processing • DOCET MP • WIC MP • Documentation of batch processes • WS PLANNING • CPF • Prevention of delays in batch networks • ED/Man MP • Know-how and qualityof data • ED/Man DLC • Storage,Data logging, Modernisation • DAISY • DAISY DM • Subsetting and Data Masking

33. Our worldwide presence Italian speaking Europe: VISIANT Arcares German speaking Europe: APS ENTER|Prise French speaking Europe: VISIANT Arcares Spain, Portugal: Vantis European Nordic Countries: VISIANT Arcares Brazil: Vantis BR USA: RES-IT US South Korea, Japan, China : DBDSynergy

34. Why VISIANT Arcares? • More than fifteen years of project experience with various IT depts. • Unique architecture employing a single repository integrating all products • Market reputation • One Vendor, One Solution • IBM & IBM Tivoli partnership • Partnership with large clients

35. Res Suite The modular and integrated solution for Process Engineering and System Governance Res Suite consists of over 20 products which are complementary and synergistic with each other. It is based on a central Repository around which all technological solutions are built. The Repository collects and centralizes the "Knowledge" of the IT System, making it available for governance, automation, quality control, as well as the engineering of application software and data management. Technological solutions Res Suite Res Suite Complete

36. UPTOWN MP Provides complete autonomy to the user when running and managing batch processing, as well as in optimizing relevant parameters. Management of On Demand batch processes JCL STREAM (Sun/Windows) Total autonomy for end user in all operations: Execution request Parameters optimization Process status control Results control Management of end user access capability Processing centralized control Integration with existing scheduling systems Integration via Web Services with IT systems applications Reduction in the management costs of processing requests Elimination of errors Reduction of logical and environmental mistakes Res Suite ToolstosupportApplication Management Res Suite Application Management

37. Marco Passerini VP Consulting and International Operations marco.passerini@visiant.com VisiantArcares SpA T - +39 02 241027 839 M - +39 335 7474394 US: +1 646 257 3729 BR: +55 11 64234566 MitchMcCluhan Business Development Manager mitch.mccluhan@visiant.com RES-IT US Inc., a Visiant Arcares company T - +1 916 271-6575 M - +1 916 313-0717