PD² Adapter Q&A Webinar

1. PD² Adapter Q&A Webinar SPS Spotlight Series May 2015

2. Introduction and Purpose • Purpose of this webinar is to educate and keep the SPS User Community abreast of the functionality and ongoing changes to the core capabilities of the SPS suite of software. • We developed these learning modules that are geared toward product functionality, configuration, and maintenance for SPS users to sharpen their system administration skills and increase their overall product and system knowledge. • Follow-Up Surveys will be sent to all attendees requesting suggestions for improving future webinars as well as their feedback on the value of the material presented, the instructor, and overall satisfaction of the session.

3. Overview • Difference between the ASF and the Adapter • Difference between types of EDA files • Locations of log files for the Adapter • PDS • Review of the PD² Buffer table • Review of the multiPoll scheduler • MWS errors • Java memory

4. Differences between ASF and Adapter Q: What is the difference between the ASF and the Adapter? A: Even though most sites install the Application Server on the PD² Adapter machine, the two do not interact in any way.

5. Difference between ASF and Adapter The ASF provides this assistance in two main areas: Document Generation and Electronic Document Access (EDA). • Generation of Documents. Instead of generation on a client machine, the ASF can generate the documents. • Creation of EDA files. Creates the PostScript (ps) and Index (idx) files for released documents. These files get placed in a specific directory on the server where ASF is installed.

6. Difference between ASF and Adapter - ASF • Clicking the Jobs button, opens the Jobs page listing the services provided by the ASF. • Highlighting the Electronic Document Access (EDA) service, and clicking scheduler, should bring up the scheduler for EDA. • Creation of EDA files is based on a configurable schedule. • Generation of files is based on a configurable schedule.

7. Difference between ASF and Adapter - ASF The ASF EDA tasks can also be configured within the PD² client. • From the menu option Select Utilities  System Administration. • Click the ASF task to configure Electronic Document Access (EDA).

8. Difference between ASF and Adapter - Adapter • The purpose of the PD² Adapter is to provide an interface that supports the integration between the PD² and external systems. • The PD² Adapter is an application that offers the capability to extract and insert documents, and retrieve data based on certain events. • The documents inserted and extracted by the PD² Adapter are formatted in a standard XML file format. • Configurations for the Adapter are handled on the Integration Server page. http://localhost:5555/ • The IP address and port are configurable at the site level.

9. Difference between ASF and Adapter - Adapter Creation of XML files is based on the multiPoll scheduler time interval. The multiPoll scheduler exist on the Integration Server > scheduler page, where the interval time can be configured.

10. Difference between ASF EDA files and Adapter EDA files Q: What is the difference between EDA files generated by the ASF and the EDA files generated by the Adapter? A: The ASF supports EDA by monitoring the PD² database for released awards and at a scheduled time, generating a PostScript (ps) and index file (idx) for each newly released or modified award and placing the files in a specified directory. Once created the PostScript and index file can be sent to the appropriate locationatDLA Transaction Services. The process is typically done by an FTP push or pull based on the site’s preference.

11. Difference between ASF EDA files and Adapter EDA files • The PD² Adapter supports EDA by monitoring the PD² database for released awards and, for each newly released or modified award, the Adapter will create an XML file. • The delivery option of this XML file to DLA is configurable in the Trading Partner section in the My webMethods (MWS) website: https://localhost:8585 • The IP address and port are configurable at the site level. • KB articles: • 15501 – Information on POCs to help obtain TN Partner Info. • 15570 – Information on adding the new BPA doc types (55C, 9CM, 49C, 5CM).

12. Adapter EDA TN Partner Partner Profiles link list all of the TN Partner Profiles. This is where the EDA Partner is configured.

13. Adapter EDA TN Partner Once in the edit mode for the EDA Partner, click the Delivery Settings tab to configure how the EDA XML will be transmitted. • In the Delivery Method tab, sites will need to configure how EDA XML files are created. There are 2 options: • HTTPS: The EDA XML files will be sent directly to DLA TS. Sites will need to contact their GEX or DLA POC for connection information. • FTP: This option will FTP the XML files to a specific location. This option is site specific and will require sites to either push the XML to DLA TS or have DLA TS pull these files (via SFTP).

14. The Integration Server and MWS log files Q: Where can I find the log files for the Integration Server and MWS? A: The Integration Server logs can be found: \SoftwareAG\IntegrationServer\logs The important ones are: • server.log (or server.log.20150407) • WMERROR_20150407_000056.log The MWS log files can be found: \SoftwareAG\MWS\server\default\logs The important ones are: • _full_.log • _problems_.log • errors.log

15. The Integration Server and MWS log files • The webMethods server log and error log can also be found on the Integration Server page, under the Logs section.

16. Order of Processing of Documents Q: How does the Adapter determine the order of processing for documents in the PD² Buffer table? A: The Adapter determines order by first in, first out. It looks at the insertion timestamp and determines the order using that value. Looking at the buffer table results, the ins_tmsp column shows when the documents were inserted into the buffer table.

17. PDS Questions Q: PDS XML files are no longer being created on my PD² Adapter Server. How can I troubleshoot this problem? A: There are several issues that could cause PDS XML files to stop creating. • Are both the Integration Server and MWS services up and running? • Try to log into the Integration Server page (localhost:5555) or the MWS page (localhost:8585). If unable to connect, further investigation will be needed. • Are documents being polled and extracted from the buffer table? • Use the Buffer Diagnostic script in Script-Aid to assist. • In the \SoftwareAG\IntegrationServer\config directory, there is a file called PDSDocStore.dat. This file logs all documents processed by the PDS Extract Utility. If this file becomes corrupt, it can be deleted and then PDS XML files will be produced again. The PDSDocStore.dat file will get created again once documents begin processing.

18. PDS Questions Q: What could cause PDS XML files to stop getting created after I upgraded to SR15? A: There could be several factors. • First, check to see if released documents are being inserted into the buffer table. You can run the Adapter Buffer Diagnostic script in Script-Aid (using the Date Range option) to determine this. • If no released documents are being inserted, then there was a failure to run the PMOSqlScript2.sql script. This file can be found in the \SoftwareAG\install\sps folder. Running this script is part of the upgrade/install instructions. • If documents are inserting into the buffer table, are they being polled and extracted? If not, check to see if the multiPoll scheduler is active or suspended.

19. PDS Data Schema Q: What data schema should PDS be using, v2.3 or v2.4? A: It is the site’s choice; however, sites should evaluate the use of U.S. Dollars and Lump Sum Units of Measure from the PDS Weekly Reports to decide if the site is ready for PDS data schema v2.4. EDA can handle PDS data schema v2.4, but it is preferred sites stay on PDS data schema v2.3 unless they have overcome U.S. Dollars and Lump Sum Unit of Measure usage problem.  In PDS data schema v2.3, awards and mods with these units of measure get a warning.  In PDS data schema v2.4, they will fail. 

20. Reviewing the multiPoll scheduler The state of the multiPoll scheduler is Suspended. This means that no documents are being polled or extracted from the PD² Database. Clicking on the Suspended link, the system will prompt you to verify if you want to activate the scheduler. The scheduler is now active and counting down.

21. Reviewing the PD² Buffer Table Q: When reviewing the Buffer results, how do I determine if/when a document was or wasn’t processed? A: From the results set above, the red shaded rows show documents that were inserted on 1/02/2015 and polled & extracted once, successfully. pol_flg = 1 ext_flg = P The blue shaded rows show documents that were inserted on 1/29/2015 but never extracted. pol_flg = 1 ext_flg = 0 The green shaded rows show documents that were inserted on 1/13/2015 and 2/8/2015 and were reflagged on 3/16/2015 to be reprocessed. They were polled & extracted successfully. pol_flg = 1 ext_flg = P

22. Reviewing the PD² Buffer Table Q:When reviewing the Buffer results, how do I determine if/when a document was or wasn’t processed? A: From the results set above, the red shaded rows show documents that were inserted on and after 4/08/2015. The results show that the document was polled successfully pol_flg = 1. However the ext_flg = E, which means the document experienced and error during extraction. The cause of this error should be shown in the Integration Server logs (server & error). If the ext_flg = E, the documents will not show up in the Transactions page in MWS.

23. Reviewing the PD² Buffer Table A pol_tmsp showing (NULL) and a pol_flg showing 0 means that the document was not polled An ext_flg showing 0 means that the document was not extracted.

24. Reflagging of a Document for PDS or EDA • Show them script-aid scripts. In Script-Aid there are three (3) Scripts that can reflag documents to be processed by the PD² Adapter. These script will help recreate the following files (if applicable): PDS XML EDA XML Integration flat files The Reprocess Document for EDA script is used to flag a document so that it can be reprocessed by the ASF. This script will help recreate the Postscript (ps) and Index (idx) files.

25. Adapter/MWS Issue – Access Denied An error is being produced when trying to run the search function on the Transcations page in My webMethods: java.rmi.RemoteException: HTTP error response: [ISS.0084.9001] Invalid credentials <h4>Access Denied</h4>: This error can be caused by large amounts of data in the MWS database. 

26. Adapter/MWS Issue – Access Denied Take the following steps to resolve this issue and prevent it from recurring: • Reboot the entire Adapter server and at the same time stop/restart the MWS Sybase Server instance.  • Query the ActivityLogtable - select count(*) from ActivityLog-  in the MWS database to see how many rows exist.  If a large number of rows is returned (ex: 5000), sites should contact the SPS Help Desk for a script to truncate the data.  • To prevent recurrence of the problem, change the MWS Database Archive and Delete Periods.  Instructions can be found in the PD² Adapter Functional Users Guide, Section 7.2.5 – ‘Changing Database Archive and Delete Periods’. • More information can be found on this on the SPS Knowledge Base in KB id 14894.

27. Increasing Java Memory in SR15 Q: How do we increase Java memory on the Adapter server when we upgrade to SR15/Adapter v3.2? A: For Adapter v3.2 (SR15), the Java memory can be changed in the setenv.bat file. This file is located in the \SoftwareAG\IntegrationServer\bin directory. In SR15, the Adapter v3.2 can be installed on Windows 64bit. This allows the Java Memory values to be increased from the old value of 1024M to a much larger value. Doubling the value to 2048M would be a good starting point.

28. Question and Answers Q: Can I install/upgrade webMethods for the PD² Adapter on Windows 2008 64bit server? If so, what version of PD² and what version of the PD² Adapter must I be on to use 64-bit OS? A: webMethods does not support its installation on a machine with a 64 bit operating system until webMethods version 8.2, with PD² Adapter 3.2 and PD² SR15. There is a 64bit wM installer for PD² SR15. Please the Hardware Software Specifications for SR15, KB# 14106 for further details. Q: How high can the Java memory valuebe set? A: The only limit would be the amount of physical memory that exists on the server and the amount of memory other applications require. This all depends on the individual environment.

29. Question and Answers Q: Where do you suspend/resume triggers for the Adapter? A: From the webMethods Integration Server page (http://server:5555) a trigger can be suspended or resumed from Settings > Messaging > Broker/Local Trigger Management; however, if it is necessary to enable or disable a trigger for an Integration, you must access it from the Legacy Trigger Maintenance page. SPD KB id 7687 gives instructions for accessing the Legacy Trigger Maintenance page, as well as a list of triggers necessary for each integration. Q: What does the DCN event in the event subscription table stand for? A: We believe this is the “Discontinue Agreement” event. This is not an event that CACI normally enables, though sites may enable it, if desired.

30. Question and Answers Q: After changing the mwsuser password, I restarted the MWS service and now I cannotlogin to the My webMethods Server webpage. What files do I need to update so that my webMethods will recognize the new password? A: To resolve the issue: 1. Navigate to the /MWS/server/default/config directory. 2. Edit the mws.db.xml file. 3. Enter the password between the tags in clear text. 4. Save the file. 5. Restart the MWS service.

31. Question and Answers Q: Does DLA still need both ASF and Adapter EDA files or can we just send EDA XML? A: Based on information we have received the requirement is for all of the files to be transmitted. Q: Is there a KB article on how to setup the ASF as a Windows service? A: No, the service configuration is not supported or validated by the SPS Help Desk and we do not provide this as an option.