60 likes | 70 Views
Learn with data management what a REST Web Service is, how to create a Power Center workflow & use REST based method via HTTP Transformation
E N D
skip to main content Blog Resources Events Careers Contact Us I N TEL L I G EN C E I N DUSTRI ES WHAT WE O F F ER ABO UT US Home » Blogs » DataManagement Choose Category Data Management (51) Data Science (22) Data Engineering (11) Intelligence (10) Cloud Services (4) Customer Experience (3) Corporate (1) featured (1) POPULAR READS How to use Informatica Power Center as a RESTful Web Service Client? DATAMANAGEMENT | July23,2019 How to use Informatica Power Center as a RESTful Web Service Client? BySatishKumar | July23,2019 Introduction DATAMANAGEMENT | July23,2019 How to integrate Informatica Data Quality (IDQ) with Informatica MDM Intoday’sworldDATAisubiquitousandcriticaltothebusinesswhicheventuallyincreasesthe needforintegrationacrossdifferentplatformslikeCloud,WebServiceProvideretc.Whenit comestoDataIntegration,businessneedseffectivecommunicationbetweentheirsoftware DATAMANAGEMENT | July25,2019 systemsandETLtooltofulfilltheirneeds. Deterministic Matching versus Probabilistic Matching ThisblogpostexplainswhataRESTWebServiceis,howyoucancreateaPowerCenter workflow,useRESTbasedmethodtoaccessthewebservicesviaHTTPTransformation. REST Overview DATAMANAGEMENT | July25,2019 Informatica MDM MDE Batch Process in a nutshell WebServiceprovidesacommonplatformthatallowstwodifferentapplicationsonvarious platformstocommunicateandexchangemessagesbetweenthemoverHTTPprotocol.Web Servicescanbeaccessedusingdifferentmethodsorstyles.InWebServiceworld REpresentationalStateTransfer(REST) isastatelessclient-serverarchitectureinwhichWeb ServicesareexposedasURLs.ThetypicalmethodofaccessingWebresourceinaRESTful systemisthroughvariousHTTPmethodssuchasGET,POST,PUTandDELETE. RESTcanuseSOAPWebServicesandanyprotocolsuchasHTTP,SOAP. High-Level REST Architecture FIGURE 1: HIGH-LEVEL REST ARCHITECTURE REST call using Informatica Power Center LetusexplainwiththehelpofasamplewebservicewhichisusedinaRetailIndustry.Ina Retailindustry,customercanpurchasevariousitemsfromtheretailerthroughonlineandoffline andweneedacentralizedrepositorycalledaDataWarehousewhereallthetransactionaldatais fedinto.TheitemdetailsarethenfurthernormalizedintoDataMartstoformacommonschema whichwillhavefactsanddimensions.Onalargescaleenvironment,thiscouldbeacumbersome taskindesigningadatamodel. Toovercomethiswehavebusinessneedstoaccessthedataoverthenetworkandthebestway SUBSCRIBE willbetousethewebservice.Sothefinalorderdetails,pricing,paymentdetails,andshipping
informationaretranslatedinternallyandsavedinathirdpartysystemwhichiseitherinanXMLinformationaretranslatedinternallyandsavedinathirdpartysystemwhichiseitherinanXML orJSONformat.Thethird-partysystemhostedoverasecurednetworkisaccessedviaaURL. SincethissystemisbasedonRESTAPIcalls,weuseInformaticaPowerCenterasaclientto accesstheserverwhichisawebserviceAPI.InformaticaDataQuality (IDQ) canalsobeintegrated separatelywiththePowerCenterandInformaticaMDMtostrengthenenterprisedataquality. InPowerCenter,youcanuseanHTTPtransformationtosendarequestandreceivearesponse fromaRESTWebservice. SuccessStory 5.5% revenueupliftforanInsuranceProvider withaCustomer-360view LearnMoreSuccessStory Pre-requisites to configure REST call using HTTP Transformation ValidRESTbasedURLsupportingeitherXMLorJSON ValidSSLcertificatestoconnecttoRESTURLoutsideofthenetwork BasicAuthenticationMechanism(UserNameandPassword) Step by Step Process Creating a Source File CreateasourcefilewhichspecifiesthesearchparameterstobepassedasinputtotheHTTP transformation. FIGURE 2: SOURCE FILE Create HTTP Transformation CreateHTTPtransformationwiththefollowinginputports: Username Password OrderNumber FIGURE 3: HTTP TRANSFORMATION Base URL SettheBaseURLtogettheOrderdetailsbasedontheinputparameterspassedfromthe sourcefile. BaseURL:https://test-swaggerUI/orders/search SUBSCRIBE
FIGURE 4: BASE URL SETTINGS Set the HTTP Header parameters HeaderparametersinHTTPtransformationcontainheaderdataforrequestandresponseina specifiedformatsuchasXMLorJSON.Followingaretheparameters: DefaultValue:Specifytheacceptablevaluessupportedbythewebservice.Bydefault,the responsewillbeinJSON.IfyouneedXMLyouneedtospecifyas ‘text/xml’ HTTPName:ForRESTAPIthedefaultvalueis “Accept” FIGURE 5: HEADER PARAMETER SETTINGS HTTP Method Selection Type SpecifythetypeofHTTPmethodontheURL.Inourexamplewearetryingtogettheorder detailinformation,sospecifythetypeas “GET” SUBSCRIBE
FIGURE 6: HTTP METHOD SELECTION TYPE HTTP Output PasstheHTTPoutputtoeitheraflatfileoranXMLparsertoparsetheinformationandloadit intothetargettable.Inthisexample,wewritetheoutputoftheHTTPtoaflatfile. Thisishowthefinalmappingwilllooklike. FinalMapping FIGURE 7: FINAL MAPPING Create a connection in Workflow manager and run the workflow NavigatetoWorkflowmanager ->Connections-> Applications->HTTPTransformation FIGURE 8: HTTP APPLICATION TYPE Name:EnterthenameoftheHTTPTransformationwhichisunderstandable SUBSCRIBE
UserName:EntertheusernameoftheRESTAPIURLcall Password:EnterthepasswordfortheURL AuthenticationType:SelecttheAuthenticationtypeas “Basic” Createaworkflowforthemappingandruntheworkflow.Finally,viewtheoutput.Inour example,fortheOrderNumber “ORD-123” FIGURE 9: FINAL OUTPUT Issues faced while connecting to HTTP Transformation WhileusingHTTPTransformationthemostcommonissueis “SSLCertificateError”.Sowhen youruntheworkflowwhichisusingthefinalURLyouwillgetthebelowerrorsinsessionlogs Root Cause ThiserroriscausedbecausetheconnectiontothewebserviceURLorRestAPIdoesnot includethecertificatedatathatisneededtoauthenticatetheconnectionfromthecertificate provider’send.ThecertificatebundledoesnotcontainacertificatefromaCertificateAuthority thattheWebserviceProvideruses. Resolution DownloadtheSSLcertificatesfortheURLandaddtothecertificatefileslocatedunder $INFA_HOME/server/bin/ca-bundle.crt ReferthebelowKBarticletoknowhowtoaddthosecertificates HOWTO:ExtractcertificatesfromaHTTPSURLandaddtoca-bundle.crtfile SUBSCRIBE
Conclusion ThisconcludeshowtocreateaPowerCenterWorkflowusingRESTbasedmethodstoaccessa webserviceusingHTTPTransformation,invokeHTTPcommandstogetdatafromtheweb serviceresource. SeniorTechnicalConsultant Hehashavingaround6plusyearsofexperiencein developmentandimplementationofETLandMDM solutions. SatishKumar MORE READS The Retail Industry and IT Data Management: A Match Made in Heaven (Or at Least in the Cloud) Data Governance and BCBS 239: How our Service Pods can help Next-Generation MDM - Architecting Intelligence for the Future ByJohnHarrington | February16,2023 ByJohnHarrington | January31,2023 ByJeffPohlmann | May5,2022 Stay Updated On The Trending Topics On Data And Analytics. S U B S C R I B E WH O WE ARE C ARE E RS E V E N T S RE S OURC E S BLOG C ON TAC T US MastechInfoTrellis,INC. © 2023 Sitemap TermsofUse PrivacyPolicy MastechInfoTrellisisthewholly-ownedsubsidiaryofMastechDigital SUBSCRIBE