1 / 9

Parallel Processing, Scheduling, Enhancement Ideas & Tips

Learn techniques for breaking up workflows to improve performance using in-house scheduling systems. Presentation by Forrest Harper. Explore Alteryx workflow replication, control files usage, scheduling needs, and more.

whunter
Download Presentation

Parallel Processing, Scheduling, Enhancement Ideas & Tips

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Parallel Processing, Scheduling,Enhancement Ideas& Tips Breaking up workflows for performance and utilizing in-house developed scheduling system to enhance operations Presentation by Forrest Harper

  2. Parallel processing • For performance • In most systems there are parts of a “job” which could run concurrently if they can be broken out and run independently, this is true of many Alteryx workflows • For replication, code integrity & maintenance efficiency • Use of Control Files • YXMD or YXMC

  3. CV2CD_Recon.YXMDThis process takes 3 hours to run

  4. 2CashDist_Extract.yxmcThis Process takes 1 hour to run

  5. 2CVG_Hist_Extract.yxmcThis Process takes 1 hour to run

  6. 3CV to CD Bill ReconRpts.yxmcThis Process takes 1 hour to run

  7. Control files • We see how we can break up a workflow into multiple flows to reduce the time to completion, 3 hours to 2 • YXMD, we need to build multiple clones with subtle changes for each entity we wish to run for, i.e multiple companies • YXMC, parameterized filters and such allow us to use macros to take a static module and make it dynamic • Selection Criteria • Directory/Folder structure for file control • Progress tracking and triggering

  8. Control files, Query modification, template files

  9. Scheduling systems & needs • Alteryx has the Server option that has a built in Scheduler • Alteryx has the Designer available with the Scheduler as an option • Alteryx Scheduler functionality is analogous to the Windows Task Scheduler • Limited to daily, Day of week, weekly, monthly and time of day primarily • Within a workflow you can trigger another workflow or external script or program, single item only • Shops who need to operationalize many workflows need more sophisticated features like • Predecessor/successor conditions • conditional days of the month • Notion of business days, 1st business day after or before, 1st of month, last of month, etc. • Conditional restart, alerts

More Related