Jorge Muñoz -Gama Josep Carmona

1. A fresh look at Precision in Process Conformance Jorge Muñoz-GamaJosep Carmona UniversitatPolitècnica de Catalunya (Barcelona, Spain)

2. Outline • Process Mining and Process Conformance • Motivation • Approach • General Approach • Implementation • Results • Extensions • Future work • Conclusions Precision in Process Conformance

3. Process Mining * www.processmining.org Precision in Process Conformance

4. Conformance Dimensions How much of the observed behavior is captured by the model Models with minimal behavior to represent accurately the log Overly precise models which overfit the log Minimal structure which clearly reflect the behavior Precision in Process Conformance

5. Outline • Process Mining and Process Conformance • Motivation • Approach • General Approach • Implementation • Results • Extensions • Future work • Conclusions Precision in Process Conformance

6. Related Work • Precision in the literature • Most related work Rozinat et al. Information System 33 (2008) • Metric for Precision in Petri Nets • Computation of Follows and Precedes relations (Always, Never, Sometimes) of Model and Log. • Measurement based on discrepancies in Sometimes relations • Model relations require a model space state exploration Coverability Graph Precision in Process Conformance

7. Motivation • Goals and Requirements • Precision Dimension • Petri Nets • Avoid the complete state space exploration • Effort needed to obtain an accurate model • Fine-level precision • Locate the precision inconsistencies Precision in Process Conformance

8. Process Conformance and Refinement Locate the inconsistencies Petri Net • Conformance • (Precision) B A D C MDT ETC Precision Metric A B D A C D Measure the inconsistencies Event Log Precision in Process Conformance

9. Outline • Process Mining and Process Conformance • Motivation • Approach • General Approach • Implementation • Results • Extensions • Future work • Conclusions Precision in Process Conformance

10. General Idea: Escaping Edges Model Behavior Escaping Edges Log Behavior Model Behavior Precision in Process Conformance

11. Conformance Route Map Petri Net B A D C MDT Model States Traversal Metric Log States A B D A C D Event Log Precision in Process Conformance

12. Log and Model States • Log • Incorporate state information in the log • (Aalst et al. Software and Systems Modeling, 2009) • Past, Unlimited and Sequence • Model • Markings of the Petri Net Precision in Process Conformance

13. Model States and Mapping • Not all the reachable markings (could be infinite) • Only Markings with a Log State mapped on • Log and Model States Mapping • i.e., reached marking after replay state prefix p2 p3 p4 p1 p1 p2 p3 p4 p5 B A B E s2 s1 0 1 0 0 1 … 0 1 0 0 n s3 s4 E A C p5 D Markings not explored p1 p4 p3 p2 Precision in Process Conformance

14. Log-guided Traversal • Log-guided Traversal of Model Behavior • Allowed Tasks : • i.e., actions enabled in that moment • Reflected Tasks : • i.e., actions really executed (thus, annotated in the log) B C D <p2> p2 p3 p4 p1 A B E A C E B B B C p2 p3 p4 p1 E E A A C C A B E A C E D D Precision in Process Conformance

15. Traversal (2) • Escaping Edges : • i.e., enabled actions not executed • Precision discrepancies B C D B p1 p2 p3 p4 E A C B C D A B E A C E D Precision in Process Conformance

16. Precision Metric • Take into account the Escaping Edges • Between 0 (imprecise) and 1 (precise) • More frequent traces, more weight in the metric • Independent of Structural dimension • Global precision • Localizability A H I Z A P Q Z H I A Z P Q Precision in Process Conformance

17. Minimal Disconformant Traces (MDT) • Localizability of precision inconsistencies • i.e., Minimal traces indicating where the model starts to deviate from the log • Algorithm to compute all MDT using Escaping Edges B D A C MDT A E A B E C D P Q Refined Petri Net Precision in Process Conformance

18. Outline • Process Mining and Process Conformance • Motivation • Approach • General Approach • Implementation • Results • Extensions • Future work • Conclusions Precision in Process Conformance

19. Implementation • ProM 6 Framework • ETConformance Plug-In Precision in Process Conformance

20. Outline • Process Mining and Process Conformance • Motivation • Approach • General Approach • Implementation • Results • Extensions • Future work • Conclusions Precision in Process Conformance

21. Results Precision in Process Conformance

22. Results (2) Precision in Process Conformance

23. Outline • Process Mining and Process Conformance • Motivation • Approach • General Approach • Implementation • Results • Extensions • Future work • Conclusions • Invisible Tasks • Duplicate Tasks • States as Markings • Non fitting • done • done • in progress • in progress Precision in Process Conformance

24. Invisible Tasks (Transitions associated with no event) p3 I B • Which Sequence? • A H C ? • A I C? A H C p4 • INDETERMINISM A C Precision in Process Conformance

25. Invisible Tasks (2) • Invisible Coverability Graph • Solutions • Union of Enabled • Lazy Invisibles * • One path only • Shortest Invisible Path * A,B A B <1, 0, 0> Inv2 Inv1 <1, ω, 0> <0, 0, 1> C C Inv3 A,D X D <0, ω, 1> A,C X X *Rozinat et al. Information System 33 (2008) Precision in Process Conformance

26. Duplicate Tasks (Several Transitions associated with the same event) • Which Task? • B ? • B ? • INDETERMINISM • Solutions • e.g. Look-ahead B C A B D ... A B C ... Precision in Process Conformance

27. Variant: States as Markings • States as Prefix 2 Escaping Edges B C B A C A B C • States as Markings B A B C A C NO Escaping Edges p1 p2 p3 <p1> <p2> <p3> Precision in Process Conformance

28. Variant: Non fitting models • Symmetric to the Escaping Edges (Ee) • Log Escaping Edges (LEe): The points where the log deviates from the model • Fitness instead of Precision Model Behavior Escaping Edges Log Behavior Log Escaping Edges Model Behavior Precision in Process Conformance

29. Outline • Process Mining and Process Conformance • Motivation • Approach • General Approach • Implementation • Results • Extensions • Future work • Conclusions Precision in Process Conformance

30. Future Work: Refinement B A D C MDT A E A B E B H J G Refined Petri Net Event Log B A E A B E D A Petri Net C Precision in Process Conformance

31. Future Work: Breaking Concurrencies • Concurrencies in the model but not in the log • Break the model concurrency with a restriction, e.g. a place • Structural Concurrency • Best effort overapproximation for general Petri Nets • Exact for live and bounded Free Choice systems • Polynomial Algorithm • Kovalyov and Esparza , Proc. Intl. Workshop on Discrete Event Sytems, 1996 B D A A B C D C Precision in Process Conformance

32. Supervisory Control • Supervisory Control in Process Mining • Santos et al. Supervisory Control Service (2010) Refined Model MDT Abstraction MDT Supervisor Model Precision in Process Conformance

33. Conclusions • New technique for precision between Petri nets and Log. • Avoids complete models state space exploration. • Metric based on the effort needed to obtain a precise model. • MDT, indicating the points where the model starts to deviates from the log. • Approach implemented as plug-in of ProM 6. Precision in Process Conformance

34. Thank You Thank You for Your Attention Precision in Process Conformance