Reviewer Training Material Callis Reviewer version 1.1

1. Reviewer Training MaterialCallis Reviewer version 1.1

2. Why are Peer Reviews interesting? • Peer reviews are the only technique available to detect defects in life-cycle work products in the early phases of development • Peer reviews are a reliable way of measuring the quality of the work that has been performed • Peer reviews reduces cost and time in later phases of development, e.g. test and integration • Peer reviews reduces total system maintenance cost dramatically (up til 10 to 1 according to Kasse, 2007) Are You a believer?

3. Often, this is the situation! • Peer review process is poorly defined • Process is often not followed • No controlled use of checklists • People are not thoroughly trained • Issues are not systematically tracked to closure • No or limited tool support means low efficiency • Data are not collected and used to improve process • Limited visibility into scheduling and results Callis Reviewer helps these issues by providing a standardized review solution

4. Callis Reviewer is • A standard solution supporting the peer review process • Planning including roles, documents, focus areas, and checklists, generating standard invitation • Reporting defects including description, type and severity of defect, if found by checklist • Processing defects including presenting defects in relevant order, defining actions, allocating responsibility • Approval and reporting including presenting defect distribution, defect density, prepation rate, approval categories, and generating review report in pdf • Presenting overviews and indicators, e.g. ”my reviews”, reviews performed, defects found, checklist efficiency, and review timeline • Configuration of relevant parameters easy, including roles, document categories, severity and type codes, approval types, checklists, etc.

5. Overview of Review Process • Four Phases: • Plan: Add purpose, roles, documents, generate invitation • Prepare: Reviewers registers findings and can get an personal reciept • Conclude: Conclusion are made on documents, meeting data are registered • Follow up: Corrector corrects document and sets resolution state on findings. Review report can be generated. • Three documents: Invitation, My findings, and Review report • Metrics collected in database

6. Callis Reviewer Tech. Overview Review Invitation Rich Web2.0 user interface Callis Reviewer Review report MS IIS MSSQL Indicators/data

7. My Reviews • ”My Reviews” lists all reviews that you are invited to (or have created=Owner) • Selecting a node in the ”Projects” tree below will show reviews sorted on specific projects • When ”Show all” is selected, both opened and closed reviews are listed • The state of a specific review is displayed in the ”Status” coloumn – both using colors and text • The ”New Review” button is used to create a new review • An existing review can be opened by double clicking on the relevant row in the list

8. Review process and status overview Phases Process and work products State Participants Metrics

9. Short-cut keys supported (from help)

10. Review Planning • Coloring groups tabs into review phases (plan, prepare, conclude, follow up) • Numbers on tab (1+2+3) documents sequence in actions needed to plan review) • Please notice that an asterisk (*) will indicate unsaved data on tab (not shown here)

11. Participants – Select user • Press ”New” to define new review participant • Select participant in list and press ”Edit” to change participant data • ”Can Manage Review” gives the user rights to change review meeting setup data, e.g. documents to review etc. • ”Can view all findings” makes it possible to view findings made by other reviewers

12. Participants – Select user • User name on review participants are fetched from MS Active Directory • Short names can also be typed directly, if known • Select user in list and press OK

13. Build-in display of configuration data • Description text on all configurable data can be displayed by hovering the parameter. • This includes • Review types • Role definitions • Document types • Severity codes • Defect type codes • Conclusion types • Resolution types Hover this!

14. Documents • HTTP-links to document can be entered or use file browser to browse to file location • Size data are used to produce metrics and indicators HTTP-link here!

15. Documents - Browse to file location Alternatively, select the icon to browse to the file in a shared part of your file system. Only supported in in MS Internet Explorer...

16. Generate review invitation

17. Additional Material • Add background information / additional material, as needed • Same method as when adding documents...

18. Prepare • Please notice that the prepare phase starts with entering findings (next tab and next slide!) • ”Minutes used preparing” is used to calculate prepation rates, indicators etc. • ”Mark as completed” indicates to review leader and other reviewers, that your are ready to meet and review the documents

19. My Findings

20. All Findings • To refresh for new findings from other users, use

21. Conclude – part 1 • Approval of the individual documents

22. Conclude – part 2

23. Follow up • Complete the review • Generate the review report (can also be done from the “Overview” tab • Please notice that you can set resolution on findings on the findings tab • Data on tabs can not be changed, when the review is closed (without opening the review first)

24. Generate review report • Generate the review report (can also be done from the “Overview” tab

25. An sustainable solution • Callis Reviewer is an easy sustainable peer review solution • Tool supporting the review process including planning, reporting in and processing defects and generating review report • Predefined indicators for sustaining implementation, management insight and continuous improvement • Training material supporting use of the tool • With the following customer business characteristics • Reduced risk – By offering a complete and ready-to-go solution in stead of a internal development project or inefficient spread sheets/paper solutions • Reduced cost – By making your reviews more effective and efficient -with a break even measured in (a few) months for most organizations • Reduced schedule – By providing a COTS solution including tool, process descriptions and training material – and a trainer, if needed • Building on a proven solution which is maintained, improved and extended with new functionality

26. Thank you for using Callis Reviewer! • Please point anyone you think could benefit from Callis Reviewer to our website: www.callis.dk • This will help us add more and more functionality into the solution – and your organization will benefit from that!