Christopher Jones Sherri Cook Allison Davis Bill Hogrewe RCAP National Conference New Orleans, LA

1. Get a check on your gut check: Small water system treatment technology decision-support tool Christopher Jones Sherri Cook Allison Davis Bill Hogrewe RCAP National Conference New Orleans, LA April 25th, 2018 Option A ? Option B

2. Workshop Agenda • Part 1: Presentation introducing the tool - 15 minutes • Part 2: Break out session for you to use the tool - 20 min + 5min discussion • Part 3: Survey of your preferences: 5 minutes

3. Learning Objectives For you: To learn how to incorporate input from multiple stakeholders when Considering diverse treatment objectives. For us: Input on how to make the tool better for you

4. Every community is different and this tool will help you identify important objectives in each one.

5. Choosing between alternatives is difficult due to potentially Competing goals. $

6. Multiple treatment technologies must be considered. Conventional Membranes Cartridge Bag Slow Sand Chlorine (multiple contact zones) Ultraviolet (UV)

7. For example, when comparing chlorine against UV, chlorine with plastic piping got the best score using this tool.

8. To get those scores we used a decision-making tool that we will use today. 5. Survey Stakeholder Values (Criteria Weights) 3. Evaluation Methods Affordability 4. Score Normalization 6. Criteria Aggregation 2. Define Characteristics of Alternatives 1. Identify Alternatives Normalized Criteria Scores Criteria Scores Technical Data Global Pollution Human Health Plant Operation Challenges Iteration between aggregated performance Scores and feasibility Performance Score For each alternative 7. Recommend an Alternative

9. For choosing a disinfectant, chlorine and UV were considered. 1. Identify Alternatives Chlorine (multiple contact zones) Ultraviolet (UV)

10. Source water, technical data, and design parameters can be entered or adjusted for a specific plant. 2. Define Characteristics of Alternatives 1. Identify Alternatives Technical Data

11. There are numerous treatment objectives that the tool considers. 3. Evaluation Methods Affordability 2. Define Characteristics of Alternatives 1. Identify Alternatives Technical Data Global Pollution Human Health Plant Operation Challenges RCAP feedback played a pivotal role in defining decision criteria

12. We have developed methods to score each criteria. 3. Evaluation Methods Affordability Global Pollution Human Health Plant Operation Challenges RCAP feedback played a pivotal role in defining decision criteria

13. A qualitative scale will evaluate intrusiveness.

14. A scale will evaluate independence.

15. Raw scores are determined by the tool. 3. Evaluation Methods Affordability 2. Define Characteristics of Alternatives 1. Identify Alternatives Criteria Scores Technical Data Global Pollution Human Health Plant Operation Challenges

16. Scores can be normalized to one another for easier comparisons. 3. Evaluation Methods Affordability 4. Score Normalization 2. Define Characteristics of Alternatives 1. Identify Alternatives Normalized Criteria Scores Criteria Scores Technical Data Global Pollution Human Health Plant Operation Challenges Worst Best

17. Everyone gets a voice in this process. 5. Survey Stakeholder Values (Criteria Weights) 3. Evaluation Methods Affordability 4. Score Normalization 2. Define Characteristics of Alternatives 1. Identify Alternatives Normalized Criteria Scores Criteria Scores Technical Data Global Pollution Human Health Plant Operation Challenges Operators, Community Members, Regulators, Financiers, Engineers

18. Combining stakeholder values and normalized scores gives aggregated scores. 5. Survey Stakeholder Values (Criteria Weights) 3. Evaluation Methods Affordability 4. Score Normalization 6. Criteria Aggregation 2. Define Characteristics of Alternatives 1. Identify Alternatives Normalized Criteria Scores Criteria Scores Technical Data Global Pollution Human Health Plant Operation Challenges Iteration between aggregated performance Scores and feasibility Performance Score For each alternative 7. Recommend an Alternative Worst 0.45 0.39 0.23 0.15 Best

19. That is how the tool was used to get the scores you saw at the beginning. 5. Survey Stakeholder Values (Criteria Weights) 3. Evaluation Methods Affordability 4. Score Normalization 6. Criteria Aggregation 2. Define Characteristics of Alternatives 1. Identify Alternatives Normalized Criteria Scores Criteria Scores Technical Data Global Pollution Human Health Plant Operation Challenges Iteration between aggregated performance Scores and feasibility Performance Score For each alternative 7. Recommend an Alternative

20. Now we have a way to look at multiple objectives for various treatment technologies.

21. This is a draft! Not the final version.

22. With that lets break into groups and evaluate different treatment alternatives using the tool. • Break into 3 groups • Use the tool with your group for 15 minutes • We will discuss together afterwards

23. Your input is needed so we can represent stakeholders better! E-mail: Christopher.H.Jones@Colorado.edu Use: https://goo.gl/forms/pzIKAMZr0HV3Yme73

24. The survey consists of pair-wise comparisons.

25. The survey outputs stakeholder preferences.