1 / 10

Evaluation Data Compiler

Evaluation Data Compiler. Better, Faster, Cheaper Selection. Lawrence F. Alwin, CPA Texas State Auditor NSAA Annual Meeting 2004. Evaluation Data Compiler. Automated decision support tool Collects, organizes, analyzes, reports quantitative and qualitative data Reduces evaluation time

tia
Download Presentation

Evaluation Data Compiler

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation Data Compiler Better, Faster, Cheaper Selection Lawrence F. Alwin, CPA Texas State Auditor NSAA Annual Meeting 2004

  2. Evaluation Data Compiler • Automated decision support tool • Collects, organizes, analyzes, reports quantitative and qualitative data • Reduces evaluation time • Ensures objectivity • Enhances decision quality • Minimizes probability of award protest

  3. Service Impact and Financial Outcomes • Saved $41,000 - $80,000 per evaluation by: • Standardizing evaluation process • Accelerating evaluation schedules • Eliminating all paper • Additional savings from avoiding protests

  4. Usefulness and Success • Simplifies evaluation process • Rated “very useful” by users • “Cleanest, fastest” way to evaluate responses • “If success scale is 1 to 5, the Compiler is a 10.” • 9 procurements totaling $516 million – no award protests

  5. Innovative Features • Use for any criteria-based evaluation • Processes up to 360,000 scores and 360,000 comments • References and cross-references criteria • Uses any scoring or weighting design • Eliminates need for evaluators to be in same location (“virtual evaluation” tool)

  6. Built-in Controls • Eliminates subjectivity of using only ranking • Automates and locks out all calculations • Validates score entry • Statistically tests scores • Examines evaluator consistency/collusion • Flags evaluator disagreements • Creates fully automated audit trail

  7. Sample Summary Report

  8. Built-in Controls • Eliminates subjectivity of using only ranking • Automates and locks out all calculations • Validates score entry • Statistically tests scores • Examines evaluator consistency/collusion • Flags evaluator disagreement • Creates fully automated audit trail

  9. Reporting and Documentation • Reports on up to 1200 criteria • Creates easy-to-use summary reports • Sorts and reports scores and comments by respondent, evaluator, team or criterion • Permanently links scores and comments • Permanently locks and stores data for archive

  10. Data Compiler Future • Web-based version • Ready for alpha testing • Beta test site selected • Available late 2004

More Related