50 likes | 65 Views
A concrete response to criticisms to improve project selection and evaluation processes. Research leaders assess projects based on scientific merit and broader impact, using specified metrics. Iterative process of review and feedback with key stakeholders for portfolio planning. QoLT Project Evaluation Criteria implemented for comprehensive assessment.
E N D
QoLT project review plan • Goal: • a concrete response to the Site Visit Team’s criticisms that we don’t have processes for selecting new projects or evaluating current projects • Approach: • each research cluster leader does an internal evaluation • for each individual project, address: • NSF’s two criteria of scientific merit and broader impact • selected metrics from our evaluation chart (at least one impact, one relevance, and execution quality) • for the cluster as a whole, address all metrics in our evaluation chart • a) research leaders & QoLT directors discuss the evaluations internally;b) leaders propose fate of projects (continue/don’t; budget up/down/same; scope change/not)c) research leaders propose additional (new) projects • ITERATE: • QoLT Directors discuss with SAB and IPAB; AB’s provide recommendations • feedback to research leaders • research leaders propose next year portfolio to Directors
QoLT Project Evaluation Criteria Quality of Life Technology Center 2 Carnegie Mellon University | University of Pittsburgh
Project SPICE (example, with apologies to HERB) recommendation continue & increase budget continue & decrease budget score as ✔+ , ✔ , ✔- continue at same budget discontinue
who reviews what Quality of Life Technology Center 4 Carnegie Mellon University | University of Pittsburgh
who prepares initial evaluations • Human-System Interaction Thrust (HSIT) Dan Siewiorek • Perception & Awareness Thrust (PAT) Martial Hebert • Person & Society Thrust (PST) Rich Schulz • Mobility & Manipulation Thrust (MoMaT) Chris Atkeson • Active Home (AH) Chris Atkeson • Personal Mobility & Manipulation Appliance (PerMMA) Rory Cooper • Safe Driving (SD) Aaron Steinfeld • Virtual Coach (VC) Dan Siewiorek • Natural Environment Testbeds (NET) Howard Wactlar