120 likes | 254 Views
QBR Metric Improvement Project Update. Ken Franklin | Highway Division | SBS. Local Program Leadership Team November 5, 2014. Project O verview. Goals Assess reliability, validity, and business value of PDLT’s project delivery performance measures Recommend and implement improvements.
E N D
QBR Metric Improvement Project Update Ken Franklin | Highway Division | SBS Local Program Leadership Team November 5, 2014
Project Overview Goals Assess reliability, validity, and business value of PDLT’s project delivery performance measures Recommend and implement improvements 2 Phases Data quality of the three KPMs Reliability, validity, and business value of the seven PDLT measures January 2015 December 2015
Phase 1: The 3 KPMS Obtain clean data sets Assess data quality Recommend improvements NTP initiated analysis PCOT initiated analysis POB initiated analysis NTP is the focus of my talk today
NTP Measure: How is it defined?! What’s been reported at QBR since SFY 2007 Q1 What the dashboard (and others*) state Deadline = PS&E Accept Date + Advt Length + FHWA Review weeks + 27 days for OPL’s activities + 57 days for contract time between bid and NTP • Percentage of projects which reached NTP before their target bid-let date + 147 days. • Actual NTP < (target bid let date + 90 window + 57 days for NTP) = “on time” *Eryca McCartin June 2011 memo
Actually, it’s not! Q. Why is local performance worse? NTP (% On Time)
The same NTP data in a scatter plot X Bid Target Date to NTP Days Negative values?
What we should have been measuring What we have been measuring Bid Target Date to NTP PSE Acceptance to NTP
% NTP On Time: Incorrect vs. Corrected Values Corrected (PSE Acceptance to NTP) Incorrect (Bid Target Date to NTP) LOCAL STATE
Box plot view of the data PSE Acceptance to NTP
How to read a box plot Possible outliers Whisker 3rd Quartile Means connected by a line Median 1st Quartile
The original legislative intent of this measure? Bid Date to NTP