440 likes | 535 Views
Joint ILS Manager Tools Course Development. T.R. “Randy” Pilling Program Director, Acquisition Logistics (703) 805-2277 thomas.pilling@dau.mil September 12, 2005. Joint ILS Manager Tools Course Development.
E N D
Joint ILS Manager Tools Course Development T.R. “Randy” Pilling Program Director, Acquisition Logistics (703) 805-2277 thomas.pilling@dau.mil September 12, 2005
Joint ILS Manager ToolsCourse Development • DAU contacted by LOGSA (Bill Edwards) seeking endorsement, partnership, co-teaching in course development and delivery • DAU also aware of LMI support to Navy regarding development and delivery of ILS courses • First coordination meeting 4 Aug 05: • Consensus on need, requirements and content • Assignment specific, level 200 course • Agreed to share coordination & control in course development • Level of commitment to get it done • Course objectives and development timelines in work—potential deployment 1Q FY 07 • Manpower and funding provided by LOGSA
ILS Manager Tools Course Preliminary Schedule
Metrics-That-Matter (MtM) Logistics & Sustainment Course Metrics T.R. “Randy” Pilling Program Director, Acquisition Logistics (703) 805-2277 thomas.pilling@dau.mil September 12, 2005
DAU Metrics-That-Matter (MtM) • Metrics that Matter (MTM) Survey System serves as the standard application DAU-Wide for recording of customer support for both students • and special customer requested projects. • Data is collected at the end of or immediately following each course • Survey questions cover areas relating to: • Instructor • Courseware • Learning Effectiveness/On-Line Learning • Job Impact • Environment
6.0: DAU Instructor rating 5.2: DAU Instructor rating Highly Dissatisfied Highly Dissatisfied Highly Satisfied Highly Satisfied Dissatisfied Neutral Satisfied 3 4 5 6 7 1 2 5.6: DAU other category ratings 5.2: DAU other category ratings Report Card Grading MtM 7 Point Scale • Other includes: • Courseware • Learning Effectiveness • Environment • Job impact • Online Delivery (where applicable)
48 41 31 65 16 0 0 64 7 0 4 3 7 0 6 0 29 11 All Courses: 2nd Quarter Summary 71 courses: 48 residence, 23 DL
LOG: 2nd Quarter Summary 101 102 201A 201B 203204
LOG: 2nd Quarter Summary 235A 235B 304
PMT/ACQ/FE: 2nd Quarter Summary ACQ ACQ ACQ PMT PMT PMT FE 101 201A 201B 250 352A 352B 201
E&T: 2nd Quarter Summary IRM IRM IRM SAM SAM SAM PQM 101 201 301 101 201 301 101
E&T: 2nd Quarter Summary PQM PQM PQM PQM PQM PQM STM 104 201A 201B 202 212 301 201
E&T: 2nd Quarter Summary STM SYS SYS SYS TST TST TST 302 201A 201B 301 101 202 301
DAU Strategy • Identify issues/inconsistencies with MtM results • Review survey questions • Determine applicable data filters • Review processes for data collection/allocation • Develop standardized procedures for collecting, filtering and reporting accurate data • Continue to review MtM results/progress at executive level and incorporate data into faculty/staff assessment reports • Implement “Data Mart” tool for fusion of MtM, travel, timekeeping and financial data systems
MTM LOG 101 Report Card 2nd Qtr 5.89 5.85 5.70 5.69 5.89 5.90 5.38 5.36
MTM LOG 102 Report Card 2nd Qtr 5.84 5.85 5.73 5.75 5.90 5.81 5.33 5.31
MTM LOG 201A Report Card 2nd Qtr 5.86 5.92 5.86 5.93 5.90 5.90 5.31 5.17
MTM LOG 201B Report Card 2nd Qtr 6.64 6.61 6.12 6.05 5.97 5.97 6.02 6.02 5.50 5.48
MTM LOG 203 Report Card 2nd Qtr 6.15 6.14 6.25 6.07 6.04 6.02 5.50 5.55
MTM LOG 235A Report Card 2nd Qtr 5.85 5.97 5.72 5.88 5.95 5.82 5.36 5.26
MTM LOG 235B Report Card 2nd Qtr 6.68 6.60 6.05 6.04 6.20 6.04 6.09 6.13 5.47 5.55
MTM LOG 204 Report Card 2nd Qtr 6.74 6.66 5.41 5.83 6.24 6.15 6.13 6.19 5.93 6.11
MTM LOG 304 Report Card 2nd Qtr 6.75 6.73 6.08 6.16 6.20 6.27 6.26 6.18 5.88 5.88
MTM ACQ 101 Report Card 2nd Qtr 5.95 5.94 5.86 5.88 6.07 6.09 5.45 5.12
MTM ACQ 201A Report Card 2nd Qtr 5.74 5.75 5.54 5.53 5.85 5.84 5.24 5.25
MTM ACQ 201B Report Card 2nd Qtr 6.67 6.68 5.77 5.82 6.12 6.10 6.21 6.17 5.53 5.58
MTM PMT 250 Report Card 2nd Qtr 6.53 6.69 5.14 5.79 5.93 5.59 5.62 5.73 5.57 5.73 5.29
MTM STM 201 Report Card 2nd Qtr 6.31 6.33 4.81 4.91 5.46 5.42 5.52 5.41 5.33 5.35
MTM STM 302 Report Card 2nd Qtr 6.40 6.34 5.63 5.35 5.62 5.50 5.81 5.83 5.44 5.32
MTM SYS 201A Report Card 2nd Qtr 5.52 5.59 5.33 5.32 5.49 5.52 5.09 5.10
MTM SYS 201B Report Card 2nd Qtr 6.46 6.39 5.74 5.79 5.69 5.57 5.62 5.50 5.23 5.11
MTM SYS 301 Report Card 2nd Qtr 6.43 6.40 5.66 5.60 5.65 5.62 5.62 5.60 5.29 5.34
Report Card Grading (survey questions)
Report Card Grading (survey questions)
Report Card Grading (survey questions)
7 6 5 4 3 2 1 n/a The content was divided into small enough units to allow for sufficient learning. 7 6 5 4 3 2 1 n/a The electronic user interface was friendly and easy to navigate. 7 6 5 4 3 2 1 n/a The online delivery had the right level of user interaction/involvement. 7 6 5 4 3 2 1 n/a The graphics and illustrations used were meaningful and within context. 7 6 5 4 3 2 1 n/a The instructor was helpful. (web-based only) 7 6 5 4 3 2 1 n/a This delivery method was an effective way for me to learn the material. 7 6 5 4 3 2 1 n/a The online help desk was beneficial. 7 6 5 4 3 2 1 n/a The exercises or knowledge reviews added value to my learning. (facilitated online courses only On-line Survey Questions