310 likes | 424 Views
Institution Research Committee Executive Presentation OUTCOMES PILOT. Committee Decision. IR committee members decided to evaluate alternative tools to uniformly capture sampling data across the colleges:
E N D
Institution Research Committee Executive Presentation OUTCOMES PILOT
Committee Decision IR committee members decided to evaluate alternative tools to uniformly capture sampling data across the colleges: • SBCJC and the IR group partnered with Channelmatter to find the best solution to capture two fundamental feedback instruments: • Student Evaluation Instrument (SEI) • Strategic Planning (SP)
I/R Insight/Challenge • Need to cost effectively capture feedback from the community to make informed decisions to increase institutional effectiveness. • Need flexible reporting and analysis tools to analyze trends, set goals and measure successes. • Proof of Concept (POC) completed August 2010 • Pilot initiated in November 2010
Pilot Actions • Piloted at four pilot colleges and SBCJC. • SharePoint installed and configured • Applications deployed including SEI data imports created for Pilot schools • Initial user testing • SP and SEI instruments remediated based on feedback and redeployed • Training sessions and documentation provided • Applications piloted with subset of end-users comprised of students and instructors • Pilot successful
Pilot Results SEI • SEI Survey: • Likert Survey • Tag question to organize • Reusable Survey • SEI Report: • Summary data • Organized by section • Comparative
SEI Survey • Manage Survey: • Create • Edit • Duplicate • Delete • Reusable • Customize Template: • Formatting • Substitution variables
SEI Question • Questions: • Likert and Free Response for SEI • Multiple-choice and True/False • Add from question bank • Includes Spell Check • Dynamic name/value pairs • HTML formatting • Question Tags: • Freeform meta-data • Used for grouping questions for reporting • Assigned by question • Multiple tags per question
SEI Criteria • Criteria: • Determine Recipients • Reusable • Filtering for searching • Provides participant count and view • Academic Criteria: • Extracts recipients from SIS • Select by: • Course/section • Demographics • Open Criteria: • Manual recipient list imported from excel
SEI Deployment • Deployment: • Set Timing • Set Reminders • Filter for searching • View Participants
SEI Response • Sample E-mail with link to complete • Sample Survey
SEI Reporting • One per instructor/section • Overall • By Tag • By Question • Comments
Strategic Planning • Strategic Planning Form: • Strategic goals/tags • Departmental objectives/outcomes • Strategic Planning Report: • Strategic View • Departmental View
Strategic Planning • Plan Management: • View status and response rates • Copy existing plan • Create: • Set timing for loops • Set reminder options • Set minimum number of outcomes
Strategic Planning • Plan Settings: • Timing • Tags • Goals • Recipients • Deployment: • Data: • View respondents plans • Reports: • Five reports • Export to Office • IR Admin Tools: • Send e-mail reminder to recipient and/or director • Update deployed plans
Goals/Tags • Planning Goals • Tags • Meta-data for grouping
Deployment • Deployment Wizard • Simple Wizard • Creates planning document for each recipient • Sends e-mail notification
Planning Form • Open Loop
Planning Form • Mid-Year Loop (Optional) • Close Loop
Outcomes Reports • Outcomes by Program • Grid Report to Excel • Budget
Linear Report • By Program • All loops • Exportable to Word to create overall Plan
SEI/SP • SEI Tags can be used for rollup to support Strategic Planning Outcomes Means of Assessment
Recommendations • Pilot College adoption of new Outcomes Technology • Capture additional feedback • Provide Support • Survey additional colleges to determine adoption needs • Install and configure Sharepoint at each location or offer up central hosting • On-board the remaining colleges • Provide Training and Support • Consider additional IR needs (e.g. SACS report)
Deployment Cost *Effort can occur concurrently
Benefits • Provide statewide solution to capture and analyze feedback to continuously improve institutional effectiveness. • Cost effective. • Easily deployed and implemented to all colleges. • Simplified user interface. • Ability to develop customized analysis and reporting in-house. • Platform can be leveraged for additional collaboration and functionality. • Order of Magnitude cost savings over the reported Delta Initiative cost.
Five Year Projection POC $ 219,000 Pilot (4) $ 270,000 On-boarding (11) $ 510,000 - 822,500 (central vs. local) (4 Banner, 7 non-Banner) ____________________________________________________________________________ Implementation Cost $ 999,000 – 1,311,500 Support (4 years-$275k annually) $1,100,000 ______________________________________________ Five Year Total Costs $2,099,000 – 2,411,500 Estimates do not include projected internal resources or licensing (a presently incurred costs)
PARTICIPANTS • The I/R pilot includes: • 4 colleges and 9 workgroup members • Itawamba Community College – ICC - Liz Edwards • East Mississippi Community College – EMCC - Andrea Mayfield • Pearl River Community College – PRCC -Martha Lou Smith & Steve Howard (Technical Representative) • Holmes Community College – HOLMESCC – Lindy McCain • MGCCC – David Besancon (Technical Representative)
HOSTING • Can be hosted centrally, locally or mixed • Centralized Hosting at SBJCJ offers: • Economies of Scale • Hardware • Support Personnel • Can be hosted individually at each college • Requires hardware and software deployment, support • Several colleges have a Sharepoint Environment in place
Individually Hosted Cost On Campus *$12,500 *$10,000-$20,000 $40,000-$50,000 Per College: Server(s) SharePoint Setup On-boarding per college • Data integration, training, support • Additional week for non-banner SIS * Some campuses already have SharePoint on-site, meaning no SharePoint server and reduced setup costs