730 likes | 846 Views
Reducing digestible tidbits from meaty stock:. Satisfying varied tastes with an attractive instructional assessment menu. Erika Bennett, Jennie Simning, & Kim Staley Capella University Library LOEX 2011. How are you turning your data into persuasion?. 1) The Hoarder .
E N D
Reducing digestible tidbits from meaty stock: Satisfying varied tastes with an attractive instructional assessment menu Erika Bennett, Jennie Simning, & Kim Staley Capella University Library LOEX 2011
How are you turning your data into persuasion? 1) The Hoarder
How are you turning your data into persuasion? 2) The Philosopher
How are you turning your data into persuasion? 3) Data informs your Actions • You pose questions that data can answer • You gather • You analyze statistically • You propose actions • You carry out and test the actions • Everybody knows what important measures you collect and why.
So this session is for you if… • You collect streams of data that never see the light of day. • There is data you wish you had quickly at hand. • You struggle reconciling decision-makers’ demands with instructional best practices.
Objectives • Prepping the Menu: Who is our audience and what are trying to give them? • Equipment: Why scorecards and dashboards? • From the Pantry: What do we have already? • Preparing the meal: Gathering measures & metrics and creating scorecards and dashboards. • Plating and Garnish: Using technology for attractive dashboard displays & infographics.
About Us • Capella is a regionally accredited online university • 39,900+ students • Avg. age is 39 • Instruction Librarian Team • In-house library, 2007
Education Business
The Big Trends • In IL assessment • Moving toward larger scale value assessments • In business assessment • Balanced assessments of business performance • Significant parallels!
Similar development cycles IL Assessment (ILIAC) Balanced Scorecards Identify perspectives & strategic themes Identify objectives & causal links Create metrics & measures Develop targets & goals Gather data Interpret & analyze data Communicate data, enact decisions, & seek improvement • Review learning goals • Identify learning outcomes • Create learning activities • Enact learning activities • Gather data • Interpret & analyze data • Communicate data, enact decisions, & seek improvement
Assessment Tools • Scorecards • Dashboards • Often confused…
What are Scorecards? • Tool for managing performance • Report card on the organization’s performance. • Key objectives • Measures & Metrics • Goals or targets
Scorecard example From Dagan, 2007
Scorecard example http://www.metricus.jp/index.php/itil/metricus-modules/modules-for-itil-best-practices/request-fulfillment-management.html
Scorecard example http://tandyjacque.narod.ru/balanced-scorecard-example.html
What are Dashboards? • Tool for monitoring performance • Summarize scorecard data • Snap-shot view of most important metrics. • Often graphical, like gauges on the dashboard of your car.
Dashboard example http://www.spiderstrategies.com/blog/index.php/2009/10/stunning-dashboards-from-scott/
Beyond the Stereotype • Proactive tools • Flexible tools
Shared Responsibility Narrow “Old world” Library Instruction • Focusing a Topic • Sources: Background • Searching the Catalog • Search Terms • Searching Periodicals • ID-ing Reference Sources • Citation & References • Library Classification • Etc.
Shared Responsibility Contemporary IL Instruction • Determine Info Need • Research Methods • Scholarly Communications • Information Technology • Evaluating Info Sources • ID-ing Reference Sources • Economic, political, legal and cultural contexts • Evaluating info content • Etc.
Strategy Map A clear illustration of long-term strategy
Strategy Map A clear illustration of long-term strategy
Strategy Mapping http://www.moe.edu.bn/image/image_gallery?img_id=31478
Strategy Mapping Classic Perspectives: • Customer • Financial • Internal Processes • Learning & Growth
Strategy Mapping Our Perspectives: • Learner • Financial • Internal Processes • Learning & Growth
Strategy Mapping Our Perspectives: • Learner • National Standards • Internal Processes • Learning & Growth
Strategy Mapping Our Perspectives: • Learner • National Standards • Internal Processes • Learning & Growth
Our Strategy Map Our Perspectives: • Learner • National Standards • Internal Stakeholders • Learning & Growth
Our Strategy Map • Learner • National • Internal • Growth Perspectives
Our Strategy Map Strategic Themes • Learner • National • Internal • Growth
Strategic Themes • Memorable and motivational names of 3-5 words. • Defensible with good execution.
Our Strategy Map • Lifelong Learning Program Integration • Great Teaching Assessment as Learning • Learner • National • Internal • Growth
Strategic Themes Initiatives Perspectives
Instruction Strategic Scorecard • Key Performance Indicators (KPIs) • Targets and Benchmarks • SWAG approach
Academic Scorecard Example From: http://www.osu.edu/academicplan/2006scorecard.pdf