240 likes | 250 Views
Intro to NRS Data Diving. Mary A. Gaston, Ed.D. & Jennifer Cooper-Keels. February 4, 2011. Why Look at Data?. Data help us to… Replace hunches and anecdotes with facts concerning the changes that are needed; Identify root causes of problems;
E N D
Intro to NRS Data Diving Mary A. Gaston, Ed.D. & Jennifer Cooper-Keels February 4, 2011
Why Look at Data? Data help us to… • Replace hunches and anecdotes with facts concerning the changes that are needed; • Identify root causes of problems; • Identify whether student or program goals are being met; and • Tell our stakeholders, including students, about the value of our programs and the return on their investments.
Data: A Carrot or a Stick? Data may be used… • To highlight, clarify, and explain what’s happening in your program OR • To show what’s not happening in your program. “However beautiful the strategy, you should occasionally look at the results.” –W. Churchill
Data Tell You • Where you’ve been • Where you are • Where you’re going • How to get there Data can help you design a quality program to help meet learners’ goals.
Applied to Adult Education… What can data do? • Guide you to improve instruction • Measure program success & effectiveness • Tell you if what you are doing is making a difference • Tell you which classes are getting the results you want—and which are not • Get to the root of problems, such as poor retention, low educational gains, or low transition rates
Starting the Dive Educational Gain While there are a number of measures in our Data System, the one we will focus on today is:
Educational Gain • Advancement through 12 educational functioning levels • Core NRS measure • Can tell us: • Whether the program/students are meeting goals • Which sites/classes/teachers are most effective • Extent of student progress • Impact of changes
Examples: What Increases Ed Gain • Make classes learner-centered • Focus on relevant knowledge • Opportunity for practice and application • Coherence • Sufficient Intensity and Duration (NRC, 1999; Garet, Porter, Desimone, Birman, & Yoon, 2001)
Do You Trust Your Data? Data analysis is only as good as the original data allow. Keys to good data collection systems include: • Clear policies and procedures for data entry • Data is entered & reviewed daily, weekly, or monthly • Teachers, staff, administrator all have access to data and review regularly • Teachers share data with students What does your program do to ensure data is accurate, reporting is timely, and staff have access to the data?
Dive into the Data Pool For each of the next few slides write down yourobservations for discussion • What do you see? • What is interesting or unusual? • Do any questions or hypotheses come to mind as a result?
Write Observations/Questions? Main AM Young Adult Main PM Satellite R
Where to Go From Here? Based on what was learned from this “data dive”: • What should I change or replicate? • What data supports this change? What additional data should be reviewed? • What is the timeframe for change? Is it realistic? • What obstacles/barriers will we encounter? • What is the follow-up plan to measure and evaluate change?
What Do I Want to Know? What questions do you want to answer about your own local program?