150 likes | 317 Views
Can student achievement data be used to fairly evaluate the effectiveness of schooling?Yes!!. How can a fair evaluation be achieved?The academic progress of each student must be followed, which requires the maintenance of an accurate longitudinally merged database of appropriate individual stu
E N D
4. How can the progress of individual students be measured with a reasonable degree of reliability given the error of measurements in individual tests?
5. There is only ONE way!!
The use of all of each students test data within the context of a multivariate, longitudinal analysis!!
6. What are the Test Data Requirements: Scales from tests must be highly-correlated with curricular objectives.
Tests must have sufficient stretch to enable progress from low and high achieving students to be measured.
Tests must have appropriate reliabilities.
Note: Either vertically or non-vertically scaled test data can be used.
7. However, this approach is fraught with many statistical and technical problems which must be overcome!
Some of the major problems are:
Fractured student records
Tests not on the same scale
Disproportionate mobility of students related to their SES status
Etc.
8. Statistical theory and proven methodology exists to deal with these problems.
However, the computational and data requirements are huge.
Simplistic analytical processes will produce results that are totally unreliable.
9. What about Socio-Economic factors?
It is been documented that if each students longitudinal record is used in the analysis, there is no need to adjust for SES measures at the student level.
If adjustments for SES factors are made at the group level, then inequities that affect students will too often be masked.