1 / 21

What Should You Consider When Talking About Technical Assessments?

Learn key considerations for technical assessments, including types, levels, development methods, administration, and analysis. The discussion covers important issues, such as validity, reliability, ethical and legal considerations, and the development cycle. Expert insights from Dr. John M. Townsend provide valuable guidance for enhancing assessment practices. Contact Dr. Townsend for further information or consultation.

eastmanj
Download Presentation

What Should You Consider When Talking About Technical Assessments?

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. What Should You Consider When Talking About Technical Assessments? John M. Townsend Tennessee Board of Regents NACTEI 27th Annual Conference

  2. Why are you assessing? Most important question • For Perkins IV? • For Program Improvement? • For student attainment?

  3. If For Student Attainment At what level is appropriate? • Entry level • Mastery level • Industry certification level

  4. When do you assess? End-of-program End-of-course End of Pathway Cluster related

  5. Norm-referenced Comparison among individuals Demonstrates changes of students as a group Competency-referenced Attainment of an individual Measurable learning outcomes based upon industry standards Norm- or Competency-referenced

  6. Buy or Develop? • Standardized instruments • Centralized state-developed instruments • Local assessments recognized by state

  7. Performance What the student should be able to do Checklist Limited number of areas can be assessed in specified time Cognate What the student should know Test-items Many areas can be assessed in a specified time Performance or Cognate

  8. Building an Assessment • Adopt– seek items or assessments that you can adopt as is • Adapt – items or assessments that can be modified to fit your standards • Build – items or assessments when others cannot be found

  9. Table of Specifications (blueprint) • Determine competencies to be assessed • Determine competency groups (3 – 10) • Determine percentage of each cognitive typology per group

  10. Development Questions • Is cost and time worth benefit of test? • Who should develop the assessment? • Test security issues?

  11. Multiple-choice elements: Stem Correct response Foils or distractors

  12. Fixed-form High reliability Needs high security Limited number of test items needed Variable-form Good reliability Lesser security needed Requires a large number of test items Fixed-form v Variable-form

  13. Assessment Administration • Decide the media for administration • Identify who should conduct the assessment • Determine when the assessment activities should occur

  14. Reporting issues: • Grading of the assessment • Assessment improvement needs • Reports needed

  15. Assessment Review • Validity – the degree to which certain inferences can be made from test scores. • Reliability – the degree of consistency between two or more measures of the same thing.

  16. Item & Assessment Analysis Find a good statistician, psychometrician or educational psychologist !

  17. Ethical Issues in Testing Code of Fair Testing Practices in Education by the Joint Committee on Testing Practices, American Educational Research Association, American Psychological Association & National Council on Measurement in Education

  18. Legal Issues • Accommodations for members of special populations • Access to the test-items by parents and others • Utilization of assessments in relation to passing or graduation

  19. Development Cycle • Competency learning outcome development • Blueprint development • Test-item development • Field Testing • Item-analysis

  20. Development Cycle • Set cut scores • Test form development • Assessment administration • Reporting of results

  21. Contact Information: Dr. John M. Townsend Executive Director, Workforce Development Office of Academic Affairs Tennessee Board of Regents 1415 Murfreesboro Pike, Suite 350 Nashville, TN 37217 615-366-4428 John.Townsend@tbr.edu

More Related