Benchmark Assessment Item Bank

1. Miami-Dade County Public Schools Best Practices When Constructing A Classroom Assessment Benchmark Assessment Item Bank Test Chairpersons Orientation Meeting October 8, 2007

2. What is the item bank? • Searchable electronic database of test items that allows teachers to create tests • High quality items that are aligned to the benchmarks/standards that are currently being taught • Items that differ in complexity and type (multiple choice, short, extended, and gridded responses) • Allows the teacher to retrieve test items based on specific needs

3. Purpose of the item bank? • To allow teachers to monitor student progress on the Reading, Mathematics, and Science Sunshine State Standards • To provide teachers with classroom assessment tools that will provide reliable student-level benchmark information to inform instruction • To provide students with information on their progress on specific benchmarks

4. Scheduled Release • The Benchmark Assessment Item Bank will release the items in the following manner: • Fall 2007 • Math 720 items across grades 3-10 • Reading 1000 items across grades 3-10 • Spring 2008 • Math 227 items per grade level grades 3-10 • Reading 512 items per grade level grades 3-10 • Science 360 items per grade level grades 4, 5, 7, 8, 10, and • 11

5. Steps to Constructing a Classroom Test • Determine the purpose of the test • Construct a test blueprint • -Benchmarks to be assessed • -Cognitive Complexity • -Length of test/number of items • Determine benchmarks to be assessed • Determine types of items that will be used • Select appropriate and relevant test items • Assemble the test • Administer the test • Use the results

6. Purpose of the Test • Determine intended use of the assessment: • Instructional decisions – spend more time on a skill, skip • the review, or stick to the instructional plan • Grading decisions- end of unit test, midterm, or final exam • Diagnostic decisions- determine students’ strengths and • weaknesses • Remediation decisions

7. Getting Started: Developing A Blueprint • Identify standards/benchmarks to be tested • Prepare a list of targeted skills that you want assessed • Develop a blueprint listing: specific content focus, number of items, cognitive level, and the percent of items by content focus • Standards/benchmarks that received more instructional time should contain more test items • Ensure that there is a balance in the distribution of items Click

8. Selecting Types of Test Items • Item provides a direct measure of the outcome it was • designed to measure • Analyze the performance and depth described in the • specific learning outcome • Assess the depth of student knowledge • Include a balance of item difficulty using Webb’s Levels • of Complexity • Select the test-item type most appropriate for the • purpose Click

9. Selecting Appropriate and Relevant Items • Does the item measure the benchmark? • Does the item measure an important concept? • Is the item appropriate for the grade level? • Does the item require students to use the appropriate cognitive level? • Are there different levels of complexity reflected? • Is the level of reading skill required by this item below the students’ ability? (mathematics and science) • Will all or almost all students answer the item in the suggested time frame for the type of question?

10. Assembling the Test • Determine relative importance of benchmark • Minimum of four items for each, if you want a reliable measure of an individual benchmark • Decide length • Number of items: will depend on complexity, grade, and purpose • of test • Length of test administration should be appropriate for grade level • Assembling the test • Check your Answer Key • Determine how students will record their answers • Provide space for name and date • Be sure directions are specific and accurate • Proofread the test before distributing it to students • Reproducing the test • Use quality copies

11. Selecting Items From ExamView • The ExamView Test Generator allows you to create and customize the test with a variety of selections: • by Standard • by Criteria • Viewing questions • Randomly

12. Administering the Test • Students should have enough time to complete all items • Provide instructions before the test is administered • Alert students to the amount of time left toward the end of the test • Clarify test collection procedures before handing out the test • Maintain a positive test-taking attitude

13. Scoring the test • Have the key prepared in advance • Have the key checked for accuracy • Decide if you will hand score or use the Edusoft • System to develop and score your answer sheets • Ensure that you have given each item the • appropriate point value • Use the rubrics and anchor papers for scoring • guidelines for constructed test items (short, • and extended responses)

14. Evaluate the test Select the report that is appropriate to the needs of the teacher. • Possible Benchmark Exam Reports that can be retrieved via Edusoft: • Class List Reports • Item Analysis Report • Item Response Report • Student Performance Report

15. Use the Results (Debriefing Guidelines) • Provide students with their test and answer sheet • Examine the test with your students • Discuss any items you found to be problematic • for the class as a whole • Listen to students comments and reactions • Make notes of any deficient or problematic items • during this process • Consider students comments, complaints, and • suggestions for test improvement not omitting items • or providing partial or extra credit

16. Revise the Classroom Test • Did the test accomplish what was intended? • Were you able to use the test results to determine progress towards learning benchmarks? • Were students able to use the test results to determine progress? • What did students think about the test?

17. Item Bank Security Agreement Educators using the Benchmark Interim Assessment Item Bank • may NOT; • Add any items from other banks into the Benchmark Assessment Item Bank • Modify the ETS items in any manner • Export, copy, or save the items to any system, hardware, or software