850 likes | 1.04k Views
Fall 2013 End-of-Course Assessments Training Materials for School Assessment Coordinators. Algebra 1 Biology 1 Geometry U.S. History. Test Administration Manual.
E N D
Fall 2013End-of-Course AssessmentsTraining Materialsfor School Assessment Coordinators Algebra 1 Biology 1 Geometry U.S. History
Test Administration Manual • One manual (2012-2013 EOC Manual) is provided for the Winter 2012, Spring 2013, Summer 2013 and Fall 2013 EOC administrations. • Instructions for computer-based test (CBT), paper-based test (PBT), and accommodated form administrations are included in this manual.
CBT Training Resources NEW! A new website has been created to compile several resources for computer-based testing. The site includes information about test setup, best practices, and training resources. This site is located at www.FLAssessments.com/CBTTrainingResources.
Technology Coordinator Guide Information and instructions for technology coordinators to follow before, during, and after testing are now provided in a separate online Technology Coordinator Guide posted at www.FLAssessments.com/EOC. Technology coordinators must familiarize themselves with all information in this guide prior to the test administration. Technology Coordinator Guide (TCG)
Glossary of Terms PearsonAccess– www.pearsonaccess.com/fl • A website used for almost all test preparation (e.g., PreID), setup, administration, and reporting tasks. • Requires a username and password. • Link to support materials: www.FLAssessments.com/EOC • Verify the correct test administration is selected each time you log in. • PearsonAccess will timeout after 14 minutes of inactivity.
Glossary of Terms PearsonAccess Training Center • Accessed from the Training Center tab on PearsonAccess home page. • Provides an opportunity to • practice PearsonAccess tasks • manage the Infrastructure Trial in preparation for testing • Requires a username and password. EOC Manual 279-282
Glossary of Terms Proctor Caching • A process of locally loading or “caching” test content on a computer at the school level. • Does not require a separate caching server and can run on any workstation on the network that meets minimum requirements. • Software is provided by Pearson. • Reduces test delays due to network congestion. • Provides students with a more seamless testing experience. • Requiredfor all FCAT 2.0/EOC computer-based testing in Florida. EOC Manual 2, 98 and TCG
Glossary of Terms TestNav 6.9 (TestNav) • Platform for Florida’s FCAT 2.0/EOC computer-based statewide assessments. • Software application installed either on a file server or on each computer that will be used for testing. EOC Manual 2 and TCG
Glossary of Terms TestHear 2.1.0.7 (TestHear) • Platform used to deliver accommodated forms (e.g., large print, zoom, color contrast, screen reader, assistive devices) for Florida’s FCAT 2.0/EOC computer-based statewide assessments. • Software application installed on each computer that will be used to test students who require computer-based accommodated forms. • TestHear will operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). • TestHear will not work on Mac OS X 10.4 or on Macs that cannot also run Windows. EOC Manual 2, 7 and TCG
Glossary of Terms ePAT(Electronic Practice Assessment Tool) • Provides students an opportunity to practice using the computer-based platform prior to testing. • Available for download at www.FLAssessments.com/ePATs. • Download ePAT launcher separately from practice test content. • Accommodated ePATs are also available. Launcher is bundled with the practice test content for accommodated forms. • Scripts and instructions for downloading ePATs are under the Resources tab. EOC Manual 2, 22
EOC Test AdministrationSchedule • The Fall 2013 EOC testing schedule* is September 16 – 27, 2013. • US History • Biology 1 • Algebra 1 • Geometry *For CBT, subjects must be tested in this order. Testing for one subject must be completed in a school before testing for another subject may begin. • Paper-based accommodations for all subjects must be administered during the first three days of the testing window to meet the accelerated return deadline to ensure timely reporting of test results. Note: No testing on September 26; Secondary Early Release Day. Any deviation from the test administration schedule requires written approval from the Florida Department of Education (FDOE) prior to implementation. Training Packet
EOC Test AdministrationSchedule, cont. Testing Duration • Each Algebra 1, Biology 1, Geometry, and U.S. History EOC Assessment will be administered in one 160-minute session with a scheduled 10-minute break after 80 minutes. Students are not allowed to talk during the break. Individual restroom breaks are permitted as needed. • Students may be dismissed from the testing room after the 10-minute break as they complete testing. However, no special incentives should be given to students to encourage them to finish early. • Any student who has not completed the test by the end of the allotted time may continue working; however, testing must be completed within one school day. EOC Manual 3
Fall/Winter Infrastructure Trial Infrastructure Trial: September 3-11 • Simulates a computer-based test using mock test items to test the vendor’s, District’s, and schools’ hardware and network capacity prior to the operational administration. • Set up the Trial to use all computers scheduled to be used concurrently during the Fall and Winter 2013 CBT administrations. • Manage the test sessions in the PearsonAccess Training Center • Use the tools provided by Pearson to determine network user capacity and bandwidth requirements • Takes approximately thirty minutes for users to log in, complete the exercise and submit the test • Complete a brief survey at http://www.surveymonkey.com/s/FYF3MZ3by September 13 to certify that the trial was conducted to identify any problems that need to be addressed prior test administration. EOC Manual 2, 7, 279, 292
Students to be Tested Algebra 1 The following students must take the Fall 2013 Algebra 1 EOC Assessment: • All students who were enrolled in and completed one of the following courses during the summer: • Algebra 1 – 1200310 • Algebra 1 Honors – 1200320 • Algebra 1-B – 1200380 • Pre-AICE Mathematics 1 – 1209810 • IB Middle Years Program/Algebra 1 Honors – 1200390 • Algebra 1 for Credit Recovery - 1200315 • Algebra 1B for Credit Recovery - 1200385 EOC Manual 3
Students to be Tested, (cont.) Algebra 1 The following students are eligible to participate in the Fall 2013 Algebra 1 EOC Assessment administration: • Students who need to retake the assessment to earn a passing score for course credit, including students enrolled in credit recovery courses • Students who entered 9th grade in the 2010–11 school year • who have not yet taken the assessment to be averaged as 30% of their final course grade • who are in grade forgiveness programs and wish to retake the assessment to improve their course grade • Students in a credit acceleration program (CAP) who wish to take the assessment to earn course credit EOC Manual 3
Students to be Tested Biology 1 The following students must take the Fall 2013 Biology 1 EOC Assessment: All students who were enrolled in and completed one of the following courses during the summer: Integrated Science 3 Honors – 2002450 AP Biology – 2000340 (if taken to satisfy the high school Biology 1 graduation requirement) This course was omitted from the list in the manual. Biology 1 for Credit Recovery - 2000315 Integrated Science 3 for Credit Recovery - 2002445 • Biology 1 – 2000310 • Biology 1 Honors – 2000320 • Pre-AICE Biology – 2000322 • Biology Technology – 2000430 • Biology 1 PreIB – 2000800 • IB Middle Years Program Biology Honors – 2000850 • Integrated Science 3 – 2002440 EOC Manual 4
Students to be Tested, (cont.) Biology 1 The following students are eligible to participate in the Fall 2013 Biology 1 EOC Assessment administration: • Students who entered 9th grade in the 2011–12 school year and beyond • who have not yet taken the assessment to be averaged as 30% of their final course grade • who are in grade forgiveness programs and wish to retake the assessment to improve their course grade • Students in a credit acceleration program (CAP) who wish to take the assessment to earn course credit EOC Manual 4
Students to be Tested Geometry The following students must take the Fall 2013 Geometry EOC Assessment: • All students who were enrolled in and completed one of the following courses during the summer: • Geometry – 1206310 • Geometry Honors – 1206320 • IB Middle Years Program Geometry Honors – 1206810 • Pre-AICE Mathematics 2 – 1209820 • Geometry for Credit Recovery - 1206315 EOC Manual 4
Students to be Tested, (cont.) Geometry The following students are eligible to participate in the Fall 2013 Geometry EOC Assessment administration: • Students who entered 9th grade in the 2011–12 school year and beyond • who have not yet taken the assessment to be averaged as 30% of their final course grade • who are in grade forgiveness programs and wish to retake the assessment to improve their course grade • Students in a credit acceleration program (CAP) who wish to take the assessment to earn course credit EOC Manual 4
Students to be Tested U.S. History The following students must take the Fall 2013 U.S. History EOC Assessment: • All students who were enrolled in and completed one of the following courses during the summer: • United States History – 2100310 • United States History Honors – 2100320 EOC Manual 4-5
Students to be Tested, (cont.) US History The following students are eligible to participate in the Fall 2013 US History EOC Assessment administration: • Students who entered 9th grade in the 2012-13 school year and beyond • who have not yet taken the assessment to be averaged as 30% of their final course grade • who are in grade forgiveness programs and wish to retake the assessment to improve their course grade • Students in a credit acceleration program (CAP) who wish to take the assessment to earn course credit EOC Manual 4
Students to be Tested:Special Programs EOC Manual 5-6; 107; 125; Training Packet
Students to be Tested: SWD Students with Disabilities (SWD) • All students with disabilities participate in the statewide assessment program by taking one of the following: • EOC assessment without accommodations, • EOC assessment with accommodations, or • Florida Alternate Assessment. • All determinations regarding participation in the statewide assessment program must be documented in the student’s IEP or Section 504 plan. • See Appendix A of the manual for information regarding accommodations. EOC Manual 7, Appendix A
Students with DisabilitiesAccommodations EOC Manual 6-7; 103-104; 152-170; Appendix A • Administration Accommodations • Flexible presentation • Flexible responding • Flexible setting • Flexible scheduling • Assistive Devices and Tools • Paper-based Accommodations • Regular print • Braille • Large print (New as Unique Accommodation for CBT; beginning in Spring 2013)
Students with Disabilities Accommodated Test Forms Test Hear: Assigning an Accommodated Form Click “Specify” or “Override” on the Session Details screen to assign a specific form. EOC Manual 103-104
Students to be Tested: ELLs English Language Learners (ELLs) All ELLs who complete the appropriate courses are expected to participate in EOC assessments no matter how long these students have been receiving services. See Appendix A of the manual for information regarding accommodations. EOC Manual 6-7; Appendix A
English Language Learners Accommodations • ESOL Levels 1-4 Only • Students who are currently receiving services in a program operated in accordance with an approved district LEP plan: • Flexible Setting • Flexible Scheduling • Additional Time • Assistance In Heritage Language • Approved Dictionary EOC Manual 160
SWD and ELLRecording Accommodations NEW! • Student accommodations can now be recorded in the Test Session Details screen in “Manage Test Sessions” by clicking on a student’s name. • Click the Edit button. • Select the accommodations used by the student in the drop-down menus. • Click the Save button. • Click “Go back to Session Detail” to record accommodations for additional students
File Download Manager (FDM) • The following briefings provide pertinent information regarding the EOC: • Briefing ID # 14070: Procedures to Record Courses in the Transcript Review and Course Evaluation (TRACE) System • Briefing ID #: 12664: Modification of End of Course (EOC) screen in ISIS • Briefing ID #: 11986: New ISIS/TRACE End Of Course Processes • Briefing ID #: 11579: End of Course Guidelines as of March 1, 2012
State and District Requirements • Standards, Guidelines, and Procedures for Test Administration and Test Security available at http://oada.dadeschools.net/TestChairInfo/InfoForTestChair.asp • Adopted by School Board • General Guidelines • Florida Test Security Statute and Rule • School Procedural Checklist (FM-6927) • District Monitors EOC Manual 13-14; Appendix B; Training Packet
Test Security Policies and Procedures: Prohibited Activities • Reading the passages, test items, or performance tasks. • Revealing the passages, test items, or performance tasks. • Copying the passages, test items, or performance tasks. • Explaining or reading test items or passages for students. • Changing or otherwise interfering with student responses to test items. • Causing achievement of schools to be inaccurately measured or reported. • Copying or reading student responses. EOC Manual 13; Appendix B
Test Security Policies and Procedures: Electronic Devices • School personnel must ensure that students do not have access to their cell phones or other electronic devices at any time during testing, including breaks (restroom breaks, etc.), even if they do not use them. • “Possession” is defined as “within arm’s reach,” even if the electronic device is not visible. • Students should not have cell phones in their pockets, clipped to their belts, at their desks, or anywhere they can be easily accessed during testing or breaks. • If a student is found to be in possession of ANY electronic devices during testing or during a break, his or her test must be invalidated. • Students and parents/guardians must be made aware of this policy prior to testing. EOC Manual 20
Reporting Testing Irregularities • All school staff are professionally responsible for ensuring appropriate test administration procedures and reporting any irregularities. • Security Breaches: Test administrators should report any test irregularities (e.g., disruptive students) and possible security breaches to the school assessment coordinator immediately. • Missing Materials: Schools must investigate ANY report of missing materials immediately. • Specified in Standards, Guidelines, and Procedures for Test Administration and Test Security • School Assessment Coordinator/Principal • Student Assessment and Educational Testing • Region Center and/or appropriate District Administrative Office • Appropriate investigative unit, if applicable Note: School personnel must be prepared to provide documentation and information in support of investigations of any testing irregularity. EOC Manual 15-16
Caveon Forensic Analyses • Caveon will analyze data to identify highly unusual test results for two primary groups: • Students with extremely similar test responses; and • Schools with improbable levels of similarity, gains and/or erasures. • Only the most extreme results are flagged and withheld • One in a trillion chance of the pattern occurring by chance
Communicate Testing Policies Communicate Testing Policies to Parents/Guardians and Students • Electronic Devices Policy—If students are found with ANY electronic devices during testing OR during breaks, their tests will be invalidated. The best practice would be for students to leave devices at home or in their lockers on the day of testing. • Leaving Campus—If students leave campus before completing the test (for lunch, an appointment, or illness, etc.), they WILL NOT be allowed to complete the test. If a student does not feel well on the day of testing, it may be best for the student to wait and be tested on a make-up day. • Testing Rules Acknowledgment—Students will click a checkbox (TestNav) or circle (TestHear) next to a Testing Rules Acknowledgment that reads: “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.” EOC Manual 27, 325
Receive Test Materials/Maintain Test Security Keep materials secure at all times. Maintain the Test Materials Chain of Custody Form at all times. No more than three individuals may have access to the locked storage area. Do not open shrink-wrapped materials or begin preparing them more than three days prior to testing. Save the original boxes for returning TO BE SCORED special document materials. If you need additional materials, contact the Test Distribution Center at 305-995-3743. EOC Manual 84-86 and Training Packet
Create/Update School User Accounts • School user accounts are necessary to complete the CBT test activities. • Create or reset your password for each Pearson site (operational and training center). • Create school user accounts for test administrators in Pearson’s operational site (optional). • Two different school user accounts may be set up: • Individual accounts for each test administrator • Test administrator will set up unique password. • Generic accounts linked to the school assessment coordinator • The password will be the same for all test administrators. • These accounts can be randomly assigned. • Test administrators may monitor and resume students with a school user account. See back of Training Packet
2012-13 EOC Manual • To read the test administration script(s) to students. • To identify script modifications for LP and One-Item-Per-Page test administrations, as applicable. • Do not interpret this as permission to paraphrase test items. • To read scripts and instructions for the administration of accommodated CBT(TestHear) forms and paper-based forms are provided in Appendix A. • To reference Appendix D on page 284 is the CBT Test Administrator Quick Reference Guide • This guide lists possible error messages students may encounter, explanations for each message, and possible solutions. EOC Manual 268, 284
Training – Test Administratorsand Proctors Read the Florida Test Security Statute and the State Board of Education Test Security Rule (Appendix B) in the test administration manual. Ensure that test administrators sign the Florida EOC Test Administration and Security Agreement and Test Administrator Prohibited Activities Agreement. Train your test administrators and proctors, including non-school-based instructors (e.g., itinerant teachers). Communicate the process for collecting required administration information to your test administrators. If any students who require accommodations are testing at your school, discuss with test administrators how accommodations will be provided (Appendix A). EOC Manual 13, 305, 307, Appendix A
Training - Proctors • When testing a large group of students, proctors must be assigned to the room. Refer to the table below for the required number of proctors. *It is strongly recommended that a proctor be assigned to rooms with 25 or fewer students whenever possible. Note: Students cannot serve as proctors or volunteers. EOC Manual 14-15
Training - Testing Location EOC Manual 86-87 • Use classrooms whenever possible. • Make sure that each room is free of distractions and has • Comfortable seating • Good lighting • Sufficient workspace • Adequate ventilation • Make sure that: • students are not facing each other when seated at tables • there is at least three feet between students • students cannot view others’ computer screens (visual barriers are installed) • Remove or cover all visual aids on student desks or displayed in the room, such as posters showing mathematical and scientific concepts. EOC Manual 22-23
Training – Preparing CBT • Ensure that all software applications, including Internet browsers, are closed on all student workstations. • Start TestNav, type in the correct URL, and open each student workstation to the student login screen, but do not log in for students. • Display the student comment form URL (www.FLAssessments.com/EOCStudentCommentForm) on the day of testing, or create shortcuts on student workstations to ensure each student is able to complete the form after testing. • Ensure that the test administrator has a way to contact the technology coordinator or school coordinator during testing without leaving the room unattended. EOC Manual 31-32
Training – Supervision of Test Administration Students have cleared the area around their workstations of all materials except for Student Authorization Tickets, pens or pencils, and, as applicable, calculators, work folders, worksheets, reference sheets, and periodic tables. Students check the Testing Rules Acknowledgment box and enter the correct test group code. Students do not have electronic devices (except for approved calculators) of any kind during testing, even if they do not use them. Students do not talk to other students or make any disturbance. Students are working independently. Students are working in the correct test. If students finish the test in the first 80 minutes before the 10-minute break, you may encourage them to go back and check their work. As students complete the test, assist them with accessing the student comment form, as needed. EOC Manual 30
Training - Testing Rules Acknowledgment All EOC assessments include a Testing Rules Acknowledgment that reads, “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.” Prior to testing, students must acknowledge the testing rules that the test administrator reads to them by checking a box (in TestNav) or clicking a circle (in TestHear) next to the statement. Students taking a paper-based test will sign below the acknowledgment. EOC Manual 29
Student Authorization Tickets For each test session, each student needs a Login ID and a 6-character test code (password), which are printed on the Student Authorization Tickets. Students will need a pen or pencil during testing to sign their tickets. Provide each student a ticket only AFTER all students have entered the testing room, and all tickets must be collected BEFORE students leave the testing room. Student Authorization Tickets must be handled in a secure manner and returned to the school assessment coordinator immediately after each day of testing is completed. EOC Manual 8, 105,
Session Rosters • A Session Roster is a list of all students scheduled in a test session that displays important information including: • Test Administration • Session Name • Test to be Administered • Test Code (password) • Student Names • Florida ID Numbers • Student Birth Dates • Class Information • Login IDs • Blank space to record attendance information and accommodations used • The Session Roster may be used to record required administration information. • Session Rosters must be handled in a secure manner and returned to the school assessment coordinator immediately after each test session is completed. EOC Manual 9, 105
Test Group Code A test group code is a unique four-digit number used to identify a group of students testing together. Create and distribute a unique four-digit number test group code to all test administrators each day of testing. Each group of students, by testing room, initial and make-up, should receive a unique test group code. Students will enter the test group code before beginning the test, as indicated in the scripts. EOC Manual 24
Test Code vs. Test Group Code EOC Manual 24, 26
Four-Function Calculators TestNav • The computer-based TestNav Algebra 1 and Biology 1 EOC assessments have a built-in four-function calculator. • Students may use the built-in calculator, or they may use a handheld four-function calculator. TestHear • Test Hear does NOT have a built-in four-function calculator. • Students who will test using TestHear accommodated forms of the Algebra 1 and Biology 1 EOC Assessments MUST be provided handheld four-function calculators. EOC Manual 10-11, 27