1 / 43

Washington Online Testi ng

OSPI Superintendent of Public Instruction. Washington Online Testi ng. Online Testing In-depth technology January 11 & 15, 2013. Webinar Protocol. All participants’ microphones are automatically muted to eliminate background noise

carver
Download Presentation

Washington Online Testi ng

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OSPI Superintendent of Public Instruction Washington Online Testing Online Testing In-depth technology January 11 & 15, 2013

  2. Webinar Protocol All participants’ microphones are automatically muted to eliminate background noise All participants may submit questions during the presentation by using the Questions Box on the GotoWebinar toolbar Questions will be addressed throughout the presentation This presentation will be available on the Washington Testing website, http://www.k12.wa.us/TestAdministration/Trainings/default.aspx , under the Online Testing Webinars link

  3. Introductions • Washington Office of Superintendent of Public Instruction (OSPI) • Data Recognition Corporation (DRC) • Vendor for the Measurements of Students Progress (MSP), the High School Proficiency Exam (HSPE) and the End-of-Course Assessments (EOC) • Online testing vendor for MSP • Program Management Team

  4. Agenda • Overview of online testing components • System Requirements • DRC INSIGHT Technology User Guide • Network Requirements • Monitoring Software • Software Downloads • Local Caching Service (LCS) Overview • LCS Installation General • LCS Installations • Windows • Windows Command Line • Mac • Mac Command Line • Linux • LCS – Changing the port number • LCS Client Configuration • LCS Manager • General • Test Versions • Transmitting Student Responses • Unsent Responses • Historical Data • Diagnostics • Bandwidth Calculator • Ping Trends • Test Engine Installation • Windows – silent installation • Windows • Windows – command line • Mac • Mac – command line • Linux • Linux command line • Software updates • System Readiness Check • MSP Technology Readiness Checklist • Commonly Asked Questions • Online Tools Training and Tutorial Installation • Contact Information • Upcoming Training • Questions

  5. Online Testing Components • eDIRECT – secured access to download the online testing components • Tutorials – uses picture, motion and sound to describe the properties, features and tools of the testing software • Online Tools Training – provides students with a hands on opportunity to try out all the features and tools of the testing software prior to the actual test • Local Caching Service (LCS) – The LCS has three roles • Reduces bandwidth by caching the test content • Provides the ability to save responses if the internet connection between the testing site and DRC is temporarily lost • Contains Load Simulation Tool for required System Readiness testing (new in 2013) • Test Engine - operational test engine for grades 3-8 reading and mathematics and grades 5 and 8 science

  6. DRC Insight Technology User Guide • What does the Technology User Guide include: • Installation Instructions: Test Engine, LCS, Online Tools Training, and Tutorials • System Readiness Guidance • Trouble shooting tips • FAQ • Where to find the Technology User Guide: • OSPI website • eDIRECT under Documents

  7. System Requirements for 2013 • What’s New? • Support of Linux 12.04/Gnome 3.4 and Mac 10.7 & 10.8 • Student Test Engine and Local Caching Service • Windows XP/Vista/7/Server 2003 and 2008 • Mac OS 10.5 or above (including Mac 10.7 & 10.8) • Linux Ubuntu 12.04/Gnome 3.4 • Mac Processor: 400 MHz (Intel Macs only are recommended) • Windows Processor: 700 MHz • Memory: 256 MB • Display: Monitors with a resolution of at least 800x600 • Connectivity: Able to connect to the Internet • Easy to Install • Testing engine and the LCS install in minutes • LCS install is highly recommended • Remote installation and shared environment deployment • Automatic updates

  8. System Requirements for 2013 • eDIRECT (Browser requirements): • Most popular browsers: Safari 4.0 or higher, Internet Explorer 7.0 or higher, Chrome, Mozilla Firefox 3.6 or 6.0 or higher • Accept cookies • Accept emails from the @datarecognitioncorp.com domain • Student Tutorials (Browser requirements) • Most popular browsers: Safari 3.1.2 or higher, Internet Explorer 6.0 or higher, Chrome, Mozilla Firefox 2.0 or higher • Updated graphics drivers with screen resolution 800x600 • Flash Plug-in • Sound card (tutorials only; no audio on operational testing)

  9. Network Requirements • Network Connectivity • All workstations used for student testing should have access to the Internet and should be able to access the servers using HTTP/HTTPS protocols on ports 80 and 443 • Firewalls at the local workstation and the network level should allow Java connectivity on ports 80 and 443 • All the URL’s corresponding to the testing servers should be white listed on content filtering or other proxy software used locally https://wa-insight.drcedirect.com http://wa-insight-client.drcedirect.com

  10. Monitoring Software - Prohibited If your testing location uses remote desktop monitoring software to monitor the computers that will be used for testing, you should disable the monitoring software on these computers during test times to guarantee adequate security. The particular steps you need to take vary, depending on the monitoring software you are using and the operating system of the testing computer (for related information, see “Operating Systems, Hardware Devices, and Virtual Desktops”). Note: If it is not feasible to disable your monitoring software, you must ensure that any staff members that can use the monitoring software refrain from using it during testing periods.

  11. Software Downloads • Software downloads • Test Engine and Online Tools Training • Tutorials • Are all available within the eDIRECT System • Test Setup/General Information

  12. LCS Overview • Local Caching Service (LCS) – The LCS has three roles: • Reduces bandwidth by caching the test content • Provides the ability to save responses if the internet connection between the testing site and DRC is temporarily lost • Contains Load Simulation Tool for required System Readiness testing (new in 2013)

  13. LCS Installation - General Same system requirements as the test engine with one exception: requires 1 GB of available hard disk space or greater Runs on a computer within the local network Installed using an installation wizard; requires administrative rights Populated with test content using the LCS Manager; test content updates are automatically downloaded Student workstations must be connected to LCS or Internet otherwise test will terminate LCS highly recommended for caching whenever possible LCS mandatory for the Load Simulation Tool

  14. LCS Installation – Windows, Mac, Linux Windows XP LCS Installation Demonstration

  15. LCS Installation – Window, Mac, Linux You can install an LCS in the Windows environment using the command line interface versus a graphical interface. This is useful to install the software in unattended mode or quickly on a number of computers Reference the Technology User Guide for further installation details

  16. LCS – Changing the port number • Windows, Mac and Linux • After the LCS is installed, if this port is already being used or conflicts with firewall settings, you can change the value by reinstalling the LCS or by updating the following file: <installation dir>/apache-tomcat-5.5.29/conf/server.xml • Before you change the port number you must stop the LCS. After you have change the number, you must restart the LCS

  17. LCS Manager - General Use the LCS Manager software to manage your LCS. The LCS Manager software helps you keep your test forms current and transmit responses for scoring To start the LCS manager, select Start–All Programs–WA Online Assessments LCS–WA Online Assessments LCS Manager

  18. LCS Manager – Test Versions • After installation, the LCS can be loaded with test content using the LCS Manager – Test Versions • Updates are automatic • Can be used to manually update content • To update the LCS manually, check the Update box for each test that needs to be updated and click the Update button at the bottom or top of the window

  19. LCS Manager – Transmitting Student Responses To check whether student test responses have been transmitted to DRC and for detailed information about those responses, click on the Student Responses tab Student Responses sent to LCS if Internet connection dropped Responses will automatically be transmitted by LCS every 15 minutes Responses can be manually transmitted Student Responses must be transmitted before a student can log back into a test after exiting Be sure to check that all responses have been transmitted and the LCS is clear at the end of each day and at the end of testing

  20. LCS Manager - Student Responses – Unsent Responses When you click Show Details to see information about student responses, the Unsent Responses tab displays information about student responses stored in the LCS that are waiting to be transmitted to DRC

  21. LCS Manager - Student Responses – Historical Data Click the Historical Responses tab to display information about student responses that were previously stored on the LCS

  22. LCS Manager – Diagnostics – Bandwidth Calculator • Click on the Diagnostics tab to display the Bandwidth Calculator tab. The LCS Bandwidth Calculator helps you estimate the potential response time of a system based on three factors: • Transmission speed • Volume of data • Number of students

  23. LCS Manager – Diagnostics – Bandwidth Calculator • The LCS displays the results of its calculations in the Loading Test Result and Test Submission Result fields using colors to indicate the range of the results • Green (Good): Green indicates an estimated test loading time of less than 11 seconds, and an estimated test submission time of less than 6 seconds—good system response time • Yellow (Fair): Yellow indicates an estimated test loading time of 11-20 seconds, and an estimated test submission time of 6-10 seconds—fair system response time • Red (Poor): Red indicates an estimated test loading time of more than 20 seconds, and an estimated test submission time of more than 10 seconds—poor system response time • Note: If your estimates indicate that response time will be poor, you have the following options: • Reduce the number of students testing concurrently (stagger the number of students that sign on at the same time) • Increase the speed of data transmission by testing during a less active time of day • Change or upgrade your communication line

  24. LCS Manager – Diagnostics – Ping Trends Click on the Ping Trends tab to graph your ping activity over a date range that you specify. You can use this information in conjunction with the Bandwidth Calculator to determine optimum times for testing As the number of ping attempts increases, peaks or spikes appear that can indicate high network traffic times. You can use this information with the Bandwidth Calculator to determine optimum testing times

  25. Test Engine Installation - Windows • Silent/unattended installs for Windows • Windows MSI installer is capable of running in silent mode • Custom attributes can be sent to MSI, such as ENABLE_AUTO_UPDATE=false • The software can be installed using tools such as Microsoft System Center, IBM Tivoli, and Symantec Altiris • Automatic updates available

  26. Test Engine Installation - Windows Software downloads require administrative rights Windows XP Demonstration

  27. Test Engine Installation – Windows – Command Line To install INSIGHT from a command line, execute the Setup command DRC_INSIGHT_setup.msi with the specific options you want. To display a list of the command line options for the installation program, use the /h (help) parameter with the Setup command Technology User Guide has a table showing the custom properties available for the installation program

  28. Test Engine Installation - Mac The OS X installation follows the standard Mac two-step process of mounting a volume and launching an application. If you are reinstalling – unmount the old application.

  29. Test Engine Installation – Mac – Command Line To install INSIGHT from a command line, execute the Setup command DRC_INSIGHT_Setup.dmg with the specific options you want to use. To display a list of the command line options for the installation program, use the /h (help) parameter with the Setup command Technology User Guide has a table showing the custom properties available for the installation program

  30. Test Engine Installation - Linux DRC provides an easy-to-use Wizard to install the LCS software. In a Linux environment, you need to enter a few commands before you can run the Wizard

  31. Test Engine Installation – Linux Command Line To install INSIGHT from a Linux command line, execute the Setup command DRC_INSIGHT_Setup.sh with the specific options you want to use. To display a list of the command line options for the installation program, use the /h (help) parameter with the Setup command Technology User Guide has a table showing the custom properties available for the installation program

  32. Client LCS Configuration Testing computer interface must be configured to use a LCS. It can be configured during the software installation, and can also be modified through the System Readiness Check application

  33. Software Updates • If Automatic Updates are enabled, the student interface software will check the version each time the application is started • If an update is necessary, it will download and install automatically • The updates do not require administrative rights

  34. Software Updates • If Automatic Updates are disabled, the student interface software will not check the version when the application is started • When a student tries to log into a test, they will be notified they are not on the latest version and will not be able to continue • The software will need to be updated manually by getting the latest version from eDIRECT and reinstalling • You can run the System Readiness Check application at any time to see if you have the latest version • To avoid delays at the start of testing, it is recommended that you update the software before testing begins by executing the installer

  35. Software Updates • The student interface is capable of automatically updating itself with the latest published version of the code • There is an Automatic Update property that is set initially on the software installation, and can also be modified through the System Readiness Check application

  36. System Readiness The System Readiness Check software is designed to help you troubleshoot issues that might occur The System Readiness Check is installed on all computers that have INSIGHT installed The application runs when you install INSIGHT Runs in the background each time INSIGHT starts Can be executed on-demand from the Programs menu (from the same directory where INSTIGHT is installed) You can use it to diagnose and correct most errors easily.

  37. System Readiness Continued Detailed resolutions to System Readiness issues are described in the Working with INSIGHT section of the Technology User Guide

  38. MSP Technology Readiness Checklist Action Required by Wednesday, April 10 Helps prepare for a successful online testing experience

  39. Online Tools Training and Tutorial Installation • Online Tools Training • Included as part of the operational test installation package • In eDIRECT go to Test Setup/General Information/Downloads • Perform the test engine installation for the Windows, Mac or Linux version as described in earlier slides • A separate link for the OTT will appear on the login screen • Username and password appear on the login screen • Tutorial Installation • In eDIRECT go to Test Setup/General Information/Tutorials • Public Link • Posted on the OSPI website • Can be utilized by parents, within local libraries, within the school library, etc. • Not recommended for schools as the OTT public link only contains the OTT and not the operational test

  40. Commonly Asked Questions • The Technology User Guide has two sections to help troubleshoot potential issues with the online testing solution • Appendix A – Troubleshooting • This Appendix describes some of the more common error messages you may encounter while installing, configuring, and using DRC INSIGHT, and provides recommendations to resolve them • Many of the messages are shown with their corresponding screen images. For some messages, there are references to a more detailed description of how to resolve the error • Appendix B – FAQs • This Appendix contains a list of frequently asked questions and answers about configuring, installing, and using DRC INSIGHT and LCS software. The questions and answers cover the Windows, Macintosh (OS X), and Linux environments

  41. Contact Information For all support issues OSPI Assessment Hotline Mailbox online.assessment@k12.wa.us

  42. Upcoming Training • In-depth Technology Training • Specific information on installing the test engine, troubleshooting, setting up an LCS and using readiness checks • January 11 from 9:00-10:30 and January 15 from 11:30-1:00 • LCS Load Simulation Tool Training • Information on the NEW Load Simulation Tool that will be required for districts and schools prior to spring testing • March 6 from 1:00-2:30 and March 8 from 9:30-11:00 • Assessment Coordinator Training • Specific training on eDIRECT (student data, test tickets, monitoring testing, etc.) • March 12 from 11:30-1:00 and March 14 from 9:00-10:30 • Coordinator/Proctor Training • Information for staff who will be with the students during testing. • April 11 from 2:30-4:00 and April 15 from 11:00-12:30

  43. Questions This presentation along with a FAQ document will be available on the Washington Testing website, under the Online Testing Webinars http://www.k12.wa.us/TestAdministration/Trainings/default.aspx

More Related