1 / 37

The National External Diploma Program

The National External Diploma Program. Writing Assessment in the New NEDP Linda Taylor, CASAS Director of Assessment Development National External Diploma Program Council Conference October 2012, Providence, RI. The Future of NEDP Writing.

laird
Download Presentation

The National External Diploma Program

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The National External Diploma Program Writing Assessment in the New NEDP Linda Taylor, CASAS Director of Assessment Development National External Diploma Program Council Conference October 2012, Providence, RI

  2. The Future of NEDP Writing • CASAS’ review of NEDP Competencies and Tasks revealed a need for increased rigor. • In terms of Writing, there is a need for: • More writing • More challenging writing • In current NEDP development work, CASAS is incorporating more writing. • The CASAS Written Prompt has been piloted for use in Diagnostics.

  3. Writing Assessment in the New NEDP Four general types of writing in NEDP Tasks: • Extended Response • Includes the Written Prompt in Diagnostics • Each Competency Area will have at least one Extended Response item • Short Constructed Response • Specific Applications – e.g., letters, resume, power point presentation • Fill Matrix

  4. CASAS Written Prompt January 2013 - June 2014 CASAS will phase in the CASAS Written Prompt to replace the current NEDP writing process for Diagnostics • January 2013 - June 2013 • Agencies may voluntarily transition to the CASAS Written Prompt • July 2013 – June 2014 • Agencies to be trained will be assigned timeframes for training • CASAS has developed a self-paced electronic training that will be available 24/7 • Additional implementation support will be scheduled periodically

  5. NEDP Written Prompt Background • The CASAS Functional Writing Assessment (FWA) Picture Task does not assess the highest levels of ability • The CASAS National Consortium Writing Committee identified a need to develop a Written Prompt Task to assess higher level writing ability • The Singapore Workforce Development Agency (WDA) funded and worked with CASAS to develop this new writing assessment from 2006 – 2008 • Tryouts were also conducted in CT in 2007 and from 2010 – 2012 to ensure appropriateness in the US

  6. Background • The Written Prompt Task is a new writing assessment in the CASAS Functional Writing Assessment series. • The task is to write an extended response generated by a written essay topic. • Takes 45 minutes to one hour • Holistically scored on a scale of 1 – 5 • Diagnostic feedback is provided • Designed to be computer-delivered

  7. Development • Target population • Advanced adult ESL and ABE learners and workforce participants • GED preparation, high school programs, NEDP • Transition to post-secondary • Content of written prompts must be appropriate for both employed and unemployed test takers • Developed 10 prompts; selected 5 for US field testing

  8. Written Prompt Testing Process • Test Directions embedded in the NEDP software • New spell check feature tutorial is included • Client enters writing into NEDP software • Two trained and certified NEDP assessors score independently. • Can be two assessors or one assessor and one advisor • If they don’t agree, they discuss and come to consensus • Client must score 3 (out of 5) to enter General Assessment

  9. Written Prompt Rubric Development • CASAS researched academic essay rubrics • Wanted continuity with CASAS Functional Writing Assessment Picture Task rubric • Created/revised numerous versions • Issues: Voice/style, key elements, formatting of rubric for holistic scoring • Scored both Singaporean and US responses • Trained Singapore staff and part-time scorers • good success rate

  10. Providing Diagnostic Feedback • Holistic scoring with targeted feedback on relevant aspects of the writing sample • Drop-down menu items AND • Open-ended comments • Show example

  11. Results from Phase 1 Pilot (2009 – May 2010) • Collected information about the writing ability levels of the NEDP population • Adjusted the Written Prompt rubric to distinguish more clearly between rubric score points • Revised the wording in the directions to the examinee (“Write about the essay topic” instead of “Write three paragraphs…”)

  12. Results from Phase 1 Pilot • Collected writing samples for scorer training materials • Realized that computer delivery lends itself to including a “Spell-check” feature which would make the writing assessment more realistic • Converted to CASAS eTests software delivery platform to conduct more tryouts (2010)

  13. Written Prompt -- Current Status • Created and tried out self-paced scorer training materials (2011 – 2012) • Currently converting into Moodle platform • Now embedding the test directions and delivery into the NEDP online software • CASAS will work with State Departments of Ed to determine training schedule and who will score

  14. Written Prompt Research Studies • Inter-rater Reliability studies • Two local program scorers score the same responses • Parallel forms • At least 100 test takers take a set of two prompts on the same day or within one or two days

  15. Writing in Generalized Assessment • Extended writing is included in all NEDP Competency Areas (except Health) • These items require writing based on analyzing or summarizing information from higher level reading • Scoring Guidelines are provided for each item that requires writing. • Items requiring writing are judged on content and ability to clearly communicate in writing. Errors in mechanics are only considered if they interfere with clarity of communication.

  16. NEDP Writing Foundation Competency 3 Write to: • present, explain and examine information and ideas • state a position, with clear and coherent supporting arguments • describe experiences and events, real or created, and • express thoughts, feelings and emotions, • using writing techniques, organizational structures, word choices, English language conventions, and styles of expression that are effective and appropriate to the purpose.

  17. Writing Assessment in the New NEDP Four general types of writing in NEDP Tasks: • Extended Response • Includes the Written Prompt in Diagnostics • Each Competency Area will have at least one Extended Response item • Short Constructed Response • Specific Applications – e.g., letters, resume, power point presentation • Fill Matrix

  18. Extended Written Response

  19. Short Paragraph

  20. Extended Narrative: The Legal System 4. Required: Client must write four or five paragraphs that cover components a, b and c, below. Assess this response for content only; mistakes in mechanics are to be considered only if they interfere with clarity

  21. Extended Narrative: The Legal System • Guideline:Check each box that is demonstrated. If PTA is required, the response must be rewritten; however, boxes that have already been checked will not require re-demonstration. a. Identifies and summarizes the main idea behind the argument for the reading of the Miranda Rights to an individual under arrest

  22. Extended Narrative: The Legal System b.Identifies and summarizes the main idea behind the justification for not reading the Miranda Rights to a suspected terrorist c.Cites two resources researched at end of the response from which main ideas were drawn for arguments for and against reading the Miranda Rights, using citation guidelines in R4  D  ND You provided an: incorrect  incomplete Written response describing circumstances under which the Miranda Rights should or should not apply to an individual, citing two sources of information.

  23. Short Paragraph: Science Issues in the News

  24. Sample Responses

  25. One or Two Sentences

  26. Specific Applications: Resume

  27. Specific Applications: Formal Letter

  28. Formal Letter: Consumer Complaints • 4a.Required: A complaint letter to Copper City Electronics with each of the four types of information below: • 1) stating the problem • 2) asking for specific action • 3) including copies of all related documents, if applicable • 4) providing contact information

  29. Formal Letter: Consumer Complaints 4b.Required: All six elements of a formal letter, following guidelines for written statements and placement of each convention • 1) Date • 2) Salutation • 3) Sender Address • 4) Receiver Address • 5) Closing • 6) Signature Guideline: Check each box that is demonstrated. If PTA is required, the letter must be rewritten; however, boxes that have already been checked will not require re-demonstration  

  30. Formal Letter: Consumer Complaints Click Sample Letter Response and Letter Formatsto guide evaluation. Any of the six displayed formats is acceptable. D  ND You provided a incorrect  incomplete formal complaint letter containing four types of information and six formal elements.

  31. Topics for Discussion • Will writing mechanics (e.g., spelling, punctuation) be assessed whenever writing is required in a task? • No, in short written responses, the focus will be on content. • Other Topics?

  32. NEDP Contact Information • Jim HarrisonDirector, National External Diploma Programjharrison@casas.org800-255-1036, ext. 191 • Melissa Dayton Linda TaylorNEDP Coordinator CASASmdayton@casas.orgDirector of Assessment Development800-255-1036, ext. 181 ltaylor@casas.org 800-255-1036, ext. 186 • Christine O’HaraNEDP Operationscohara@casas.org800-255-1036, ext. 135 37

More Related