E N D
LANGUAGE ASSESSMENT SCLE5163 AN ANALYSIS OF A PROGRESS ACHIEVEMENT READING COMPREHENSION TEST FOR SAUDI ARABIA 3 RD YEAR SECONDARY PREPARED BY: MOUSTAFA MOHAMMED AL SAYED SHALABY MONDAY 15/12/2014
INTRODUCTION Good teachers need to write and designbetter Tests. The test constructionis essentially a matter of problemsolving. Masteringand understand the principles of testing, how testing processes can be applied in a practical way. The desirable qualities of the test are validity, reliability, practicality and beneficialbackwash. Tests of poor quality have a harmfuleffecton teachingand learning. Failing to measure what is supposed to measure, testwhat is supposed to testand dowhat is supposed to do.
THE SCHOOL BACKGROUND THE OBJECTIVE OF THE COURSE A student should realize that learning English needs a lot of hard work and practice. He /she will need an English Language after leaving school so he/she need to know the language. This course is well designed & prepared to help and contribute students comprehensive understanding of the English language which will of course be needed at university level or at his / her practical working life in the kingdom our outside the Kingdom. One of the major topics that will be handled is English literature. English novels, short stories, some of the most important English authors such as William Shakespeare and Charles Dickens.
TEST TAKERS NUMBER 113 students divided into five classes. Two literal classes three science classes. The majority of the regular students is Saudi about 95%, the rest of them about 5 % from different Arab countries. The regular students ages from 16 up to 20 years old . The percentage of irregular students vary, but most of them employers, soldiers or officers or parttimeemployees , they are mainly from Kuwait. The irregular test takers vary from 20 up to over 40 years old. THE TEACHERS NUMBER There are four English teachers in this school are conducting the same course.
TEST DESCRIPTION This is a reading comprehension text depends on English literaturebackground. Aims to measure their general understanding of a written literaturetext. DESIGN STAGE Designing a test is not an easy process to be done It is a complicatedprocess. It is high-stakestests Needs extensive trailing and revision The test affects the future decision to a large number of students. Designinggenerally is a linearprocess, but in some cases, some activities are its iterative, that is, will need to be repeated a number of times. H. Douglas Brown (2003).
PURPOSE OF TEST Testing is the process of measuring students' capability, ability to perform the objectives and goals of the syllabus and specific educational future aims or performance in a given domain. Testing, simply, is a method of measuring a person’s ability, knowledge, H. Douglas Brown (2003). Brown (2003). Objective of reading is comprehension, student ability to find meaning in what is read. You need to select and choose carefully the information that you are going to ask students to extract from this reading text. DESCRIPTION OF TARGET LANGUAGE The students ability to use language in a reading test, to read the given reading comprehension text, as a whole, then answer the given questions. There are individual differences.Bachman and Palmer (1994) The target language use domain for this test is language instructional students are required to conduct reading the comprehension passage and answer the questions that are given Bachman
CHARACTERISTICS OF TEST TAKERS Governmental school "So the test should have a careful planning to make sure that the test will be useful for its intended purpose. The tester must ensure that the performance on the test tasks will correspond as closely to the language use, the test scores will be maximally useful for their intended purposes H. Douglas Brown (2003)." Brown
DEFINITION OF CONSTRUCT TO BE MEASURED Comprehension ability to understand, grasping with the intellect. Especially reading tests skills and language abilities. Modellingthe task, Students are given a similar English literature texts Make the test clear to be understood to give your students the opportunity to recognizethe purposeof the test.
PLAN FOR EVALUATING TEST USEFULNESS RELIABILITY " The difference of candidates from one occasion to another. The more similar the score on a test on one occasion is that on anotheroccasion the more reliable the test should be". Affendi, Oct. 13th (2014) Affendi 2014 • CONSTRUCT VALIDITY What do we mean by a valid test? This test measures what it is supposed to measure, test what it is intended to test. We have many approaches to know if a test measures what it is supposed to measure. Affendi, Oct. 13th (2014) * content validity. * criterion –related validity * construct validity. * Face validity.
AUTHENTICITY “The degree of correspondence of the characteristics of a given language test task to the features of a target language task” (Bachman and Palmer, 196:23). “A good language test, is supposed to employ formats andtasksthat reflect real-world situationsandcontextswhere test takers would authentically use the target language”. Coombe et al (2007:7) INTERACTIVENESS Questions must trigger with background of students. That will reflect their studying and using what they have learned to add to it the skill that we are going to test. "The extent and type of involvement of the test taker's individual characteristics (i.e. Topical knowledge, affective schemata and language ability) in accomplishing a test task “ (Bachman and Palmer, 1996:25). IMPACT This test is high - stake test students should know the area that they are weak and can make their improvement • Teacher make a revision of the methodology used and repeat the explanation of the skills to make the suitable remedies that he sees in a situation like this .
PRACTICALITY Studentswho will pass the test will be able to pursue their university studies. Students who fail will have to reset again to be examined. IDENTIFYING, ALLOCATING AND MANAGING RESOURCES HUMANRESOURCES Each school has its own staff those, who teach third year secondary . Teachers should prepare this kind of tests to their classes referring to the general specification done by ministry of education.
TEST DEVELOPMENT AND TIME LINE This test is held twicea year at the end of each semester.after finishingthe timetable of the course based on what the ministry of education and usually sets the timetable for testing schedule. OPERATIONALISATION STAGE COURSE SYNOPSIS This is a reading comprehension test .The Test is comprised of 25 points divided between different types of questions. A-Answer the following questions. B- Put (t) for true and (f) for false. C-From the passage, give the opposites. D-From the passage, give the synonyms of these words. D-The underlined word (….) inline x referring to…... (Complete). E- Choose the correct answer. These different kinds of questions, measure a student's ability to comprehend and interpret. How to apply those interpretations to answer the questions. The time allowed 1 hour to complete the exam questions.
OBJECTIVES • Students should be able to answer all types of questions based on the comprehensiontext given. • Students should be able to answer the questions based on information from the reading passage. Learning outcome • Comprehension questions, measure students ability to extract basic information. This question type can refer to specific parts of the text or to the text as a whole. Students need to: • * Restate information. • * Explain the clear implications of the text. TEST TASK SPECIFICATIONS DEVELOPING A BLUEPRINT/DRAFT
William Shakespeare was born in England in 1564. His father was a glove maker. Shakespeare attended to Stratford grammar school where he was taught by Master Roche. At the age of fourteen, he had to leave school to help his father in his business. When he was 18, he married Ann Hathaway, the daughter of a rich farmer. The following year his daughter ,Susanna, was born. In 1592, Shakespeare decided to leave his family in Stratford to seek his fortune in London. Each year he returned to spend time with his family in his home town. Shakespeare wrote 35 plays such as Romeo and Juliet, Othello, Hamlet and Macbeth. Also, he wrote 154 poems. The most quote " to be or not to be". In 1612, he returned to his birthplace, where he lived the rest of his life. William Shakespeare's early plays were written in the conventional style of the day, with elaborate metaphors and rhetorical phrases that didn't always align naturally with the story's plot or characters. However, Shakespeare was very innovative, adapting the traditional style to his own purposes and creating a freer flow of words. With only small degrees of variation, Shakespeare primarily used a metrical pattern consisting of lines of unrhymed iambic pentameter, or blank verse, to compose his plays. At the same time, there are passages in all the plays that deviate from this and use forms of poetry or simple prose. The Merchant of Venice is a play by William Shakespeare, believed to have been written between 1596 and 1598. Macbeth is a tragedy written by William Shakespeare, and is considered one of his darkest and most powerful works. Set in Scotland, the play dramatizes the corrosive psychological and political effects produced when evil is chosen as a way to fulfil the ambition for power. Tradition has it that William Shakespeare died on his birthday, April 23, 1616, though many scholars believe this is a myth. Church records show he was interred at Trinity Church on April 5, 1616. In his will, he left the bulk of his possessions to his eldest daughter, Susanna. Though entitled to a third of his estate, little seems to have gone to his wife, Anne, whom he bequeathed his "second-best bed." This has drawn speculation that she had fallen out of favor, or that the couple was not close. However, there is very little evidence the two had a difficult marriage. Other scholars note that the term "second-best bed" often refers to the bed belonging to the household's master and mistress—the marital bed—and the "first-best bed" was reserved for guests.
A- ANSWER THE FOLLOWING QUESTIONS: 1- Who was William Shakespeare? …………………………………………………………………………………………… 2-Where did Shakespeare live? …………………………………………………………………..………………………… 3-Did Shakespeare writes poems? ………………………………………..…………………….……………………………… 4-When was Shakespeare born? ………………………………….…………………………………………………………. 5-Why did Shakespeare leave his family in Stratford? …………………………………..………………………………….……………………… 6-When did Shakespeare write” The Merchant of Venice” ? …………….…….…………………………………………………………………………. B- Put (T) for true and (F) for false:
C- From the passage, give the opposites of these words: a) Arrive …………………….. b) Poor …………………….. D-From the passage, give the synonyms of these words:- (1) Aid …………………….. (b) wealthy …………………….. E- The underlined word (he) in the passage refers to…………………….. (Complete) F- CHOOSE THE CORRECT ANSWER :
BENCHMARK For each correct answer (225 = 50) marks. A- ANSWER THE FOLLOWING QUESTIONS: ( 26 = 12 marks ) 1- William Shakespeare was a famous English poet, writer and author. 2- William Shakespeare lived in London. 3- Yes, he did . 4- He was born in England . 5- He left to help his father. 6- It was written between 1596 and 1598
B- Put (T) for true and (F) for false: ( 2×4= 8 marks ) C-From the passage, give the synonyms of these words:- ( 2×2= 4 marks ) D-From the passage, give the synonyms of these words:- ( 2×2= 4 marks ) E- The underlined word ( 2×1= 2 marks ) F- Choose the correct answer :( 2×10= 20 marks ) Total mark 50
SCORING METHOD Scoring method at the end of the test, the test papers are collected after the students finish the test at the limited time . The whole papers delivered at the control room to be organized, orderly and to take off the names of students put a given a serial code number, all the staff of the school gathers and then we got the whole papers to be corrected, we also got the benchmark we divide the number of questions on the staff members then starting scoring the marks after finishing scoring those who correct certain questions revise to others and vice versa.
COLLECTING FEEDBACK FOR ASSESSING TEST USEFULNESS Asking student after the test, some questions to get their impressions about the test what is difficult, what is easy, later, while and after scoring we get the feedback concerning everything about the test Collecting feedback for assessing test usefulness.
CONCLUSION • "Life is a test" What is the best way to assess learners' ability? What are the most practical instruments available? Are the current standardized tests of language proficiency accurate and reliable? How can a teacher design tests? The effect of testing on teaching and learning can be harmful or beneficial.'' The good test is an obedient servant since it follows and apes the teaching " Davies (1968:8).
REFERENCES William Shakespeare. (2014). The Biography.com website. Retrieved 06:50, Nov 25, 2014, fromhttp://www.biography.com/people/william-shakespeare-9480323. William Shakespeare. [Internet]. 2014. The Biography.com website. Available from:http://www.biography.com/people/william-shakespeare-9480323 [Accessed 25 Nov 2014]. "William Shakespeare." Bio. A&E Television Networks, 2014. Web. 25 Nov. 2014. "Reading." Merriam-Webster.com. Merriam-Webster, n.d. Web. 25 Nov. 2014. http://www.merriam-webster.com/dictionary/reading. "Comprehension." Merriam-Webster.com. Merriam-Webster, n.d. Web. 25 Nov. 2014. http://www.merriam-webster.com/dictionary/comprehension. "Reliability." Merriam-Webster.com. Merriam-Webster, n.d. Web. 26 Nov. 2014. http://www.merriam-webster.com/dictionary/reliability "Authentic." Merriam-Webster.com. Merriam-Webster, n.d. Web. 26 Nov. 2014. http://www.merriam-webster.com/dictionary/authentic. Kataoka, M. (2005). Language Assessment: Principles and Classroom Practices. Brief Reports And Summaries, 344. McMillan, J. H. (1997). Classroom Assessment. Principles and Practices for Effective Instruction. Allyn & Bacon, A Viacom Company, 160 Gould St., Needham Heights, MA 02194; Internet: www. abacon. com. Bachman, L., & Palmer, A. (2010). Language assessment in practice. Bachman, L. F., & Palmer, A. S. (1989). The construct validation of self-ratings of communicative language ability. Language Testing, 6(1), 14-29. Bachman, L. F., & Savignon, S. J. (1986). The evaluation of communicative language proficiency: A critique of the ACTFL oral interview. The Modern Language Journal, 70(4), 380-390. Arthur HughesTesting for language teachers, second edition, Cmbride University Press, 1989,2003, second edition