Download
1 / 13
130 likes | 238 Views
General Education. Assessment Report. Outcomes B-2, B-3, B-8, C-1, C-4, C-5.
E N D
General Education Assessment Report
Outcomes B-2, B-3, B-8, C-1, C-4, C-5 • Methodology:The assessment for each of these outcomes used the Measure of Academic Proficiency and Progress (MAPP) test from ETS. Students in senior capstone courses from various areas were asked to take the test in the spring. 49 students were tested from Business, Science, Education, English, and Psychology
Problem • Observations of students taking the tests and the scores reported indicate that test data is highly suspect.
Outcome B-2 • Students will be able to articulate the parameters of the Wesleyan-Holiness tradition and see its connections with intellectual, emotional, spiritual, and physical life . • The self-developed portion of the MAPP test was used to assess this outcome, using questions developed by the Division of Religion. In addition, students gave a level of satisfaction with the statement “Trevecca Nazarene University provides an understanding of what it means to live a holy life and relates this explanation to many aspects of my life.” • 62% of the responses to the questions were correct, which did not meet the criterion of 70%. In addition, the average score on the additional question was 3.75, which did not meet the criterion of 5.5.
Outcome B-3 • Students will be able to articulate the doctrinal and moral convictions of the Church of the Nazarene. • The self-developed portion of the MAPP test was used to assess this outcome, using questions developed by the Division of Religion. In addition, students gave a level of satisfaction with the statement “Trevecca Nazarene University clearly describes those Christian doctrines and moral convictions that are important to the school’s Nazarene heritage.” • 65.5% of the responses to the questions were correct, which did not meet the criterion of 70%. In addition, the average score on the additional question was 3.47, which did not meet the criterion of 5.5.
Outcome B-8 • Students will demonstrate the ability to understand and perform basic mathematical and statistical tasks to analyze and solve problems • The context portion of the MAPP Test entitled Math was used to assess this outcome. • The mean student score was in the 24th percentile, which did not meet the criterion of the 75th percentile.
Outcome C-1 • Students will demonstrate an understanding and practice of various modes of intellectual thinking processes. • The context portion of the MAPP Test entitled Critical Thinking was used to assess this outcome. • The mean student score was in the 5th percentile, which did not meet the criterion of the 75th percentile.
Outcome C-1 • Students will demonstrate an understanding and practice of various modes of intellectual thinking processes. • Laboratory exercises from 30 life science students were randomly selected and evaluated according to a rubric developed by the Department of Science and Mathematics. • The mean student score was 8.31, which met the criterion 7 out of 14 possible points. In addition, the line items on the rubric had averages ranging from 0.7 to 1.66, which met the criterion of 0.7.
Outcome C-4 • Students will understand the relationship between personal well-being and the capacity to engage others. • Students gave a level of satisfaction with the statement “Trevecca Nazarene University enhances my sense of personal well being and my ability to engage others as well.” • The average level of satisfaction 3.47, which did not meet the criterion of 5.5.
Outcome C-5 • Students will demonstrate an appreciation of the stewardship of resources, as it applies to personal life and in society as a whole, from a Christian perspective. • The self-developed portion of the MAPP test was used to assess this outcome, using questions developed by various divisions within the University. In addition, students gave a level of satisfaction with the statement “My college education at TNU prepares me to be a faithful steward of my personal finance.” • 81.5% of the responses to the questions were correct, which met the criterion of 70%. In addition, the average score on the additional question was 3.67, which did not meet the criterion of 5.5.
Protocol for AdministeringAssessment InstrumentsGeneral Education Committee2008-9 • Efforts to use “student convenience” as the sole criterion for gathering data to assess General Education Outcomes has led at times to flawed or useless data. In an attempt to rectify this situation, the following protocol for administering assessment instruments, including paper and computerized standardized tests, will be tested during the Fall 2008 semester. • The MAPP will be used to assess content and skill outcomes where appropriate. MAPP will be administered in capstone courses for each major with the approval of the course professor.
A primary testing session will be scheduled in consultation with the capstone course professor and the TNU Testing Center. • A second make-up testing session will be scheduled for students who have course conflicts or miss the primary testing session. • The primary testing session should occur before the tenth week of the semester. • Students must stay for a one and one-half hour testing session. Additional time is available as allowed by the computer testing service. • The course professor should be present for the beginning of the testing session, in order to emphasize the importance of the test. • Testing sessions will be orally introduced by the professor or a member of the General Education Committee stressing the importance of test results in deciding future changes and improvements to TNU’s instructional programs. • A member of the General Education Committee will be present for the whole testing period to observe student behavior during the period and record the length of time students were engaged answering test items. Any unexpected behavior (i.e., failure to give best effort) should be noted).
