450 likes | 639 Views
LECTURE 5. I. ANALYZING THE LEARNING TASK. 5 MAIN STEPS :. 1. WRITE THE LEARNING GOAL. 2. DETERMINE THE TYPES OF LEARNING OF THE GOAL. 3. INFORMATION-PROCESS ANALYSIS. 4. PREREQUISITE ANALYSIS AND ITS TYPE OF LEARNING. 5. WRITE LEARNING OBJECTIVES. WRITE LEARNING GOALS
E N D
LECTURE 5 I. ANALYZING THE LEARNING TASK 5 MAIN STEPS: 1. WRITE THE LEARNING GOAL 2. DETERMINE THE TYPES OF LEARNING OF THE GOAL 3. INFORMATION-PROCESS ANALYSIS 4. PREREQUISITE ANALYSIS AND ITS TYPE OF LEARNING 5. WRITE LEARNING OBJECTIVES English Study Program-FKIP-UNSRI 2014
WRITE LEARNING GOALS THE LEARNING GOALS ARE STATEMENTS OF PURPOSE OR INTENTIONS (WHAT LEARNINERS SHOULD BE ABLE TO DO AFTER INSTRUCTION): THE FOCUS IS ON CLEAR DESCRIPTIONS OF WHAT CAPABILITIES LEARNERS WILL POSSESS AFTER INSTRUCTION. English Study Program-FKIP-UNSRI 2014
DETERMINING TYPES OF LEARNING • USEFUL TO IDENTIFY THE TYPE OF LEARNING OUTCOME • COGNITIVE EFFORT • LEARNING CONDITIONS • WAYS TO TEST FOR ACHIEVEMENT English Study Program-FKIP-UNSRI 2014
DETERMINING TYPES OF LEARNING • BLOOM’S: • RECALL (KNOWLEDGE) • COMPREHENSION • APPLICATION • ANALYSIS • SYNTHESIS • EVALUATION English Study Program-FKIP-UNSRI 2014
DETERMINING TYPES OF LEARNING • GAGNE’S: • DECLARATIVE KNOWLEDGE • INTELLECTUAL SKILLS • COGNITIVE STRATEGIES • ATTITUDES • PSYCHOMOTOR SKILLS English Study Program-FKIP-UNSRI 2014
Information-ProcessingAnalysis 01. Read and gather information as much as possible 02. Change the goal into a representative test “question” 03. Give the problem to expert (observe and discuss with them) 04. Review the written steps (no. 03) 05. Identify similar steps conducted by those experts 06. Identify the shortest, least complex way 07. Note factors that may require a more complex way/steps 08. Select the circumstances that best match the goal(s) 09. List the steps appropriate to the goals 10. Confirm the analysis with other experts English Study Program-FKIP-UNSRI 2014
II. ASSESSING LEARNING FROM INSTRUCTION English Study Program-FKIP-UNSRI 2014
PURPOSES OF EVALUATION • TO ASSESS PERFORMANCES OF • INDIVIDUAL STUDENTS (CAN THEY DEMONSTRATE THEM) • 2. TO PROVIDE INFORMATION FOR THE NEEDED REVISION IN THE INSTRUCTIONAL MATERIALS (IS THE INSTRUCTION EFFECTIVE, EFFICIENT, APPEALING?) English Study Program-FKIP-UNSRI 2014
Activity of SequencingAssessment Design 1. Purposes of the assessment instrument and the model type to follow 2. Kinds of assessment necessary 3. Forms of items (performance test, essay, MC, portfolio, etc) 4. Write test items and directions 5. The number of items needed 6. Proportion of objectives appear in the assessment instrument English Study Program-FKIP-UNSRI 2014
Purposes and Model of Assessment 1. To determine competence level - to assess competence or identify gaps in learning (Criterion-referenced, objective-reference, or domain-referenced) - Effective for determining who is competent and where individual weaknesses are; not effective for comparing or ranking learners 2. To compare or rank learners’ abilities - to obtain a spread or variation of scores (Norm-referenced ) English Study Program-FKIP-UNSRI 2014
TYPE OF ASSESSMENTS • Entry Skills Test CAN BE GIVEN PRIOR TO THE INSTRUCTIONAL LESSON IN COMBINATION WITH THE PRETEST OR AS A WAY OF REVIEWING THE PREREQUISITE SKILLS English Study Program-FKIP-UNSRI 2014
PREASSESSMENTS/PRETESTS To find out how much learners already know some of the objectives Given before a lesson or as a way to gain students’ attention and to inform them of the objectives of the lesson Focus on portion of the instruction not yet learned previously English Study Program-FKIP-UNSRI 2014
POSTASSESSMENTS/POSTEST To find out if learners have achieved the terminal objective Given at the end of a lesson Test items must be different from those of pretest or practice test Test items cover the most critical objectives English Study Program-FKIP-UNSRI 2014
CHARACTERISTICS OF INSTRUMENTS • Criterion-referenced : validity, reliability, practicality Five C’s: Congruence(sesuai), Completeness (sempurna), Consistency (konsisten), Confidence (keyakinan), Cost (biaya) English Study Program-FKIP-UNSRI 2014
VALIDITYTo measure/assess what is supposed to be measured/assessed • Test item must be consistent with the objective (congruence) • Items for each objective are representative of the range of items (completeness) • Objectives are adequately sampled (completeness) English Study Program-FKIP-UNSRI 2014
RELIABILITY • Consistently measures what it is supposed to measure, and • We are very confidentwith the result/score of the instrument English Study Program-FKIP-UNSRI 2014
PRACTICALITY • Consider the time in processing the assessment, human resource conducting the test, time between administration of the test and when scores must be reported English Study Program-FKIP-UNSRI 2014
ASSESSMENT FORMAT • PERFORMANCE ASSESSMENT Observation of on-the-job performance, Simulation, Essays, Portfolios • PAPER-AND-PENCIL TESTS Recall items, Recognition items, constructed answer items English Study Program-FKIP-UNSRI 2014
ASSESSMENT FORMATS • PERFORMANCE ASSESSMENTS (AUTHENTIC ASSESSMENT-Norman & Linn, 1995): higher order knowledge and skills in the real-world context in which they are actually used, generally with open-ended tasks that require substantial examinee time to complete e.g.: observation, open-ended problems, micro worlds, essays, simulations, projects, portfolios English Study Program-FKIP-UNSRI 2014
PERFORMANCE ASSESSMENTS • Observation (dalam situasi pekerjaan) Instrumen: checklist, rating scales (menilai kualitas proses saat siswa melakukan keterampilan tertentu; atau menilai produk atau hasil dari performa ini. Checklist/Rating scales: daftar prilaku atau karakteristik yang dapat diamati; Prilaku/karakterisktik dinilai dengan pernyataan antara lain: ada/tidak ada, ya/tidak; tepat/tidak tepat; benar/salah, dlsb English Study Program-FKIP-UNSRI 2014
PERFORMANCE ASSESSMENTS • Simulation Jika tidak praktis atau tidak diinginkan, situasi dapat disimulasikan. Disampaikan melalui bahan ajar cetak,video, interaksi kelompok, komputer, multimedia interaksi. English Study Program-FKIP-UNSRI 2014
PERFORMANCE ASSESSMENTS • Essays Jawaban esai yang benar: rangkaian jawaban, bahasa, kekhususan, tata bahasa (sulit menilai secara objektif). Mengurangi kemungkinan subjektivitas penilaian, gunakan checklists, rating scales, model jawaban, atau penilai berlapis. English Study Program-FKIP-UNSRI 2014
PERFORMANCE ASSESSMENTS • Portfolio “Kumpulan hasil kerja siswa yang menunjukkan usaha, kemajuan, atau prestasi mereka dalam bidang tertentu Sangat berguna untuk menilai tujuan pemelajaran secara meluas Isi portoflio: pedoman pemilihan, kriteria manfaat penilaian, bukti dari refleksi diri siswa English Study Program-FKIP-UNSRI 2014
Evaluation of Performance Assessments CRITERIA Standards of Validity, Consequences of Assessments on instructional practice, Directness, Transparency, Fairness, transfer and generalizability, adequate cognitive complexity of the tasks, content quality, content coverage, meaningfulness, cost, and efficiemcy English Study Program-FKIP-UNSRI 2014
Paper-and-Pencil Assessment Forms Category: MC, T/F, Matching, Completion, Short Answer Used to assess declarative knowledge, intellectual skills, attitudes, cognitive strategies, and portions of motor skills English Study Program-FKIP-UNSRI 2014
Paper-and-PencilTests Forms: Recall Recognition Constructed answers English Study Program-FKIP-UNSRI 2014
PAPER-AND-PENCILTESTS Recall - Menilai tujuan pengetahuan deklaratif - Menilai komponen hasil pemelajaran laindari pengetahuan deklaratif Siswa mereproduksi pengetahuan yang mereka peroleh dalam pengajaran, kata per kata seperti yg tertulis/ diucapkan, menggunakan kata-kata lain, meringkas Sangat menuntut daya ingat, tidak memerlukan proses penalaran tinggi Bentuk item tes tertulis: Jawaban Singkat, Mengisi bagian kosong, Menyempurnakan English Study Program-FKIP-UNSRI 2014
PAPER-AND-PENCILTESTS Recognition Siswa harus mengenali atau identifikasi jawaban yang benar dari pilihan yang ada. Menilai pengetahuan deklaratif yang sudah dihafalkan. Dapat saja memerlukan keterampilan lebih tinggi (aplikasi prinsip atau konsep yg diperoleh utk mengenali jawaban yang benar) English Study Program-FKIP-UNSRI 2014
PAPER-AND-PENCILTESTS Constructed Answers Siswa menyusun jawaban: jawaban tertulisselamasimulasi, jawaban tertulis denganpensil/pena/komputer Memerlukan penalaran lebih tinggi dari keterampilan intelektual (petunjuk/pilihansedikit) English Study Program-FKIP-UNSRI 2014
ASSESSMENT ITEM SPECIFICATION • (Popham, 1978) • Objective • Descreation of test form • Sample Item • Question characteristics • Response characteristics • Number of item andmastery criterion English Study Program-FKIP-UNSRI 2014
SPESIFIKASI ITEM PENILAIAN 1. Tujuan Pernyataan tujuan akan Membantu dalam pengembangan spesifikasi item Tujuan terdiri dari kondisi, performa, kriteria English Study Program-FKIP-UNSRI 2014
SPESIFIKASI ITEM PENILAIAN 2. Deskripsi bentuk tes Pilihan Berganda Simulasi dgn menggunakan komputer Pilihan utk prosedur diagnosa Pilihan solusi suatu persoalan English Study Program-FKIP-UNSRI 2014
SPESIFIKASI ITEM PENILAIAN 3. Item sampel Harus menilai kemampuan untuk melakukan prilaku yang dinyatakan dalam tujuan sesuai dengan kondisi English Study Program-FKIP-UNSRI 2014
SPESIFIKASI ITEM PENILAIAN 4. Karakteristik pertanyaan (Spesifikasi domain isi dan rentang faktor kesulitan item) Merumuskan kualitas pertanyaan, penilaian tes, skenario dalam simulasi English Study Program-FKIP-UNSRI 2014
SPESIFIKASI ITEM PENILAIAN 5. Karakteristik Jawaban Desainer membuat garis besar karakteristik jawaban benar(mudah dilakukan), dan jawabansalah (lebih sulit dilakukan) a. Siswa melingkari huruf jawaban benar. Tiap item soal ada 4 opsi jawaban (1 B, 3 S) b. Gunakan 1 distractor (pengalih) pada opsi jawaban. English Study Program-FKIP-UNSRI 2014
SPESIFIKASI ITEM PENILAIAN 6. Jumlah item & kriteria penguasaan Penguasaan (mastery): performa lulus atau memadai Identifikasi setiap tujuan persentase item siswa harus menjawab benar untuk dapat kita katakan mereka menguasai tujuan itu. English Study Program-FKIP-UNSRI 2014
ASSESSMENT INSTRUMENTS BLUEPRINTS Menilai performa siswa (lebih dari satutujuan yang dinilai) Komponen: • Tujuan 5. Petunjuk pelaksanaan • Bentuk Item 6. Metode penilaian • Jumlah item 7. Pembobotan item • Proporsi item 8. Nilai kelulusan English Study Program-FKIP-UNSRI 2014
ASSESSMENT INSTRUMENTS BLUEPRINTS Jumlah Item Formatif/diagnostik: buat beberapa Periode penilaian (jika tidak bisa) kurangi jumlah item utk sub tujuan dan jumlah secukupnya utk tujuan akhir English Study Program-FKIP-UNSRI 2014
ASSESSMENT INSTRUMENTS BLUEPRINTS Proporsi Item Persentase item utk setiap tujuan erat kaitannya dgn jumlah item keseluruhan Lebih fokus pada keterampilan intelektual ketimbang pengetahuan deklaratif English Study Program-FKIP-UNSRI 2014
ASSESSMENT INSTRUMENTS BLUEPRINTS Petunjuk Pelaksanaan Petunjuk untuk siswa (termasuk batas waktu) Petunjuk untuk pelaksana tes (cara menjawab soal, menentukan area penilaian, bahan yg diperlukan selama penilaian, lama waktu, dan informasi terkait lainnya: realibilitas, validitas, dan kepraktisan) English Study Program-FKIP-UNSRI 2014
ASSESSMENT INSTRUMENTS BLUEPRINTS Scoring Methods - Simple (MC, T/F) - Complete and Detailed (observation,simulation, essays) English Study Program-FKIP-UNSRI 2014
ASSESSMENT INSTRUMENTS BLUEPRINTS Weighting of items Berikan item lebih banyak untuk tujuan penting Beri bobot lebih Siswa harus tahu pembobotan ini English Study Program-FKIP-UNSRI 2014
ASSESSMENT INSTRUMENTS BLUEPRINTS Passing or Cut-Off Score - 80/80 criterion (learners must achieve at least 80% of the items on at least 80% of the objectives) Quiz question: Describe any weakness(es) of using this criterion English Study Program-FKIP-UNSRI 2014
Tujuan Evaluasimenilai pencapaian tujuan siswa dan evaluasi efektifitas pengajaran Model PenilaianNRA (ranking siswa) dan CRA (Kompetensi siswa) Karakteristik Instrumen PenilaianValiditas, Reliabilitas, Kepraktisan Spesifikasi Item Penilaiantujuan, item sampel, bentuk pertanyaan, karakteristik pertanyaan dan jawaban, jumlah item dan kriteria penguasaan Pedoman Instrumen Penilaianjumlah item, proporsi item, petunjuk, metode penilaian, pembobotan item, nilai kelulusan English Study Program-FKIP-UNSRI 2014
END OF LECTURE QUESTIONS? English Study Program-FKIP-UNSRI 2014