170 likes | 389 Views
ePEN Reports GCE Geography Team Leader Training - Module 3. Learning Objectives. In this module you will:. Learn about the different reports available Understand how to interpret the reports Look at what actions to take using data from reports. Reports.
E N D
Learning Objectives In this module you will: • Learn about the different reports available • Understand how to interpret the reports • Look at what actions to take using data from reports
Reports • There are 11 reports available on ePEN • Go to ‘View Progress’ and ‘reports’ tab • You can run reports for all markers, just your team or for only one marker • Not all reports available need to be used by TLs • Examples of those that TLs most commonly used are shown • You will also complete a few short tasks to help you with the interpretation of the data
QC Practice AA number The number of responses attempted in the sets The number of sets attempted and the number passed The date/time the set was started and completed If it has not been completed it will be blank The % of marks agreeing with the true score and the % of marks within adjacency Item name
QC Qualification AA no. The number of responses attempted in the sets Item name The date/time the set was started and completed If it has not been completed it will be blank Whether they have started or not and whether they were successful The % of marks agreeing with the true score and the % of marks within adjacency The number of sets attempted and the number passed
Cumulative Qualification Report Marks given to each response in the set – only shown where there are differences Item name True scores % below true score, within tolerance and out of tolerance % above true score, within tolerance and out of tolerance Set name % same as true score
Marker Differences Trait name Date marked True score Where the difference occurred The item the difference occurred on Score given by examiner Difference between true score and examiners score
Marker Statistics Summary Information on backreading Including: • Number backread • % out of tolerance • % same as true score Information on rate of marking, including total time spent marking that item and number of items marked per hour on average AA Number Trait or item name Information on marking against validity responses. Including: • Number seen • % out of tolerance (non-adj) • % within tolerance (adj) • % same as true score Total marked for that item Marker name • Revamped so you can run it just for your team, for one team or all items • Can be used as evidence if an examiner needs to be stopped
Task • You will be regularly running reports to help you monitor your team • You need to be able to interpret this data • In these tasks you will be provided extracts from a report • Note down your answers to the questions that accompany each section of the report
The full report • Who has marked the most responses? • F Thomas • Who has marked the least responses? • F Patel • Would you take any action? • You could look further at F Patel to see if there is any reason they have marked so few responses
Data about rate of marking • Who has marked the fastest? • F Thomas • Who has marked the slowest? • P Wilson • Would you take any action? • F Thomas is not marking significantly faster than the rest of the team so no action required • P Wilson is considerably slower than the rest of the team, they may require further guidance about the mark scheme for this item
Data about validity items • How many validity items has S Taylor seen? • 2 • Who scored best on validity marking? • E Collins and F Patel both scored 100% on perfect agreement • Would you take any action? • S Taylor marked 50% in perfect agreement and 50% higher than the true score but within tolerance • F Thomas scored 60% perfect agreement and 40% out of tolerance • Both markers should be investigated further. Validity scores should be 80-100% perfect agreement
Data about backreading • How many times has E Collins been backread? • 5 • Which markers and which traits give caused for concern? • S Taylor – 1b, 1c and 1d • F Thomas – 1c • Would you take any action? • F Thomas – complete a 2nd sample • S Taylor has already had a 2nd sample conducted on them (10 responses seen). You should consult your supervisor at this stage about whether they should be stopped from marking this item • Backreading scores should be 80-100% perfect agreement