180 likes | 344 Views
Assuring Quality Resources – The Peer Review Process. BioSciEd Net New Partners Meeting Melinda E. Lowy Higher Education Programs Coordinator Education Office The American Physiological Society. Peer Review of BEN Learning Objects.
E N D
Assuring Quality Resources – The Peer Review Process BioSciEd Net New Partners Meeting Melinda E. Lowy Higher Education Programs Coordinator Education Office The American Physiological Society
Peer Review of BEN Learning Objects • BEN Founding Partner Societies committed to providing only quality teaching resources • Each BEN Partner is responsible for developing and initiating peer review of its Learning Objects • Learning Objects are not uploaded for searching on BEN until accepted by Partner
What Constitutes Peer Review? • Each Partner defines “peer review” in its own terms • Develops review criteria • Can vary depending on type of resource • Develops review process • Sets review schedule • Selects reviewers • Trains reviewers in use of criteria • Posts review process on their site
Developing Peer Review Procedures/Process Example using APS Archive of Teaching Resources
APS Review Criteria Types of learning objects • Graphics, PowerPoints, lesson plans, case studies, lectures, tests, simulations, etc. • Web sites (personal, institutional) • Peer-reviewed education journal articles • Pedagogy material (reports, “how-to’s”, tools, ect.) • APS-developed materials
Review Criteria • Graphics, PowerPoints, lesson plans, case studies, lectures, tests, simulations, etc. • Scientific accuracy only • Appropriate use of animals/humans • Quality or appropriateness handled through bulletin boards attached to each object (colleague-to-colleague sharing)
Review Criteria (cont’d) • Web sites (personal, institutional) • Overview of reviewer-selected pages at several levels within the web site • Scientific accuracy only • Appropriate use of animals and humans • Quality or appropriateness handled through bulletin boards attached to each object (colleague-to-colleague sharing)
Review Criteria (cont’d) • Peer-reviewed journal articles • Review done according to Journal criteria and includes both content and pedagogy • Only articles that have passed peer review and have been accepted are catalogued for the Archive • In addition, comments are handled through bulletin boards attached to each object (colleague-to-colleague sharing)
Review Criteria (cont’d) • Pedagogy material • Reviewed for content only • APS-developed materials • Reviewed for content and pedagogy
APS Review Process • Two review dates per year with specific calls for Learning Objects in related fields. • An object is received and assigned to a review panel from that field. • The review panel is put together from interested members. Their contact info is put into the online system. • APS staff email reviewers with instructions on how to access the object and the review form on the APS Intranet.
Review Process (cont’d) 5. During the 2-week review period, the review panel reviews all materials received in that field and submits their reviews via the Intranet. • APS staff combines the reviews and gets a decision on acceptance. 7. The anonymous reviews are sent to the author by APS staff. -if accepted, the object is released to the Archive -If accepted with revisions, the author is asked to revise the object according to the reviews -if not accepted, the author may revise the object according to the reviews or withdraw the object
Review Process (cont’d) 8. If revision is necessary, the revised object and comments are re-sent to the review panel for final acceptance.
Review Schedule Deadline dates for submissions: February 15 and September 15 Review panels convened: March 1 and October 1 (2 weeks to complete reviews) Reviews sent to authors: March 22 and October 22.
Reviewer Training • Review panel • Web conference calls planned • Demonstrate review process step-by-step • Discussion of review criteria guides • Individual reviewers • PowerPoint demonstrating the review process step-by-step, including screen shots • Review criteria guides
For Future Consideration • Reviewer ethics • Reviewer confidentiality
Developing Your Peer Review Procedures/Process • Handout listing review procedures and criteria for various types of learning objects for various Partners • Discuss it with your Education Com. • Discuss it with your Council/Board • Staffing considerations • Initial setup: considerable time and effort • Afterwards: ~8 hours/month