1.08k likes | 1.1k Views
Evaluating Open Educational Resource (OER) Objects. Using the Achieve OER Evaluation Tool on OER Commons. CC BY Achieve 2013. Open Educational Resources: [With Webster’s Definitions]. O. Open : Containing an open license - no restrictions on remixing or reusing
E N D
Evaluating Open Educational Resource (OER) Objects Using the Achieve OER Evaluation Tool on OER Commons CC BY Achieve 2013
Open Educational Resources: [With Webster’s Definitions] O Open: Containing an open license - no restrictions on remixing or reusing [Having no enclosing or confining barrier; not restricted to a particular group or category of participants] E Educational: Used for teaching and learning [Pertaining to the action or process of educating or being educated] Resource: Object used to support an effort or task [A source of support or aid, especially one that can be readily drawn upon when needed] R
Open Educational Resources (OER) • What are OER? • OER are teaching, learning, and research resources that contain an open license. • They provide extraordinary opportunities for educators to freely share knowledge and resources. • They offer great potential for instructional innovation and networks for sharing best practices. • There are, literally, millions of OER objects available online.
Open Educational Resources (OER) • OER objects may include (but are not limited to): • Images • Applets • Games • Worksheets • Lesson plans • Original-source texts • Assessments • Units • Textbooks • Teacher/learner support materials • NOTE: Any smaller component of a more complex object, that can exist as a stand-alone, alsoqualifies as an “object” (e.g. a unit in a textbook, a lesson in a unit, or an activity in a lesson).
The Achieve OER Evaluation Rubrics • How and why were the Achieve OER Rubrics created? • Educators using the vast system of sharing need a method for filtering OER to meet the needs of their students. • The purpose of the rubrics is to provide a structure for evaluating an online resource in a systematic, purposeful and comprehensive way. • The rubric criteria are based on Achieve protocols used to assist states in alignment and quality review studies. • The Achieve OER Evaluation Tool, hosting the rubrics on OERCommons.org, allows a user to identify, evaluate, and sort objects based on the specified essential elements of quality.
Applying the Achieve OER Rubrics • How do the Achieve OER Rubrics work? • The rubrics represent an evaluation system for objects found within Open Educational Resources. • They are hosted as an online evaluation tool on the repository, OERCommons.org, but can also be used independently. • They are applied to any content area. • NOTE: At this stage only Common Core Standards for English Language Arts/Literacy and Mathematics are available in the Achieve OER Evaluation Tool. Content standards for History, Social Studies, Sciences, and technical subjects are not yet available. • Each rubric is applied independently to an object. • They rate the potential, not the actual, effectiveness of an object. • They use a five-point scoring system to describe levels of quality.
The Rubrics’ Common Scoring Scale • The Detailed Scoring Descriptors are Specific to Each Rubric • 3:Superior • 2: Strong • 1: Limited • 0: Very weak / None • N/A:Rubric not applicable to the object • NOTE: N/A should be used when a particular rubric does not apply to the object being rated. This is not a pejorative score; it simply means it would be inappropriate to apply this rubric to the particular object.
The Rubrics • There are Seven Rubrics on the Achieve OER Evaluation Tool • Rubric I. Degree of Alignment to Standards • Rubric II. Quality of Explanation of the Subject Matter • Rubric III. Utility of Materials Designed to Support Teaching • Rubric IV. Quality of Assessment • Rubric V. Quality of Technological Interactivity • Rubric VI. Quality of Instructional Tasks and Practice Exercises • Rubric VII. Opportunities for Deeper Learning • NOTE: Sometimes one or more of the rubrics may not be relevant to a particular object. In those cases, a rating of N/A is appropriate.
Achieve OER Evaluation Toolon OERCommons.org OERCommons.org hosts the rubrics as the Achieve OER Evaluation Tool
Register and Log In Go to the OERCommons Website to Register and/or Log in: http://www.oercommons.org/
The OERCommons.org Home Page • From the Home screen use the browse options to search for OER: • Use the Search screen by typing a key word or object title
The OERCommons.org Home Page • Browse All allows you to see a listing of all OER categories available
The OERCommons.org Home Page • My OER allows you to go immediately to the group of OER you have saved
The OERCommons.org Home Page • Groups allows you to create a group or to view groups created by you or others
The OERCommons.org Home Page • Contribute • allows you to create an OER or submit a resource from a website to OERCommons
The OERCommons.org Home Page • You can also go directly from this screen to the Advanced Search
The OERCommons.org Home Page • Discover New Resources: OERCommons posts links to the most recent additions to the site.
The OERCommons.org Home Page • Help: Find answers to frequently asked questions and get information aboutConditions of Use, OERCommons in general, OER objects, Open Author, member tools, etc.
Browse the Site for Objects • Browse All takes you to this screen where you can further refine your search by selecting a particular subject area, grade level, or materials type. • On this screen you can also see the number of OER available in each category.
Access Your Saved OER Your Name • My OER allows you to see only those OER you have saved. • During your searches you may find an OER that you may want to find easily later. In those cases you can save the objects to My OER and return to your personal list at any time.
Search the Site Using Groups Search groups by: Grade level Subject Type Your group search can be filtered in much the same way as an object search. • Groups allows you to create a group, to view all groups, or to view the groups you have created. Groups allows schools, districts, etc. to more easily share OER.
Contribute a Resource Upload a resource from the web Create an OER using Open Author Contribute allows you to create an OER or submit a resource to OER Commons from the web
Refine Your Search for OER • Advanced Search allows for more refined searches based on: • Alignment with a specific CCSS • By using the drop-down menus here educators are able to quickly view all objects that have been aligned to a specific Common Core subject, a grade level, a learning domain, or even a specific standard.
Refine Your Search for OER • Advanced Search allows for more refined searches based on: • Evaluation with any of the Achieve OER Rubrics • Educators are able to find all objects evaluated using a specific Achieve OER Rubric. This will allow them to quickly find, for example, an object that has been rated for the quality of its assessments or its technological interactivity.
Refine Your Search for OER • Advanced Search also allows for more refined searches based on any or all of the following: • key words (using the search bar) • any of six subject areas • grade level • language • material type • content source • primary user • member activity • conditions of use
Refine Your Search for OER Once you have refined your search options you will be sent to a list of those OER objects meeting your search criteria. This example shows the first few of 8,709 primary and secondary Humanities objects.
Refine Your Search for OER You can then change the number of items shown per page and … Reorganize your list by title, relevance, rating, date, or the number of visits.
Refine Your Search for OER You can scroll through the object list manually or by using the page numbers.
Refine Your Search for OER By clicking on Expand All you can see every Collapse All (Complete Item Description)for the objects on your list. By clicking on Collapse All you can close all item descriptions to save space.
Refine Your Search for OER By un-clicking any criteria in the left column you can refine your search even further.
Refine Your Search for OER • Here you see the example list of the first three objects from our refined search. • For each object you can see: • The title • The subject • The grade level • The collection contributor
Refine Your Search for OER Clicking on the collection title for any object will allow you to see a list of all objects contributed by that author. This can be particularly helpful for educators who find a particular contributor that seems to fit their needs.
Refine Your Search for OER If you click on (Complete Item Description) for any individual object, you will be able to read the full text of the object’s abstract.
Ratings and Actions • There are two ways of approaching the evaluation of a resource in OERCommons: • Holistically evaluating the object with a single 5-star rating, (similar to the rating systems used on Netflix, Yelpand Amazon) • Separately evaluating each of the components of quality, as with the Achieve OER Rubrics
Ratings and Actions In the list view for the objects on OERCommons you will see a symbol to the right of the object’s title in the list. It may look like one of these: This symbol shows five “empty” stars and indicates that the object has not yet been evaluated with either system. This symbol shows that the object has been given four stars using the holistic 5-star rating system but has not been rated using the Achieve OER Evaluation Tool. This includes this symbol, , along with the 3-star rating, indicating that the object has been evaluated by at least one rater using both the 5-star rating system and the Achieve OER Evaluation Tool.
Search the Site for OER • On the far right for our example search list we see the present state of the objects in the evaluation cycle. • This object has been holistically rated with the 5-star system.
Search the Site for OER • This object has been evaluated and rated using both the 5-star rating system and the Achieve OER Evaluation Tool
Search the Site for OER • This object has not been rated at all
Conditions of Use No restrictions on remixing, redistributing or making derivative works. Remixing, redistributing or making derivatives works comes with some restrictions, including how it is shared Do not remix or make derivative works Everything else/All Rights Reserved. US-based educators have certain permissions under Fair Use and the TEACH Act. For more detailed information click on [Help] on the OER home page, found next to login, and then Conditions of Use. Conditions of use are also identified here. There are four possible conditions:
Conditions of Use Two of these are “Remix and Share”
Conditions of Use This one is “Read the Fine Print.”
Actions • Each item in the list offers three to be taken: • From this list screen you can • Save this item to My OER • Add a tag (keywords, etc.) to this item • Align this item to the Common Core State Standards for Mathematics or ELA/Literacy
Selecting an OER Object After finding an object of interest, click on the title to move to the launch page for that OER.
The OER Object’s Launch Page • From this object’s launch page you can do the following: • Read the abstract
The OER Object’s Launch Page • See previous users’ holistic ratings
The OER Object’s Launch Page • See average ratings from all previous evaluators using the Achieve OER Evaluation Tool.
The OER Object’s Launch Page • See a list of standards aligned by previous users
The OER Object’s Launch Page • View the resource on its home website. • Clicking here will take you to the site where the object is hosted. This is the only way to fully study the object and align/evaluate it accurately.
The OER Object’s Launch Page • Provide additional standards to the alignment • Click here if additional standards are needed in the alignment.