OER Quality Evaluation

Created Feb. 7, 2024 by NCeL

Welcome

As NCeL advances its open educational resource (OER) adoption and implementation plan, it brings you SHMS, a comprehensive OER toolset and immersive professional learning program to assist educators in enhancing their capacities to use, evaluate, curate, and create OER. 

This is the first module in our training series that will provide participants with an introduction to OER quality evaluation. We have designed these modules to first spark the learner's interest in the topics covered and then dig deeper into the content through presentations, storytelling, and demonstrations of the tools. We will offer opportunities for learners to practice exploring the resources and tools, and reflect on how they might use them in their work. 

SHMS Training Course Outline:

Kickoff: Opening Live Session welcomes participants and introduces the course goals and outcomes.

Level 1: Introduction ot OER  (3 modules)

- Module 1 - Overview of the what, why, and how of OER; including an exploration in open licensing and a showcase of OER use cases from around the world

- Module 2 - Content Discovery: identify teaching and learning goals, search and browse collections

- Module 3 - Curation and Collaboration of OER with groups, shared folders and discussions

Level 2: Evaluation (2 modules)

- Module 1 - Quality: participants reflect and share their quality criteria for teaching and learning materials they use

- Module 2 - Tools for Evaluating: explore digital tools for assessing OER (Achieve Rubric, Rating, Comments)

Level 3: Authoring and Remixing (3 modules)

- Module 1 - Authoring Toolset: demonstration of Open Author and Module Builders

- Module 2 - OER Design: discover instructional design supports, including templates

- Module 3 - OER Remix: overview of the what, why, and how of remixing OER

Level 4: Open Education Practice for curriculum improvement (1 module)

- Deep dive into the feedback, refinement, reflection, and revision process

Admin Training Course

- Site Administration and Management

The Closing Live Session covers Q&A and congratulates participants on all that they have accomplished. Participants can also discuss and plan next steps for implementation and outreach.

About SHMS

SHMS is a National program that aims in enriching the educational content to support education. This program seeks to find a sustainable path to partnership in design, improvement, maintenance, and enhancing the quality of the digital educational content and it will contribute in providing more educational opportunities for those who speak the Arabic language. This would be achieved through partnerships with leading international and Arabic institutions for building digital repository, and localizations of the OER and building high-quality Arabic educational content. In addition, it will be opening the way for academics and students in Saudi Arabia to enrich the content through well-defined process to ensure quality.

Program Objectives

  • Contributing to the quality of lifelong education.
  • Enhancing the quality and accessibility of teaching and learning resources.
  • Build capacity of participants in developing sector-wide OER policies.
  • Strengthen the coordination in design, development and quality assurance of OER.
  • Establish the best open educational practices, products, and outstanding processes through self-evaluation and peer review.
  • Encourage researchers and developers to conduct studies and propose guidelines and solutions to enhance the OER system.

Pre-activities:

To participate in group discussions during the REFLECT sections you will need to create a login and join the Group. Please see instructions below

CREATE A PROFILE on SHMS to be able to contribute to the discussions in our group, and to save, organize, remix, and author resources. Share some information about yourself and upload a photo or image here: http://shms.sa/profile/edit

JOIN OUR GROUP Once you've logged in successfully, join the Evaluation Group by clicking "Join This Group"

Quality Matters

Each of us have our own quality criteria that helps us select which resources we use in our teaching.

image3
image3.pngimage3

image3


REFLECT: Take a moment to reflect on your quality criteria and provide two or three examples of the criteria you use to help you assess if the resources you find are acceptable to use in your teaching. Reply here

For example, I’ve been searching for various videos to introduce new content to my students. Videos must have clear and concise presentation of the content with easy to understand visuals because my students will be watching them on their own time. Videos must have accessibility supports like closed captioning for my hearing impaired students.

*Reminder: you will need to be logged in to SHMS and join the Group to reply to the discussion.

Evaluation Supports

SHMS has supports to help us assess the quality of OER we discover. To help educators determine the degree of alignment of OER to standards and to determine other aspects of quality of OER, Achieve developed rubrics in collaboration with leaders from the OER community. Achieve partnered with ISKME to develop an online evaluation tool to allow users to apply these rubrics and evaluate the quality of instructional resources. We will be using the tool in our next module to formally assess OER, and we wanted to give you an overview of the seven quality areas that the rubric assesses with the hopes that this will inform your own quality criteria for selecting resources to use in your teaching.

  1. Degree of Alignment to Standards - How closely aligned to the learning standard is this resource? Standards could be common core, next generation science, or other.

  2. Quality of Explanation of the Subject Matter - How thoroughly is the subject matter explained in this resource?

  3. Utility of Materials Designed to Support Teaching - Is this resource designed to support teachers in planning and presenting the resource? Is it easy for teachers to understand and use?

  4. Quality of Assessment - Are there assessments included in this resource that determine what a student knows before, during, and after the subject is taught?

  5. Quality of Technological Interactivity - Is technological interactivity included in this resource?

  6. Quality of Instructional and Practice Exercises - Are exercises designed to provide an opportunity to practice and strengthen specific skills and knowledge?

  7. Opportunities for Deeper Learning - Are students engaged in any of the deeper learning skill areas below?                                             Think critically and solve complex problems. Work collaboratively. Communicate effectively. Learn how to learn. Reason abstractly. Construct viable arguments and critique the reasoning of others. Apply discrete knowledge and skills to real-world situations. Construct, use, or analyze models.

Any SHMS user is welcome to assess and evaluate resources using the Achieve OER Evaluation Rubrics. While not all of the resources on SHMS have been evaluated with these rubrics, some of them have been evaluated and you can search by rubric in Advanced Search.

REFLECT: Given what we have shared and explored today, if you were to add an eighth quality area to the Achieve Rubric, what might you recommend? Add your suggested quality area description in two sentences or less with your Reply Here

Next Modules

Our next module will focus on OER Evaluation Tools and will be an opportunity to explore digital tools for assessing OER with rubrics, ratings, and comments.


Return to top