Webinar Two - Feedback and Evaluation of OER
by Joanna Schimizzi 1 year, 6 months agoDiscusison Board Tip: Please reply directly to this prompt by clicking "reply" below. You will only see the "Reply" button if you are logged in and a member of the group.
Prompt:
What feature did you see in a resource today that you think is high priority for OER in your context?
How might OER evaluation fit into your local Community of Practice?
1. Relevancy, currency, and thoroughness.
2. With training, it could be useful.
1. Different ways of teaching the annotated bibliography.
2. It would help screen for the best possible resources.
I am interested in where you saw the resource for teaching the annotated bibliography (or resources).
I really did enjoy this session. Knowing that there are informal and formal processed to evaluate OER materials really does help to elevate the value of OER materials.
I think both the evaluation and comment tools could really help boost the collaboration process across institutions in our consortium.
1. User friendly design and layout.
2. Make overall course evaluation easier :)
It is true, ease of navigation provided by good design and layout are extremely important for a resource.
1. Overviews of other reviews.
2. For specific field, community based gives an overview.
Definitely still learning how to assess what is available.
Tama -- I am seeing a lot of interest in specific fields collaborating. Some faculty in Arizona are really interested in Biology collaboration, so one of my goals for March is to try to create stronger opportunities for faculty to connect and collaborate. It should help reduce the time spent on "finding" resources and some time spent on evaluating resources.
Joanna,
That is great, but music seems to be a different animal. What is out there that I have found thus far, leaves a bit to be desired and I need to know specifically about Music Appreciation resources.
Searching ratings and comments during eval process. Great place to start to narrow down the search.
I truly enjoyed this session. I have saved some resources and have more confidence in evaluating and providing feedback. I gained much in the breakout rooms, as although we work in different disciplines, we discovered we look for similar criteria.
1. The ability to interact with a resource is a priority
2. As a group to work in collaborations, an evaluation is very critical and useful for development.
1. Accessibility characteristics (captioning / alternative text-based options for videos)
2. OER evalution could help people in my community develop resources that follow accessibility guidelines.
1) Level category that specify the main audience of the content
2) Its always a plus to receive feedback from people from various backgrounds.
1) Interactive applets in a calculus textbook.
2) OER evaluation will promote growth in the current and future pool of resources. "Average" evaluations are just as important as "loved it" or "hated it" evaluations to give an accurate summary of a resource.
I like the idea of "Average" evaluations. To me that speaks of something that could be great to remix, "It's a good source, but I would like to see ...". The soruce has the bones, but its average because you expect to see something more.
1. Current information and seeking resources that have high ratings.
2. I am always looking for resources that have actually been used and evaluated by professors. This is a great feature for me personally.
I wonder how often students find themselves in these space. Have you come across any student evaluations?
1. Ratings
2. Search fetures
Can you tell us a little more about the ratings and search features that you found might be a high priority in your context?
What feature did you see in a resource today that you think is high priority for OER in your context?
One thing I'm a bit deficient on in my materials: photos and images. I learned about new open sources options for photos, which is awesome.
How might OER evaluation fit into your local Community of Practice?
My courses are being evaluated by our Instructional Designers (including Micah), so I feel comfortable. The scaffolding approach works well, so if you have completed QM training, that is a great foundation to know you're on track in your course design (hopefully :-)
I evaluated a textbook. I appreciated that it included a description of the resource and tags that indicated what disciplines it related to (it could be used in multiple disciplines)
The multiple ways that sources can be evaluated allow for filtering by relevance and quality, which can be useful when there are a lot of sources that may be 5-stars but not at the appropriate level for our students.
The information on how to better evaluate OER contributions was helpful. It does require an equal amount of empathy and scrutiny all in the goal of enhancing the overall product. Excellent info. shared by fellow faculty.
1. What feature did you see in a resource today that you think is high priority for OER in your context?
We are looking to replace entire texts for our subject matter area, and there were several full-text OERs available in different levels.
2. How might OER evaluation fit into your local Community of Practice?
A main concern is quality of the materials we use. Having the resource evaluations (when they are available) will help with decision-making and choosing OERs. There also seems to be resources with no evaluations at present. If we use the materials, we can help our colleagues by providing an evaluation (if we can find the time, alas! That's the tough part).
And a relevant xkcd comic for this week's session: https://xkcd.com/1098/
That is an awesome comic Laurel.
1. Review and evaluation.
2. In my Area of instruction I like the evaluation rubric both for evaluating another work and for receiving any evaluations of my own work.
What feature did you see in a resource today that you think is high priority for OER in your context? Relevance! The thing I love most about OER is being update to date! Science textbooks are out-of-date before they have dried from their original printing.
How might OER evaluation fit into your local Community of Practice? People are always worried about quality. If we spent more time on evaluation and improvements in small ways, we would all have great products.
1 I would look for currency. I think the dynamic nature of these resources makes currency easier to achieve.
2 I think it would afford a starting point for everyone to work with, as in you practice providing feedback and think about how that impacts what you are creating.
I think that the evaluate and comment features within the OER Commons can be a good way to quickly determine whether a particular resource may fit your needs.
As all textbooks are evaluated, it shouldn't be too hard to update the evaluation practices within an organization so that they are applicable to OER as well.
I think the rubric is high priority for OER in my context. As a librarian for all subject areas, being able to see how the content is evaluated by content experts (other faculty) will help me curate lists for the faculty I serve.
I like the comprehensiveness of the rubric, however I wonder if it is a bit too time consuming for many fauclty. I think there would be lots of good intentions to come back and fill out a rubric after giving a quick star review, but follow through most likely would not happen (again, due to time)
I think it depends on a person's focus and interest. Think about all of the reviews on Amazon or Google. There are people that will engage and make the time for the evauation. There are people that won't. I think if anything that might add to the vaidity of the evals. The people that complete them fully are doing it probably because they really believe what they are rating.
1. Ratings and written reviews of OER from other educators will be helpful, I think, as I research what sources I'd like to use.
2. My colleages at CCC are increasingly interested in (and involved in) working with OER to support student success and the OER Commons is a useful repository.
Hi Anna, I agree on the value of OER Commons. In fact, I just uploaded a few resources there myself :-)
It is inspiring to view all the resources that are shared.
Karly
Until our lesson, I hadn't thought about the review features. I think that really helps address quality issues and with people new to OER, it is a great thing to review and then think about with your content. Good luck to you and your college.
I really got into the search function finally, amazing that I had not seen the filters and used them they are my goto on youtube,
Not sure how the evaluation will fit, depends if the criteria I am looking to integrate needs to be strongly evaluated
It took me most of the week to figure that out. It's a great tool though!
I learned how to quickly look for quality OERs.
1) Primary source material is important and difficult to find in OERs.
2) I could see using it prior to talking with fellow faculty about whether to adopt an OER.
1. Finding a simple skills manual is priority for me right now
2. Screens for better sources.
I hadn't thought about actually preparing material to go into the OER "universe" before these sessions.
1. Ability to be interactive and up-to-date
2. I think the phrase "eating the elephant one bit at a time" comes to mind here ... using ratings and comments to peruse through a few resources a week without trying to get lost in the rabbit hole.
Ha! I love that saying. I use it all the time when approaching difficult problems in my math classes. It's definitely applicable in our OER context.
I am wondering if there are OERs for the Computer Field, I don't seem to find much. Any hints would be helpful. Also, How do you use the WWW in your OER. Thanks, Fay
1. Simplistic layouts for lesson sections with references and credits
2. Hierarchy of evals that provide a better overall view
1. Peer review can be done directly in the resource. Ours is a separate process using an internal rubric. I may rethink this for future iterations.
2. Common evaluation is useful for strenghthening any community of practice. It is a key part of professional development that should be undertaken on a regular basis.
I like that the review can be done in the resource too. One less place to go to complete work is always appreciated!
1 - I never thought about reviewing the comments that my peers left and how helpful this can be.
2 - I think it is a great way to revise and remix.Your peers are already pointing out areas they saw and its a way to continue to apply and move forward, especially after multiple remixes of the same source.
The comments are helpful for me since I am not a content expert. My role (librarian) is to pull resources for the content experts (faculty), but I still want to pull the best that I can so seeing what others thought about the resource will be helpful.
I've been asked to do OER evaluation for licensing/copyright in the past, so I am faimilar with that part of the eval process.