Sue G-M's rubric

Sue G-M's rubric

by Susan Glynn-Morris -
Number of replies: 12

Hi All

I've enjoy reading the Q&As and was intrigued by the simplicity and positivity of the single point rubric. I have used the concept to create a single point peer review rubric (attached below). 

I've often seen peer review forms which only ask students to provide a score for various criteria, do not ask for specific feedback, and are often only used to generate a mark for the student being evaluated. In this rubric I have added a column for feedback that ideally could be shared with students. 

Thinking about how this feedback could be compiled and shared simply and anonymously, I have played around with Google Forms (link below). Data can be downloaded and shared back to students (some editing may be required to separate the students). 

Curious to hear your thoughts!

Peer Evaluation Rubric

Google Form

 

In reply to Susan Glynn-Morris

Re: Sue G-M's rubric

by Jacquie Harrison -

HI Sue,

I love how you have broken down the criteria for successful group participation! 

For the rating scale, I'm wondering if the expectations have been made clear to the students. For example, what is the expectation that students will follow timelines. How would you exceed the expectations? 

I always find it difficult to use criteria that is double barrelled. In the Quality criteria it says made a valuable contribution and produced quality work. I'm never sure how to respond if they did really well in one (made a valuable contribution but did not always produced quality work).

In reply to Jacquie Harrison

Re: Sue G-M's rubric

by Susan Glynn-Morris -

Great points Jacquie. Thanks for taking the time to review and provide feedback. I really appreciate it. I always cringe at double-barrelled questions on surveys and now I've done it too!

In reply to Susan Glynn-Morris

Re: Sue G-M's rubric

by Sue Hellman -

Hi Sue.

 I tried opening the Google Form, but it says only the owner's group can view it. To make it available to others, you have to adjust the permission settings. 

-Sue too

In reply to Susan Glynn-Morris

Re: Sue G-M's rubric

by Bettina Boyle -

HI Sue,

Great point regarding making space for specific feedback.

If I look at your rubric example with a student’s eyes, I may not be quite sure what would warrant a 1,2, 3 or 4 (did not meet, partially met etc.) for each expectation.

Putting on my educator classes I see a couple of ways you could make this a bit clearer:

1) Consider adding descriptors for each expectation and level as in an analytical rubric. This could also help clarify what expectations such as useful recommendations, fair share, showing respect etc look like.

Or

2) Stay with the Single Point rubric (It is simpler and easier for students), but try to move the expectations the centre column (“met expectations”) with space for comments on either side. Examples in this in this discussion. This would force peers to really consider and being specific about if a peer either did not meet or exceeded expectations. I like this, because it includes a level of accountability for the giver of the feedback, and it incorporates your point of space for feedback.

 

On a different note… Your question of how to share this feedback simply and anonymous made me think quite a bit and had me go back and forth a few times when thinking about my comments to you.

While anonymous may spur some honesty that wouldn’t otherwise come out, it also removes a sense of accountability from the person giving the feedback. And then I started thinking about how peer evaluation rubrics could be used non-anonymously and along the way, rather than at the end…

I am working on this myself at the moment with my class on Leadership in Teams. Peer evaluation is a part of it, but ideally, the teams are able to create a sense of trust and honest feedback throughout the term so there is no big surprises at the end. However, of course the reality is that this doesn’t always happen.

So in case this resonates with you - my question to myself has been, how can I coach and guide them to create such as space? What may be some formative assessments or check points that gets them use to giving and receiving feedback along the way – and allow students to correct behavior as needed?

Bettina


In reply to Bettina Boyle

Re: Sue G-M's rubric

by Sue Hellman -

Re peer assessment ananymous or not? 

The reading I've done says that an important issue to consider is that peers can be reluctant to assess in such a way that could make another peer look bad or lose marks. I think using this as a formative assessment is a one way to remove that kind of pressure. Then creating a checklist style rubric so reviewers are asking themselves 'do I see this requirement or not' takes them out of the role of judge and makes the process more supportive. Using names means that the person whose work was assessed can go back to the evaluator for clarification if needed especially if more than 1 response was received and they have conflicting results. 

In reply to Sue Hellman

Re: Sue G-M's rubric

by Susan Glynn-Morris -

Another great point! I am very keen to revisit the idea of peer assessment as a form of formative evaluation. Thanks for sharing your thoughts. 

In reply to Bettina Boyle

Re: Sue G-M's rubric

by Susan Glynn-Morris -

Thanks for sharing your thoughts Bettina. I agree with your point about moving the standard to the centre (I did see that discussion post). I am going to play with this. I also appreciate your point about finding ways for students to provide non-anonymous feedback throughout the course. The reality is that in a small group, if someone writes something anonymously, the person receiving the feedback may well have a good idea of who said what based on their interactions. Good food for thought... Thanks again.  

In reply to Susan Glynn-Morris

Re: Sue G-M's rubric

by Tara Vanderveer -

Congratulations for diving into something new! I too am struggling/playing with the single point rubric. I have made one that, once I revise in this course, I am going to use and see how it goes!

I wonder if moving the criteria to the middle as the "standard" would make it more clear to students what is the bear minimum for like a "C".

I would also not shy away from having a ZERO column. The works I have read and the VALUE rubrics team and AAC&U suggest it is important to have the option to say, this was totally unacceptable.

For instance...
Does not meet   Partially Meets   Standard Met   Exceeds   Excels   Feedback

Leadership

Proposed useful recommendations and helped keep group on task.

(I do question if this shows leadership though)



In reply to Tara Vanderveer

Re: Sue G-M's rubric

by Susan Glynn-Morris -

Thanks Tara. I like this idea and am going to play around with it! I appreciate you taking the time to comment.

In reply to Susan Glynn-Morris

Re: Sue G-M's rubric

by Sylvia Riessner -

Thanks for sharing your Peer Evaluation Form - both the Word doc and the Gform. I thought your approach was very straightforward and, putting on my participant/learner hat, I'd be more inclined to complete the online form and maybe it doesn't have to be anonymous to make me inclined to be honest?

As Bettina mentioned, creating a supportive learning environment/community could help, as well as incorporating an ongoing, formative use of the tool?

A couple of minor suggestions/questions:

1.  Move the meaning of the "1234" to the top of the table in the Word doc - sometimes students don't take the time to scan an entire document and might just guess.

2. Make clear when you want students to share their own perspective (expectation) or when there is a clear course standard and they should be assessing whether their peer had achieved that standard

Note:  I noticed a couple of comments you've received have addressed the vague nature of expectations and assigning a point based on expectations. However, I'd suggest you NOT try to be more specific - the feature of single point rubrics that appeal to instructors and students (IMHO) is the simplicity and ease of completion.

If you clarify that this is the student's assessment, based on their understanding of course standards AND their own perception of what was "useful", "valuable", "tactful" etc.  I'm not sure that such subjective terms can ever be totally clear without way too much detail?  Perhaps the suggestion to add an Examples column could help? So the students could quickly provide an example of what they appreciated or found lacking?

And a final reflection in terms of how such a tool could be used. You say, in the Gform, that their responses are anonymous but, perhaps, just as important, would be to make a brief statement of the value of sharing peer perspectives and how the data will be used. If not in the form, then whenever you introduce its use?

You could introduce an appreciative perspective both explicitly and by modeling how you yourself provide feedback/assessment information to the group?

In terms of your exploring the use of an anonymous tool - it would be helpful to think about the size of your cohort, and how valuable their feedback or how fair their assessment might be if the teacher is going to use it to create marks?  My concern with peer feedback, particularly in larger groups would be that it would have to be considered in light of the participation level and attitude of the person providing the feedback. I've seen students provide fairly quick responses to peer feedback and, when I checked my notes (and the online course records) they sometimes had spent very little time participating themselves.

If the purpose of the peer feedback was to identify potential areas that could be improved rather than helping an instructor render an evaluation, I believe your rubric would be very useful.

Cheers


In reply to Sylvia Riessner

Re: Sue G-M's rubric

by Susan Glynn-Morris -

Thank you Sylvia for your thoughtful response. I have really appreciated everyone's feedback. It has given me a lot to think about. I only wish I had more time to do this thinking and make changes as part of this course. I will definitely be keeping track of the comments I have received. Thanks again.