Guidebook: Designing an Alternative Assessment Where Learners Use GenAI

15. Monitor the Assessment

This brings us to the final step in the development of an assessment: deployment and monitoring. In other words, you will try out, and then evaluate the assessment.

You may want to decide, in advance, how you will assess the performance of this assessment and how you will collect data to determine how to improve it. Some of the ways in which you could collect data on its performance include:

• What appear to be common points of confusion for students about the assignment? Consider modifying the assignment instructions to address this.
• What are aspects of the assessment that students tend to do well and aspects where many struggle? Consider whether this is an important aspect of the learning for this assignment (i.e., whether it aligns with the learning objectives). If it does, you may bolster opportunities for learning this objective. If the aspect of the assignment that is challenging is not important for your course objectives, consider remove it.
• Collect student perspectives on the assessment – for example by administering a short anonymous survey. How are students responding to the assignment? What do they like and what critiques do they have?
• As you grade assignments, consider asking students who submitted excellent work whether they would give you permission to use their work as examples in future courses. You can add these samples in the instructions/ resources for the assignment.

Based on the data you collect and the reflections you make, iterate, and improve the assignment. It will only get better.

To Do

Congratulations – You are done with your assessment design!

The final step is to share what you developed with your peers, review what others have done, celebrate, and share ideas with one another.

 

Note: Images created using Bing Image Creator (September 2023)