How to Mark AI Graded Questions
Overview
Essay question type in Quiz Activities needs manual marking from graders. This can be challenging specially if there are multiple essay questions and participants involved. In this tutorial you will learn how to bulk grade essay questions on quiz activities with AI Grading activated, this feature would allow graders to efficiently review student's answers and AI grading feedback to the (submitted attempts) in one page. This grading page would help streamline the process of the grading workflow.
If you are not familiar with creating quizzes in your LMS or the AI Grading feature, you may find the following links helpful.
• Check out this link to learn more on How to Use AI Grading
• You may visit this link to learn How to Setup a Quiz Activity
• You may also visit this link to know more about How to Mark an Essay Type of Quiz
Other useful links:
Step Tutorial
Step 1: From the AI Grading page, click on the "Grade" button of student submission you would want to mark.
Make sure that AI grading enabled on the quiz settings to get AI grading feedback. Otherwise student submission will not appear from this page.
Step 2: You will be routed to the attempt submission page, here you will see all essay question type for this quiz along with the AI Marking Suggestions for each.
Important note:
· If there's an issue with the AI Grading feedback, you must review the question and benchmarks inline with the AI Grading tutorial
· Most issues in AI grading results are due to issues with the specificity in the Marking Guide. This is discussed in detail on How to create a good marking guide
· Most issues in AI grading results are due to issues with the specificity in the Marking Guide. This is discussed in detail on How to create a good marking guide
Accessing Student Submission/s to bulk grade from the Progress Dashboard - Assessment Centre page
Alternatively, you can also check essay submissions from the Progress Dashboard - Assessment Centre page, here's how:
Step 1: Go to the Progress Dashboard menu and make sure that the report type is set to Assessment Centre
Step 2: Search for the specific Qualification/Course or activity you would want to grade (e.g in this example we have used the Category, Activity Type, and Completion status filters) once done with the filters, click the Generate Report button:
Important Note:
· In order to run the Progress Dashboard, at a minimum Category, Subcategory, Course, Activity Type, Group, Trainer, Student or Completion Status filter must be selected.
· In order to run the Progress Dashboard, at a minimum Category, Subcategory, Course, Activity Type, Group, Trainer, Student or Completion Status filter must be selected.
· At a trainer level of access, trainer filter is greyed out (you can only search for student attempts under your assigned courses)
Step 3: Progress Dashboard - Assessment Centre page will now show results based on the filters generated. Attempts that needs grading are listed in orange color, click on the "Requires Grading" button of your chosen attempt/submission to start grading:
Step 4: You will be routed to the student's attempt page, here you will see all essay question type for this quiz attempt along with the AI Marking Suggestions for each.
Things to take note when marking AI Graded Questions
· You can only see and be able to mark your own students from the AI Grading page.
· Review each questions and click the "Accept" button only if you agree to the AI grading decision suggestion, this would automatically apply AI's feedback and points to that specific question.
· AI grading does not handle partial grading, it only provides grading suggestion based on right or wrong answers:
◦ If answer is correct, AI grading will suggest for maximum allowed grade◦ If answer is incorrect or partially incorrect, AI grading will suggest 0
· Results of the AI Grading suggestions relies heavily on Grades information part (how marking guide was contextualised).
· AI Grading checks for new ungraded submissions every 2 hours, upon a successful student attempt submission, please wait within this time frame for it to generate AI grading feedback.
· AI Grading cannot provide feedback for image/picture submissions
· Placeholder Essay questions with 0 points will not be included on the
· Placeholder Essay questions with 0 points will not be included on the
Best Practices for Trainers and Assessors
In addition to setting precise benchmarks, trainers and assessors also play a critical role in ensuring the ongoing integrity and accuracy of AI grading. They should adopt the following best practices:
· Conduct frequent moderation sessions to calibrate AI grading against established standards and ensure consistency across all assessments.
· Routinely examine and refine marking guides to better align with AI grading outputs and address any discrepancies found during reviews.
· Keep detailed records of any issues encountered with AI grading. Reports should specify the problem identified, such as incorrect grading decisions, and include a rationale for why a response marked as Satisfactory should be Not Yet Satisfactory, or vice versa.
Related Articles
How to Use AI Grading
What is AI Grading - AI Grading is a powerful LMS AI tool that aims to assist the trainer/grader to decide whether student answers are Satisfactory or not. This tool leverages large language models to assess the answers provided by learners and ...Online Assessment Form Activity: Creating Short Answer Questions
Short Answer Questions are part of the Knowledge Assessment. These are questions which can be answered directly and graded by the assessor as soon as submitted. It can either be a short question, a table to be accomplished, or an essay question. ...Online Assessment Form Activity: Creating Multiple Choice Questions
Multiple choice questions can be built in the Online Learning Assessment Form. These types of questions are manually graded by the assessor. Follow the steps below on how to build multiple choice questions: Note: You need a Trainer or Manager access ...How To Mark an Essay Type of Quiz
Note: You need LMS Admin or Trainer access before you can perform this action. This tutorial will show you how to mark an attempt and give feedback for an essay type of quiz. Step 1: Login and go to the course page where you want to check the ...How to Bulk Grade Essay Questions (Regular Quiz Activity)
Overview Essay question type in Quiz Activities needs manual marking from graders. This can be challenging specially if there are multiple essay questions and participants involved. In this tutorial you will learn how to bulk grade essay questions on ...