4R Framework and 4R Rubric
4R Framework and 4R Rubric
In recent years, there has been considerable interest in using Generative AI. In particular, students may use it for doing assignments (e.g., essays and programs). Therefore there is a strong need to take into consideration the use of Generative AI in grading assignments. Here, a 4R framework is proposed to facilitate the grading of Generative AI-related assignments.
The 4R framework consists of four core elements:
(1) Report: Students should report what and how they have used (i.e., similar to citation).
(2) Recap: Students should recap the Generative AI's output (i.e., to show his/her understanding).
(3) Revise: Students should revise the output based on their own work.
(4) Reflect: Students should reflect what they have learned (i.e., learning reflection).
In addition, the following 4R rubric with suitable weightings is proposed for assessment purposes (i.e., to determine a grade taking into consideration the 4R elements with suitable weightings):
| A+/A/A- | B+/B/B- | C+/C/C- | D+/D/D- | F | |
|---|---|---|---|---|---|
| Report | Full report | Clear report | Acceptable report | Weak report | Poor report |
| Recap | Comprehensive recap | Clear recap | Basic recap | Weak recap | Poor recap |
| Revise | Transformative revision | Major revision (with minor deficiencies) | Basic revision (with minor deficiencies) | Little revision | Poor revision |
| Reflect | Critical reflection showing excellent learning | Clear reflection showing good learning | Basic reflection showing satisfactory learning | Weak reflection showing little learning | Poor reflection showing insufficient learning |
Note: Suitable weightings should be assigned to each 4R element. D- may be optional.
The effective grade is then determined by the following GPT formula:
G* = G x PT
where
G* is the effective grade (i.e., the student's final grade)
G is the grade of the submitted output (i.e., Generative AI output together with student's input)
PT is the proportion term (0 to 1) as determined by the 4R rubric
Let's consider the following example. Suppose that we have the following PT table:
| PT | Minimum GPA as determined by the 4R rubric |
|---|---|
| 0 | 0 |
| 0.25 | 1.7 |
| 0.5 | 2.0 |
| 0.75 | 2.5 |
| 1.0 | 3.0 |
If a student can get at least 3.0 based on the 4R rubric, his/her grade is not affected. However, if a student gets 2.0 based on the 4R rubric, the effective grade will be reduced by 50% (i.e., by a factor of 0.5). Note that it is a general approach as teachers can determine the weightings and PT table based on their needs (e.g., nature of assignments).
If you have any comments or suggestions, please email them to Henry Chan at cshchan@comp.polyu.edu.hk.