The title of this post may sound contradictory. If we give students marks, the assessment is summative. Right? Not necessarily. It is perfectly possible to tell students their ‘mark’ for an assignment but for that mark not to count towards the final outcome (so this assessment is purely formative). Similarly, it is possible for a grade from an assignment to count towards the final outcome (and so be summative) even if the student is not told this grade.
Confusion over this point has clouded my thinking about whether iCMAs (interactive computer-marked assignments) should be formative or summative. I am increasingly accepting the argument that telling students their grade for an assignment at the same time as giving feedback can dilute the effect of the feedback – if the student gets a good grade they may think that they don’t need to improv, so reason that there is no point in reading the feedback; if the student gets a poor grade they may think that it is impossible for them to improve to the required standard and so, again, not read the feedback. But I know that students engage with feedback from iCMAs at a deeper level if the iCMA is summative.
One example of this is illustrated in the figure below. The three charts are for variants of the same question (a question requiring the student to use a provided word equation to calculate density) in low-stakes summative, formative-only and diagnostic use. In each case the student was given three attempts, with increasing feedback provided. Green represents a correct reponse; red/orange/yellow represents an incorrect response – and the colour stays the same if the response is unchanged from first to second or from third to second attempt. Grey represents a ‘blank’ response : in summative use, 21% of the third-attempt responses were identical to those given previously with 2% of them blank; in formative-only use, 46% of the third attempt responses were identical to those given previously with 7% of them blank; in diagnostic use, 55% of the third attempt responses were identical to those given previously with 19% of them blank.
In the context of what I am discussing in this post, the relevant point is that, even in summative use, students are not told their mark for the question or for the whole iCMA at the same time as being given the feedback. For this particular module, they are given their overall iCMA score at a later stage (once the score has been ratified, usually around a week later). For other modules they are not given their iCMA score at all, just whether or not they have passed – students don’t seem to like this much, but it is a reflection of the fact that borderline decisions are made by a human-marker, looking at the responses that the student has entered into the computer.
I’m not saying that summative use of iCMAs is necessarily the best way forward – students still seem to be preoccupied by the minutiae of the grading – but the issue is a different one to whether students are distracted from the feedback provided by seeing a numerical score or grade at the same time.