Supporting minoritised student experience of Taught Postgraduate assessment: a co-creation project

This blog post is another in our series of scholarship-focused posts and summarises a report of this project, which investigates minoritised students’ experiences of assessment in higher education. The project lead was Dr Judy Chandler, and the co-researchers were Bob Hallawell and Rhiannon Moore. The project was funded by Praxis – WELS Centre for Scholarship and Innovation.

This blog post been edited by Dr Jane Cobb based on a Praxis project report by Dr Judy Chandler et al.

The Supporting Minoritised Students co-creation project found evidence of disparities in outcomes for minoritised PostGraduate Taught students and highlights the importance of students’ feedback literacy and existing capital.

“The general module assessment guidance… I seldom check that guidance because that’s too long and sometimes I think the information for me there is…is like too…too abstract, too general (interview participant).”

This study uses a change laboratory (a type of participatory, collaborative research within which ideas are tested) and case study methodology, in combination with analysis of quantitative data from outcomes of two Open University Master’s Programmes (in Education and in Childhood and Youth) and builds on existing literature.

The project reports the following key findings:

  • Many minoritised students do less well in qualifications than their counterparts. (The project defines minoritised students as: “students minoritised by language, social processes or institutions”.)  For example, Black, Asian and students who choose to share mental health conditions were awarded the lowest outcomes on certain courses.  Further, black students completed their taught postgraduate studies with the lowest course outcomes of these three minoritised demographic groups.
  • Application of feedback requires feedback literacy and is associated with students’ prior experiences and expectations. (I understand feedback literacy as being required to interpret the guidance and feedback around assessed work, which students have gained from previous study, and which would then feed forward to future assessed work.) The project finds that feedback literacy is associated with students’ prior (and cultural) experiences and expectations.
  • Existing assessment support contributes to the replication of patterns of existing capital and academic identity. Credit transfer students, those with prior experience of study or work within similar domains, and those who were already familiar with the Open University systems, are more able to navigate their assessment experience and emerge with positive course outcomes.  For students without pre-existing sources of this capital, strategies of navigation or resistance were more limited, as they were less able to draw on existing knowledge and experience to navigate the interpretation of assessment requirements, documentation, or feedback.

 

  • Data highlights the impact of negative feedback on a student’s confidence and view of their own ability. Further, a lack of clarity and specificity meant that feedback was sometimes difficult for students to apply, particularly for those for whom English is an additional language.

The project makes the following recommendations:

Academic teams should consider assessment data across courses, pathways and qualifications.

When designing assessment guidance and support, it is important to consider any assumptions made about students’ existing knowledge and skills and to ensure that support is in place for those students without this experience.

At a qualification level, endeavour to provide some consistency in tutor support.

Students declaring mental health conditions should receive continued support throughout their course, not just at its outset, in preparation for final assessment.

Create ways for all students to feel a sense of belonging during their course.

This project provides insight and empirical data which can be drawn upon by practitioners interested in improving student experience of assessment in higher education, particularly in a distance and online setting.

In so doing, it supports, for example, the ongoing work of the Anti-Racist and Inclusive Assessment.

The project team states that future iterations of this project will incorporate the experiences of course team members and tutors working on the Master’s in Education and Master’s in Childhood and Youth, alongside those of minoritised students. There will be a continued emphasis on the co-creation of inclusive and accessible assessment support, which builds upon the varied experiences of this diverse group of co-collaborators.

For further information on this project, please contact [email protected] or visit the Open University Scholarship Exchange 

 

“The proposal to develop this project to investigate the experience of all participants (tutors, course team and students), viewed as co-collaborators, seems an interesting way to strengthen and illuminate the data further.  Both the concept of feedback literacy itself and the fact that it is associated with prior experience resonate with me as an ex-OU tutor (of many years!).  Moreover, I have experienced that feedback can (unintentionally) affect a student’s confidence, and there is evidence to support this. Finally, the recommendation that a sense of belonging is created for students is something that, as tutors, we have been continually trying to achieve with varying degrees of success, such as by encouraging an active online student forum.” Dr Jane Cobb.

 

What are your thoughts on the findings and recommendations of this project?

 

Second-order researchers within education: challenges and tensions

tug of war
Photo by RUDI GUZTI from Pexels

This post responds to questions raised previously within this blog, which focus on the challenges faced by second-order researchers. Fearn (2023) suggests that within the field of education, second-order researchers (also named practitioner-researchers) “do not share their expertise through publication”, in part due to a lack of “adequate training in enquiry” (Fearn, 2023, drawing on Davis, 2019).   

Although it may be true that adequate training is not provided, this post will suggest that 

a lack of training is not the primary barrier preventing teachers from sharing their knowledge through publication.

Within the Scottish educational context, practitioner enquiry – the term commonly used to describe practitioner research in education – is an important part of professional learning (see General Teaching Council for Scotland, n.d.). This post suggests that it is not the act of enquiry that is the primary challenge but the act of publication following that enquiry.   

The literature tells us that practitioners engaging in research are insider researchers, party to “valuable insights” that other researchers “would admire” (Punch and Rodgers 2022, p. 278). But when considering the results and/or impact of practitioner enquiry, those judging the quality of the research (understandably) want the research to be reported with a full explanation of its context. Insider researchers can feel torn between the responsibilities they have to the academic community who will be reading their published work – who want as much context as possible – and the responsibility they feel towards their learning community; they can experience “feelings of loyalty to the group and even uneasiness during analysis” (Punch and Rodgers, 2022, p. 278), which would perhaps not be felt by researchers who are external to the learning community.   

It could be suggested that this tension would be felt by any practitioner-researcher in any field of practice. But, within the field of education, there is a growing recognition of the extent to which learning and teaching strategies must be adapted for and informed by the “unique circumstances of the learning community” (Education Scotland, 2022). If insider researchers have access to “valuable insights” that are inaccessible to other researchers, as Punch and Rodgers (2022, p. 278) suggest, practitioner researchers in education could provide increased detail regarding the ‘unique circumstances’ of their research situation. The tension described above, between the responsibilities felt towards the academic community and those felt towards the community being researched, can therefore be particularly problematic for second-order researchers within the field of education, given their increased access to information about that learning community and the emphasis on the importance of context within education.   

Interrogating the purpose of publication, and the purpose of practitioner enquiry itself, could support practitioner researchers in education to overcome this issue. Given Education Scotland’s (2022) emphasis on the need to adapt learning and teaching to the “unique circumstances” of a learning situation, we could question whether the results of practitioner enquiry need to be accompanied by detailed contextual information: would any practitioner reading such publications not have to adapt the outcomes anyway, to meet the needs of their own ‘unique circumstances’? Boland and Doherty (2020, p. 45) support this view by asserting that the contextualised learning one gains through practitioner enquiry cannot be used as a resource for other practitioners. They argue that the “small scale and the particularity of context” (2020, p. 45) reduce the extent to which the outcomes of practitioner enquiry can be used elsewhere but stress that the publication of practitioner enquiry is useful to demonstrate “how particular ideas provoke enquiry”. Elsewhere within the literature, Wall also emphasises the importance of the results of practitioner enquiry – but not necessarily in terms of the sharing of “the endpoint” – for Wall (2023), drawing on Stenhouse, 1981), it is the sharing of the research process “when the actual learning about pedagogy and research is happening” that is important.    

This post does not wish to question the importance of practitioner research within the field of education – nor does it question the importance of publishing such research. It does, however, wish to highlight the tensions that may prevent practitioner researchers within education from publishing their enquiries. It hopes to stimulate conversation about how published practitioner research within this field can be used – and therefore encourage consideration of the content we should expect within published practitioner research reports.  

by Sussana Wilson 

I am in the final year of my EdD studies, focusing on lecturers’ professional learning within the Scottish FE contextIn my day-job, I teach within Further and Higher Education, predominantly on teacher and lecturer education programmes