{"id":585,"date":"2011-07-31T11:04:31","date_gmt":"2011-07-31T11:04:31","guid":{"rendered":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=585"},"modified":"2011-08-14T19:11:56","modified_gmt":"2011-08-14T19:11:56","slug":"assessing-open-university-students-at-residential-schools-and-otherwise","status":"publish","type":"post","link":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=585","title":{"rendered":"Assessing Open University students – at residential schools and otherwise"},"content":{"rendered":"

\"\"<\/a>I was due to be tutoring at the Open University residential school SXR103 Practising Science<\/em> at the University of Sussex (shown left; the crane is a reminder of the huge amount of building work that is going on) for two weeks this summer. Unfortunately\u00a0flu and laryngitis forced me to bail out after just one week. It was an excellent week, even if teaching is a bit challenging when you have no voice! – I’m extremely grateful to my colleagues, especially Keith, Chris and Anne-Marie, for helping to cover for me and to Dave for staying on an extra week in my place.<\/p>\n

So now I’m home with unexpected time to catch up on some reading, writing and reflection\u00a0(though my thinking may be\u00a0even more\u00a0befuddled than usual!). \u00a0I’ve thought previously that the assessment-related issues confronting those of us who work at the UK Open University, with its ‘supported distance learning’, are not that dissimilar to those working at conventional ‘face to face’ universities.\u00a0Now I’m\u00a0beginning to wonder.<\/p>\n

Let’s start by thinking about teaching and assessing\u00a0introductory science at a distance (for example in the OU module S104 Exploring Science<\/em>). We do everything we can to make the learning process active. Students are required to do experiments at home and there are other activities requiring them to watch videos and complete interactive activities. Each student has a tutor, and occasional tutorials (face to face or using ‘Elluminate’) are provided, but we can’t assume that our mostly part-time adult students will be able to attend these (for reasons of geography\u00a0or other commitments at any specified time) so we can’t assess student contributions\u00a0to them. \u00a0However activities conducted within each tutor group’s online forum are<\/strong> sometimes assessed.<\/p>\n

The module texts\u00a0are peppered with \u00a0in-text questions and self- assessment questions, and it is only a very small step from these to our formative-only interactive computer-marked questions (iCMAs).\u00a0From here\u00a0it is only a very small step to low-stakes summative use of iCMAs (with the weighting to act as an encouragement to students to attempt the questions in timely fashion). We know that students appreciate the instantaneous feedback on iCMA questions, and they also have a pacing and motivational function. Alongside iCMAs, students submit and receive feedback on regular tutor-marked assignments (TMAs)\u00a0to their tutors, and the module ends with a synoptic end of module assessment (EMA).<\/p>\n

All of these components have a useful function in assessing and teaching our students. Each has to be submitted by a particular date (with short extensions available on TMAs only), which helps to keep students up to date.\u00a0\u00a0However none of the components is timed and each is available to students for at least several weeks before the cut-off date. Everything that I’ve described so far is done for a good reason and practice has been developed and refined throughout the University’s 40-year history. However, the fact that students see their assessment questions substantially before each due-date means that assessment can drive learning to an unfortunate extent. Strategic students read the questions first and then only study relevant part of the module materials. This behaviour is prevented to a certain extent by exams on higher-level modules, but exams bring their own problems for many of our students and the learning outcomes being assessed in S104 were deemed to be more appropriately assessed by an end of module assessment (completed at home and with flexibility over when it is done and how much time is spent on it).<\/p>\n

Compare this with SXR103 when suddenly our distance learners are being taught face-to-face, in the lab, field and on a project (requiring them to work as a member of a group). It’s\u00a0pretty intense with\u00a0 lab work, field-trip or project from 9am-5.30pm each day and tutorials in the evening. The lab work is sometimes a bit recipe-driven (something that is being addressed as we alter the way in which we teach practical science) but I’d like to concentrate on the learning outcomes that are being assessed and the method of assessment. For the Earth science and physics activity I’ve been working on (‘Rocks and radioactivity’), the learning outcomes relate to working safely, observational skills, taking measurements, analysing results (including graph plotting and interpretation).<\/p>\n

The key point is that both students and tutors work extremely hard to help students towards achieving these learning outcomes whilst they are with us in the lab. Assessment is by (1) satisfactory participation (not quality of results) and (2) an end of module assessment, requiring students to analyse and interpret results and to ‘write up’ one of the experiments they have completed during the week.\u00a0<\/p>\n

The significant point is that the EMA is not released until students have completed their week at residential school – so the sort of strategic behaviour I described above is not possible. This stops the residential school from being assessment-led, and does so most effectively. But we can’t currently do this on our conventional modules, because each student is working at a different pace and some require access to assessment materials before others do. For the future, a possible solution (being used on a few modules) is to only release assessment after a student has completed a particular online task, but for most modules the OU’s flexible online delivery definitely adds a problem that face-to-face teachers do not encounter.<\/p>\n","protected":false},"excerpt":{"rendered":"

I was due to be tutoring at the Open University residential school SXR103 Practising Science at the University of Sussex (shown left; the crane is a reminder of the huge amount of building work that is going on) for two … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[90,135],"tags":[362,136],"class_list":["post-585","post","type-post","status-publish","format-standard","hentry","category-open-university","category-residential-schools","tag-open-university","tag-residential-school"],"_links":{"self":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/585","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=585"}],"version-history":[{"count":9,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/585\/revisions"}],"predecessor-version":[{"id":660,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/585\/revisions\/660"}],"wp:attachment":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=585"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=585"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=585"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}