{"id":176,"date":"2010-09-08T14:26:44","date_gmt":"2010-09-08T14:26:44","guid":{"rendered":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=176"},"modified":"2012-07-16T14:52:44","modified_gmt":"2012-07-16T14:52:44","slug":"counting-counts-but-syntax-sucks","status":"publish","type":"post","link":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=176","title":{"rendered":"Counting counts but syntax sucks"},"content":{"rendered":"<p>The quote I&#8217;ve used as the title of this post has been attributed to the late Professor Roger Needham at the University of Cambridge.<\/p>\n<p><a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2010\/09\/IMG_00691.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-thumbnail wp-image-198\" title=\"IMG_0069\" src=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2010\/09\/IMG_00691-150x150.jpg\" alt=\"\" width=\"150\" height=\"150\" \/><\/a>I can&#8217;t believe I&#8217;ve been blogging for two months and am only now mentioning our work\u00a0with short-answer free-text e-assessment questions for the first time. I talked about this\u00a0 yesterday at <a href=\"http:\/\/www.alt.ac.uk\/altc2010\/index.html\">ALT-C<\/a>\u00a0at Nottingham University (the photo shows the Millenium Garden), in a demonstration linked to the launch of the JISC guide to &#8216;Effective Assessment in a Digital Age&#8217; (in which we feature as a case study). I&#8217;m talking about the work again on Friday, at the Physics Higher Education Conference in Glasgow.<\/p>\n<p>In summary: we have\u00a0written computer-marked e-assessment questions in which students give their answer as a short sentence (up to 20 words). We give students three attempts at each question, with increasing targeted feedback for incomplete and incorrect responses. We have used responses from students in developing our answer-matching &#8211; I think that&#8217;s key.\u00a0We&#8217;ve used both linguistically-based software (<a href=\"http:\/\/www.intelligentassessment.com\/\">Intelligent Assessment Technologies&#8217; <\/a>FreeText Author) and the OU&#8217;s own OpenMark PMatch, which is entirely based on keywords and\u00a0word-order.\u00a0Both have worked well, achieving\u00a0better marking accuracy than human markers.\u00a0I&#8217;m not advocating \u00a0doing away with human markers, however perhaps we could use\u00a0this type of\u00a0e-assessment to relieve them of some of the drudgery, leaving them free to mark more sophisticated work and to support students in other ways.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The quote I&#8217;ve used as the title of this post has been attributed to the late Professor Roger Needham at the University of Cambridge. I can&#8217;t believe I&#8217;ve been blogging for two months and am only now mentioning our work\u00a0with &hellip; <a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=176\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[56],"tags":[59,58,344,353,35,60,61,62,57],"class_list":["post-176","post","type-post","status-publish","format-standard","hentry","category-short-answer-free-text-questions","tag-accuracy","tag-alt-c-2010","tag-e-assessment","tag-jisc","tag-openmark","tag-phec-2010","tag-pmatch","tag-roger-needham","tag-short-answer-free-text"],"_links":{"self":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/176","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=176"}],"version-history":[{"count":8,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/176\/revisions"}],"predecessor-version":[{"id":988,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/176\/revisions\/988"}],"wp:attachment":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=176"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=176"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}