{"id":166,"date":"2010-09-08T08:35:14","date_gmt":"2010-09-08T08:35:14","guid":{"rendered":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=166"},"modified":"2010-09-08T08:44:33","modified_gmt":"2010-09-08T08:44:33","slug":"do-we-know-what-we-mean-by-quality-in-e-assessment","status":"publish","type":"post","link":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=166","title":{"rendered":"Do we know what we mean by &#8216;quality&#8217; in e-assessment?"},"content":{"rendered":"<p>This was the topic of my roundtable at the <a href=\"http:\/\/www.northumbria.ac.uk\/sd\/central\/ar\/academy\/cetl_afl\/earli2010\/\">Earli\/Northumbria Assessment Conference <\/a>and I am very grateful to the 10 people who attended one of the two wonderful discussions we had on the topic.<\/p>\n<p>The obvious answer is that, no, we don&#8217;t know what we mean by &#8216;quality&#8217;. We don&#8217;t even know what we mean by &#8216;e-assessment&#8217;, Having discussed this a bit, we moved on to discuss\u00a0different aspects of &#8216;quality&#8217;. I note that both groups, whilst mentioning that validity and reliability are important, also emphasised the role of e-assessment in transforming learning, in particular through its ability to provide instantaneous feedback.<!--more--><\/p>\n<p>Words that experts use in the context of &#8216;quality&#8217; in e-assessment include (in no particular order):<\/p>\n<p>Reliable, Accurate, Valid, Effective,\u00a0Practical (i.e. cost-effective), Consistent, Equitable, Secure, Technically reliable, User-friendly, Accessible, Appropriately aligned, Authentic, Authenticated (Plagiarism-proof), Transparent (students know what they are expected to do), Engaging, Satisfying, Appropriate to medium, At appropriate level,Feedback-rich, Relevant, Timely<span id=\"_marker\">\u00a0<\/span><\/p>\n<p style=\"line-height: 150%; text-indent: -23.75pt; margin: 7.7pt 0cm 0pt 23.75pt; vertical-align: baseline;\"><span style=\"line-height: 115%; font-family: &amp;amp;amp; color: black; font-size: 11pt; mso-fareast-font-family: +mn-ea; mso-ascii-theme-font: minor-latin; mso-hansi-theme-font: minor-latin; mso-bidi-theme-font: minor-latin; mso-fareast-language: EN-US; mso-ansi-language: EN-GB; mso-bidi-language: AR-SA;\">\u00a0<\/span>Interviews with students lead me to think that they regard the following as particularly\u00a0important:<\/p>\n<ul>\n<li>Fairness (though some are happy to trust us)<\/li>\n<li>Accessibility<\/li>\n<li>Technical reliability (though some see that as our problem)<\/li>\n<li>Clear instructions and questions<\/li>\n<li>Variety of test items<\/li>\n<li>Usefulness for learning<\/li>\n<\/ul>\n<p>We had interesting conversations about the tension between the need for reliability and the need for authenticity. We also discussed the importance of writing clear and unambiguous questions.<\/p>\n<p>Thank you to the person who reminded me that we should not be adding together marks from questions that assess different things (different &#8216;domains&#8217;) . This is absolutely true of course (and I was missing a point) but the challenge\u00a0of carrying this through into practice is, I suspect, one that few of us entrely meet.<\/p>\n<p>More generally, I am led to conclude that not only do we not know what we mean by &#8216;quality&#8217; in e-assessment, we don&#8217;t know what we mean by &#8216;quality&#8217; in assessment more generally. Lots more to think about here.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This was the topic of my roundtable at the Earli\/Northumbria Assessment Conference and I am very grateful to the 10 people who attended one of the two wonderful discussions we had on the topic. The obvious answer is that, no, &hellip; <a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=166\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41],"tags":[50,344,42,352],"class_list":["post-166","post","type-post","status-publish","format-standard","hentry","category-quality","tag-domain","tag-e-assessment","tag-earlinorthumbria","tag-quality"],"_links":{"self":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/166","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=166"}],"version-history":[{"count":6,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/166\/revisions"}],"predecessor-version":[{"id":168,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/166\/revisions\/168"}],"wp:attachment":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=166"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=166"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=166"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}