{"id":1101,"date":"2012-12-21T17:46:24","date_gmt":"2012-12-21T17:46:24","guid":{"rendered":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=1101"},"modified":"2012-12-21T17:46:24","modified_gmt":"2012-12-21T17:46:24","slug":"think-before-you-assess","status":"publish","type":"post","link":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=1101","title":{"rendered":"Think before you assess"},"content":{"rendered":"<p><a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2012\/12\/the-thinker.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-medium wp-image-1103\" title=\"the-thinker\" src=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2012\/12\/the-thinker-201x300.jpg\" alt=\"\" width=\"201\" height=\"300\" srcset=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2012\/12\/the-thinker-201x300.jpg 201w, https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2012\/12\/the-thinker-686x1024.jpg 686w\" sizes=\"auto, (max-width: 201px) 100vw, 201px\" \/><\/a>As well as the reading\u00a0that has sparked my recent posts on <a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=1088\">Learning Outcomes <\/a>and <a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=1093\">Revolution or Evolution?<\/a>, I&#8217;ve been reading articles about multiple-choice questions and about assessing practical work. I&#8217;m fairly sure that\u00a0I&#8217;ll be saying more about\u00a0both of those topics during 2013,\u00a0if not\u00a0sooner.\u00a0But there&#8217;s a common theme. Honest, there is.<\/p>\n<p>When you want to assess practical work, it can be very easy to assess the underlying subject knowledge rather than the practical skills, and there are decisions to be taken about whether you want to assess practical experimental skills or report writing skills or both. If you chose to use multiple-choice assessment questions, irrespective of whether you like\u00a0MCQs or loathe them <em>per se<\/em>, again it is sensible to stop and think about what you are actually assessing. An interesting paper\u00a0that I read today:<\/p>\n<p>Martinez, M.E. (1999) Cognition and the question of test item format. <em>Educational Psychologist<\/em>, 34(4), 207-218.<\/p>\n<p>points out that &#8216;data bearing on the hypothesis of equivalence between\u00a0constructed response\u00a0and multiple-choice questions have been equivocal.\u2019 Some people think the two types of questions can be equivalent, others disagree.\u00a0For simple items, where a constructed response question is assessing recall, a multiple-choice question is assessing\u00a0recognition. So although there may be correlation between scores obtained on tests comprising multiple-choice questions and tests comprising constructed response questions, the two tests are unlikely to be actually assessing the same thing.<\/p>\n<p>My common theme is that you need to think carefully about WHAT you want to assess, and check that you are actually assessing this in the tasks that you produce for your students. And I think the easiest way to do this is to think in terms of learning outcomes. What is it that you hope your students have learnt: recall or recognition?; practical skills, report-writing skills or knowledge?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As well as the reading\u00a0that has sparked my recent posts on Learning Outcomes and Revolution or Evolution?, I&#8217;ve been reading articles about multiple-choice questions and about assessing practical work. I&#8217;m fairly sure that\u00a0I&#8217;ll be saying more about\u00a0both of those topics &hellip; <a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=1101\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[254,77,230],"tags":[417,356,406],"class_list":["post-1101","post","type-post","status-publish","format-standard","hentry","category-learning-outcomes","category-multiple-choice-questions","category-practical-work","tag-learning-outcomes","tag-multiple-choice-questions","tag-practical-work"],"_links":{"self":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/1101","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1101"}],"version-history":[{"count":3,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/1101\/revisions"}],"predecessor-version":[{"id":1105,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/1101\/revisions\/1105"}],"wp:attachment":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1101"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1101"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1101"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}