{"id":550,"date":"2011-07-10T17:30:03","date_gmt":"2011-07-10T17:30:03","guid":{"rendered":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=550"},"modified":"2011-07-31T11:08:27","modified_gmt":"2011-07-31T11:08:27","slug":"are-you-sure","status":"publish","type":"post","link":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=550","title":{"rendered":"Are you sure?"},"content":{"rendered":"<p>For various reasons I&#8217;ve been thinking a lot recently about confidence-based marking.\u00a0 (Tony Gardner-Medwin, who does most of the work in this area also calls it &#8216;certainty-based marking&#8217;). The principle is that you get most marks for a correct response that you are sure is right, fewer for a correct response that you are not sure about. But at the opposite end of the scale, you tend to get a penalty for an incorrect response that you were sure was right.<!--more--><\/p>\n<p>Confidence-based marking is one way of dealing with the &#8216;guessing effect&#8217; for multiple-choice questions, but it can also be used to make students engage at a deeper level with questions. Jon Rosewell has an interesting <a href=\"http:\/\/www.open.ac.uk\/about\/teaching-and-learning\/esteem\/pop131979.shtml\">eSETeM project <\/a>in this area (getting students to rate their confidence<em> before<\/em> seeing the distractors)\u00a0and Silvester Draaijer has recently\u00a0<a href=\"http:\/\/draaijeronassessmentandtesting.wordpress.com\/2011\/06\/27\/certainty-based-marking-cq-multiple-evaluation-testing-cq-confidence-measurement-testing\/\">blogged<\/a> on the subject.<\/p>\n<p>I&#8217;m not comfortable with the use of negative marking and, probably for this reason, I&#8217;ve never been very keen on the idea of confidence-based marking. However I can see that \u00a0if you are\u00a0using\u00a0this approach\u00a0to encourage deeper learning then\u00a0there\u00a0might be some mileage it in. \u00a0One of the criticisms of confidence-based marking\u00a0comes from the theory\u00a0that girls tend to be less confident than boys, so are disadvantaged. But of course, when properly used, you aren&#8217;t necessarily penalised for lack of confidence, rather for lack of an appropriate level of confidence &#8211; and Tony Gardner-Medwin has shown that female medical students are not disadvantaged by the approach.<\/p>\n<p>Several people, including Tony (who works at\u00a0a Medical School) make the point that doctors need to have confidence in what they are doing. When I heard him speak, several years ago now, that made me very upset because I had recently recovered from a serious illness which my GP incorrectly diagnosed as a mental breakdown. He was sure he was right and his confidence caused a delay in reaching the correct conclusion (as well as knocking my confidence further; in addition to\u00a0feeling ill I had to deal with the thought that I was cracking up!). However, on reflection, I can see Tony&#8217;s point. I want doctors to have confidence when they are right &#8211; but to have the decency to admit that they aren&#8217;t sure when the situation is less clear-cut.<\/p>\n<p>Having blogged about one thing that&#8217;s rather more personal than my usual fare, I will now tell you something that I hadn&#8217;t told anyone until I was in the middle of a discussion of confidence-based marking&#8217;s pros and cons\u00a0a couple of weeks ago. When I heard Tony Gardner-Medwin speak, he used some &#8216;every day&#8217; examples to illustrate his approach. One of these asked a question about the speed limit on dual carriageways in the UK. I ticked the &#8217;70 miles per hour&#8217; box and indicated that I had high confidence in my answer. I was devasted when Tony said that the correct answer was &#8216;of course&#8217; &#8217;60 m.p.h&#8217; &#8211; apparently I was wrong. For the next few months I crawled around the country &#8211; it took me some time to even have the confidence to check the highway code. And of course I wasn&#8217;t wrong! So, if you use questions of this type, make jolly sure that <strong>you<\/strong> are right.<\/p>\n<p>That would have been the end of this little anecdote were it not for a wonderful\u00a0insightful comment from someone else in the meeting when I was telling my story. Her comment was [the speed limit] &#8216;depends what vehicle you&#8217;re driving&#8217;. Oh yes! Life just isn&#8217;t as black and white as the world of multiple-choice questions would have us believe:<\/p>\n<p><a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2011\/07\/Capture-2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-554\" title=\"Capture 2\" src=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2011\/07\/Capture-2.png\" alt=\"\" width=\"785\" height=\"393\" srcset=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2011\/07\/Capture-2.png 785w, https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2011\/07\/Capture-2-300x150.png 300w\" sizes=\"auto, (max-width: 785px) 100vw, 785px\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>For various reasons I&#8217;ve been thinking a lot recently about confidence-based marking.\u00a0 (Tony Gardner-Medwin, who does most of the work in this area also calls it &#8216;certainty-based marking&#8217;). The principle is that you get most marks for a correct response &hellip; <a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=550\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[78],"tags":[357,132],"class_list":["post-550","post","type-post","status-publish","format-standard","hentry","category-confidence-based-marking","tag-confidence-based-marking","tag-tony"],"_links":{"self":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/550","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=550"}],"version-history":[{"count":6,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/550\/revisions"}],"predecessor-version":[{"id":593,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/550\/revisions\/593"}],"wp:attachment":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=550"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=550"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=550"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}