{"id":637,"date":"2011-08-03T14:54:24","date_gmt":"2011-08-03T14:54:24","guid":{"rendered":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=637"},"modified":"2011-08-14T19:15:41","modified_gmt":"2011-08-14T19:15:41","slug":"its-just-not-cricket","status":"publish","type":"post","link":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=637","title":{"rendered":"It&#8217;s just not cricket"},"content":{"rendered":"<p>First of all, for the benefit of those who are not native speakers of English, I ought to explain the meaning of the phrase &#8216;It&#8217;s just not cricket&#8217;. The game of cricket carries connotations of being something that is played by &#8216;gentlemen&#8217; (probably\u00a0on a\u00a0village green)\u00a0who wouldn&#8217;t dream of cheating &#8211; so if something\u00a0 is unfair, biased or involves cheating it is &#8216;just not cricket&#8217;. This post is about bias and unfairness in assessment.<\/p>\n<p><a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2011\/08\/1464437_e7c738ae1.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-medium wp-image-639\" title=\"1464437_e7c738ae\" src=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2011\/08\/1464437_e7c738ae1-300x196.jpg\" alt=\"\" width=\"300\" height=\"196\" srcset=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2011\/08\/1464437_e7c738ae1-300x196.jpg 300w, https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/wp-content\/uploads\/2011\/08\/1464437_e7c738ae1.jpg 640w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>\u00a0\u00a9 Copyright <a title=\"View profile\" href=\"http:\/\/www.geograph.org.uk\/profile\/4942\">Martin Addison<\/a> and licensed for reuse under this <a rel=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-sa\/2.0\/\">Creative Commons Licence<\/a><\/p>\n<p>It is reasonable that we do all we reasonably can to remove unfair bias (e.g. by not using idiomatic language like &#8216;it&#8217;s just not cricket&#8217;&#8230;) but how far down this road it is appropriate to go is a matter of some debate. Some of my colleagues love to make their tutor-marked assignment questions interesting and, by coincidence,\u00a0some of them are rather fond of cricket&#8230;so we end up with all sorts of energy considerations relating to cricket balls and wickets. Is that fair? Are students who don&#8217;t know about cricket disadvantaged? Or perhaps\u00a0it is the students who know lots about cricket who are disadvantaged &#8211;\u00a0\u00a0they \u00a0may try to interpret the question too deeply. In situations like this, I insist on including an explanation of the terms used, but I sometimes wonder if we&#8217;d be better not trying to make\u00a0assessment &#8216;interesting&#8217; in this way. The sport gets in the way of the physics.<!--more--><\/p>\n<p>There is also a small but marked effect as a result of students feeling &#8216;excluded&#8217; by something they don&#8217;t understand. The question may not really require any understanding of cricket (or whatever) but if you feel that you are being asked about something you don&#8217;t understand that you may panic. This happened to me in my O level physics exam (about a million years ago) which (to the eyes of an underconfident 15-year old <strong>girl<\/strong>) was all about car engines.<\/p>\n<p>Some people go to extreme lengths to compensate for bias e.g. by ensuring that the percentage of girls and boys or of each ethnic group who pass an exam or test should be equal. I don&#8217;t think that&#8217;s fair at all &#8211; different people are good at different things. If we carry this approach to its logical conclusion then we would say that everyone ought to pass all exams &#8211; otherwise we are disadvantaging those who can&#8217;t do maths (or whatever the exam is assessing).<\/p>\n<p><strong>However<\/strong>, it is right that we do everything we can to remove unfair bias. Courtesy of Donlan (1982) here is an example of a question that, presumably, was intended to measure American students&#8217; logical reasoning ability but instead measured knowledge of &#8216;upper-class recreational activity:<\/p>\n<p><strong>runner<\/strong> is to <strong>marathon<\/strong> as<\/p>\n<p>(a) <strong>envoy<\/strong> is to <strong>embassy<\/strong><\/p>\n<p>(b) <strong>martyr<\/strong> is to <strong>massacre<\/strong><\/p>\n<p>(c) <strong>oarsman<\/strong> is to<strong> regatta<\/strong><\/p>\n<p>(d) <strong>referee <\/strong>is to <strong>tournament<\/strong><\/p>\n<p>(e)<strong> horse<\/strong> is to <strong>stable<\/strong><\/p>\n<p>Apparently 53% of white pupils but only 22% of black students gave the desired answer (c).<\/p>\n<p>Donlon, T.F. (1982) The SAT in a diverse society: fairness and sensitivity. <em>College Board News<\/em>, 122, 12-16.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>First of all, for the benefit of those who are not native speakers of English, I ought to explain the meaning of the phrase &#8216;It&#8217;s just not cricket&#8217;. The game of cricket carries connotations of being something that is played &hellip; <a href=\"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/?p=637\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[145,146],"tags":[378,147,379],"class_list":["post-637","post","type-post","status-publish","format-standard","hentry","category-bias","category-fairness","tag-bias","tag-cricket","tag-fairness"],"_links":{"self":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/637","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=637"}],"version-history":[{"count":5,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/637\/revisions"}],"predecessor-version":[{"id":664,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=\/wp\/v2\/posts\/637\/revisions\/664"}],"wp:attachment":[{"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=637"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=637"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/SallyJordan\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=637"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}