{"id":1659,"date":"2023-07-14T12:18:28","date_gmt":"2023-07-14T11:18:28","guid":{"rendered":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/?p=1659"},"modified":"2023-07-14T12:18:28","modified_gmt":"2023-07-14T11:18:28","slug":"beyond-the-real-world-exploring-authentic-assessment-design","status":"publish","type":"post","link":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/?p=1659","title":{"rendered":"Beyond the \u201creal world\u201d: exploring authentic assessment design"},"content":{"rendered":"<p><em>Mary Simper ~ Learning Designer<\/em><\/p>\n<p>The Learning Design team at the OU has been exploring assessment practices, which has led to some rich discussions on accessibility, student choice, learning outcomes and authenticity. Discussions around authentic assessment have led us to think about how we can design assessments, well\u2026 more authentically!<\/p>\n<h3>Let\u2019s start with an analogy&#8230;<\/h3>\n<p>Imagine being given a recipe for the best brownie in the world. Wouldn&#8217;t you want to bake and taste the brownies? This is called a <em>taste test<\/em> and it gives bakers the opportunity to experiment before selling products.<\/p>\n<p>Similarly, authentic assessment provides students with a taste test where they mix, measure, and stir ingredients, applying methods to create a final product. A key stage is reviewing how well the process worked and this is akin to reflection, a major component of authentic assessment.<\/p>\n<p>Now that we\u2019re all hungry for brownies, here\u2019s a more concrete definition:<!--more--><\/p>\n<blockquote><p><strong>Authentic Assessment Definition:<\/strong><\/p>\n<p>Authentic assessment places the learner in a context relevant to their studies, goals, and ambitions. It provides them with the opportunity to apply what they\u2019ve learned in this context, and to relate knowledge to both their personal lives and wider society. Reflection is a key component.<\/p><\/blockquote>\n<h3>The issue with the term \u2018authentic\u2019<\/h3>\n<p>Authentic assessment is often interpreted as placing students in the \u2018real-world\u2019, which is mostly professionally orientated. We want to avoid this term because it draws a line between the \u2018student world\u2019 and the \u2018real world\u2019 which is unhelpful as it suggests that students won\u2019t occupy the \u2018real world\u2019 until they have finished their studies (which we know is not true).<\/p>\n<p>Recent literature suggests that it\u2019s \u201cnot simply about the task, but the relationship the person\/student has to the task&#8221; (McArthur, 2023). To be truly authentic, then, assessments should provide opportunities for students to understand society, to relate tasks to their identity, sense of self, values, and beliefs and to understand why and how their efforts can have an impact.<\/p>\n<h3>How do we design an Authentic Assessment?<\/h3>\n<p>We identified five key stages. Some, such as learning outcomes, could be applied to all assessment designs, but others, such as the context and task stage, help us to understand truly authentic assessment design.<\/p>\n<figure id=\"attachment_1657\" aria-describedby=\"caption-attachment-1657\" style=\"width: 519px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/www.open.ac.uk\/blogs\/learning-design\/wp-content\/uploads\/2023\/07\/authentic_assmt_graphic.png\" target=\"_blank\" rel=\"noopener\" ><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-1657 \" src=\"https:\/\/www.open.ac.uk\/blogs\/learning-design\/wp-content\/uploads\/2023\/07\/authentic_assmt_graphic.png\" alt=\"'Designing Authentic Assessment' Graphic showing the five stages: 1 Identify learning outcomes. Graphic of people writing on a checklist. Identify the learning outcomes and highlight the verbs used to inform what students will do. 2 Identify relevant contexts. Graphic of people talking around a calendar. Contexts should be relevant to all students and can be categorised under work, societal issues and principles, and personal contexts and relationships. 3 Map contexts to tasks. Graphic of woman walking in front of a map. Map potential tasks to each context, ensuring that tasks relate to the learning outcomes while taking all three contextual categories into account. 4 Manage the workload. Graphic of man on the phone in front of a clock. Remember that students will be carrying out the task. Ensure students are given realistic and workable timeframes to work in. 5 Provide evidence of achievement. Graphic of a person at a desk. Consider how to evaluate student achievement. What key concepts should feature? How will reflective responses be marked?\" width=\"519\" height=\"332\" srcset=\"https:\/\/www.open.ac.uk\/blogs\/learning-design\/wp-content\/uploads\/2023\/07\/authentic_assmt_graphic.png 1200w, https:\/\/www.open.ac.uk\/blogs\/learning-design\/wp-content\/uploads\/2023\/07\/authentic_assmt_graphic-300x192.png 300w, https:\/\/www.open.ac.uk\/blogs\/learning-design\/wp-content\/uploads\/2023\/07\/authentic_assmt_graphic-1024x655.png 1024w, https:\/\/www.open.ac.uk\/blogs\/learning-design\/wp-content\/uploads\/2023\/07\/authentic_assmt_graphic-768x492.png 768w\" sizes=\"auto, (max-width: 519px) 100vw, 519px\" \/><\/a><figcaption id=\"caption-attachment-1657\" class=\"wp-caption-text\">5 steps to designing authentic assessment (click image to expand \u2013 opens in new tab)<\/figcaption><\/figure>\n<h5>Stage 1: Learning outcomes<\/h5>\n<p>Most assessment designs begin with the learning outcomes (LOs).<\/p>\n<p>Here is an example LO for a Creative Writing course: \u201c[\u2026] To <em>communicate <\/em>objective evaluations of others\u2019 work through constructive criticism\u201d.<\/p>\n<p>The verb &#8216;to communicate&#8217; reveals exactly what we want students to do. This is a good starting point for assessment design. To find out more about LOs, check out Sarah Fulmer&#8217;s <a href=\"https:\/\/images.squarespace-cdn.com\/content\/v1\/56acc1138a65e2a286012c54\/1507117156304-845LX7TLWQ56WXJULR7I\/Learning+Outcomes+Checklist.jpg?format=750w\" >checklist for creating effective learning outcomes<\/a> (2017).<\/p>\n<h5>Stage 2: Relevant contexts<\/h5>\n<p>After identifying what students will be doing, we can begin to explore contexts. As mentioned, there\u2019s often an overemphasis on professional contexts in authentic assessment. To avoid this, we\u2019ve broken it down into three categories (work contexts, societal issues\/principles, and personal\/relational contexts). For example, a creative writing course might include the following ideas:<\/p>\n<p>&nbsp;<\/p>\n<table style=\"height: 466px;\" width=\"579\">\n<tbody>\n<tr>\n<td colspan=\"3\" width=\"624\"><strong>LO: \u201cCommunicate objective evaluations of others\u2019 work through constructive criticism\u201d<\/strong><\/td>\n<\/tr>\n<tr>\n<td width=\"208\"><strong>Work contexts<\/strong><\/td>\n<td width=\"208\"><strong>Societal issues\/principles<\/strong><\/td>\n<td width=\"208\"><strong>Personal contexts and relationships<\/strong><\/td>\n<\/tr>\n<tr>\n<td width=\"208\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Traditional editorial work (newspapers, magazines)<\/li>\n<li>Working in film and media<\/li>\n<li>Advertising<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/td>\n<td width=\"208\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Contributing to a just society relying on peer review<\/li>\n<li>Objectivity reflects society\u2019s emphasis on scientific approaches<\/li>\n<li>Balanced communication strengthens international relations<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<td width=\"208\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Communicating with friends and family<\/li>\n<li>Being able to express disagreement appropriately<\/li>\n<li>Being able to communicate values and beliefs<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>In practice, we\u2019d expect this list to be longer, but by mapping a LO to students\u2019 future professional contexts, wider societal issues\/principles, and personal relationships, we can explore authenticity beyond the work-related view.<\/p>\n<h5>Stage 3: Identifying relevant tasks<\/h5>\n<p>Now we need to explore each category and formulate tasks, for example:<\/p>\n<p>&nbsp;<\/p>\n<table width=\"624\">\n<tbody>\n<tr>\n<td width=\"112\"><strong>Scene setting:<\/strong><\/td>\n<td colspan=\"3\" width=\"512\">You\u2019re working with a media team for X company, and your team is developing a new radio drama series based on X.<\/td>\n<\/tr>\n<tr>\n<td width=\"112\"><strong>Assessment Part<\/strong><\/td>\n<td width=\"78\"><strong>Category<\/strong><\/td>\n<td width=\"117\"><strong>Context<\/strong><\/td>\n<td width=\"317\"><strong>Task<\/strong><\/td>\n<\/tr>\n<tr>\n<td width=\"112\"><strong>Part 1<\/strong><\/td>\n<td width=\"78\">Work<\/p>\n<p>&nbsp;<\/td>\n<td width=\"117\">Working in film and media<\/p>\n<p>&nbsp;<\/td>\n<td width=\"317\">A colleague approaches you with the first draft script for the pilot episode and asks for your feedback. Read the script and write an objective evaluation to provide feedback.<\/td>\n<\/tr>\n<tr>\n<td width=\"112\"><strong>Part 2<\/strong><\/td>\n<td width=\"78\">Societal<\/td>\n<td width=\"117\">Strengthening relationships<\/td>\n<td width=\"317\">You are asked to produce a set of guidelines for providing constructive feedback. Reflect on how they might impact relationships within the team. Can you think of any other contexts where constructive communication guidelines are critical?<\/td>\n<\/tr>\n<tr>\n<td width=\"112\"><strong>Part 3<\/strong><\/td>\n<td width=\"78\">Personal<\/td>\n<td width=\"117\">Communicating with friends and family<\/p>\n<p>&nbsp;<\/td>\n<td width=\"317\">Reflect on your evaluation and subsequent guidelines.<\/p>\n<p>How might you apply these guidelines in your personal life, for example, when communicating with friends and family?<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>In this example we\u2019ve included a relevant working context, tied it to wider societal principles (the ability to strengthen relationships), and related it to students&#8217; personal lives. In practice, the process would be more complex. There may be multiple LOs, inclusivity issues or workload concerns, but as an initial framework, these categories help us to consider authentic assessment beyond the \u2018real-world\u2019 definition.<\/p>\n<h5>Other things to consider&#8230;<\/h5>\n<p>There are some other things to consider, including:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li><strong>Building a problem or scenario: <\/strong>in practice we would expand on the above example, perhaps with a problem for students to solve.<\/li>\n<li><strong>Task instructions: <\/strong>clear, concise, and workable instructions should accompany the task.<\/li>\n<li><strong>Collaboration: <\/strong>consider asking students to collaborate, particularly where communication is the focus of the LO.<\/li>\n<li><strong>Pilot test:<\/strong> as designers, we too should taste test our work (though ours might not always taste as good as a brownie!) and try it out with a small group of students to gain feedback.<\/li>\n<li><strong>Key questions to ask:<\/strong>\n<ul>\n<li>Will all students identify with or have knowledge of this context?<\/li>\n<li>Does this context disadvantage any students?<\/li>\n<li>Does this fit with students\u2019 goals and ambitions?<\/li>\n<li>Have students been scaffolded for this context?<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h5>Stage 4: Managing the workload<\/h5>\n<p>Authentic assessments can quickly spiral into large tasks. It\u2019s always worth revisiting an assessment design with workload in mind.<\/p>\n<h5>Stage 5: Evidence of achievement<\/h5>\n<p>Authentic assessment can be more nuanced than traditional assessment because it relies on reflection. This needs careful consideration when planning the marking. Consider the key concepts, such as how well a student has applied knowledge from a task to their personal lives.<\/p>\n<h3>Rounding it all up<\/h3>\n<p>Designing authentic assessment isn\u2019t about creating a \u2018real-world\u2019 context for students to work in. It\u2019s about giving them room to taste test the skills they\u2019ve acquired in professional, societal, and personal contexts. Designing an authentic assessment is not simple, but our exploration has revealed principles that underpin truly authentic assessments, and we\u2019re looking forward to building on this approach in the future. We hope you\u2019ll have fun experimenting with these ideas.<\/p>\n<hr \/>\n<h3>References:<\/h3>\n<p>Fulmer, S. (2017) GUEST POST: Should I share my learning outcomes with students? T<em>HE LEARNING SCIENTISTS<\/em> (online) available at <a href=\"https:\/\/www.learningscientists.org\/blog\/2017\/10\/4-1\" >https:\/\/www.learningscientists.org\/blog\/2017\/10\/4-1<\/a> (accessed 10<sup>th<\/sup> May 2023)<\/p>\n<p>McArthur, J. (2023) Rethinking authentic assessment: work, well-being, and society, <em>Higher Education<\/em>, SpringerLink (online) available at <a href=\"https:\/\/link.springer.com\/article\/10.1007\/s10734-022-00822-y\" >https:\/\/link.springer.com\/article\/10.1007\/s10734-022-00822-y<\/a> (accessed 6<sup>th<\/sup> May 2023)<\/p>\n<hr \/>\n<h5>Resources:<\/h5>\n<p>Brown, S. (2023) Working towards more authentic assessment: a pragmatic approach to choosing alternatives that are right for you, Sally Brown (online) available at <a href=\"https:\/\/sally-brown.net\/?s=portfolio&amp;submit=Search\" >https:\/\/sally-brown.net\/?s=portfolio&amp;submit=Search<\/a><\/p>\n<p>Heriot Watt University (ND) A STEP-BY-STEP GUIDE TO DESIGNING MORE AUTHENTIC ASSESSMENTS (online) available at <a href=\"https:\/\/lta.hw.ac.uk\/wp-content\/uploads\/GUIDE-NO31_A-step-by-step-guide-to-designing-more-authentic-assessments.pdf\" >https:\/\/lta.hw.ac.uk\/wp-content\/uploads\/GUIDE-NO31_A-step-by-step-guide-to-designing-more-authentic-assessments.pdf<\/a><\/p>\n<hr \/>\n<p>Banner image: via Canva<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Mary Simper ~ Learning Designer The Learning Design team at the OU has been exploring assessment practices, which has led to some rich discussions on accessibility, student choice, learning outcomes and authenticity. Discussions around authentic assessment have led us to think about how we can design assessments, well\u2026 more authentically! Let\u2019s start with an analogy&#8230; [&hellip;]<\/p>\n","protected":false},"author":34,"featured_media":1658,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[74,55,73,1,147,6],"tags":[79,186,187,190,77,40,188,189,52,30],"class_list":["post-1659","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-accessibility","category-assessment","category-edi","category-learning-design","category-student-success","category-student-centred-learning","tag-accessibility","tag-assessment-practices","tag-authentic-assessment","tag-design-principles","tag-edi","tag-learning-design","tag-learning-outcomes","tag-real-world","tag-skills","tag-students"],"_links":{"self":[{"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/posts\/1659","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/users\/34"}],"replies":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1659"}],"version-history":[{"count":21,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/posts\/1659\/revisions"}],"predecessor-version":[{"id":1682,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/posts\/1659\/revisions\/1682"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/media\/1658"}],"wp:attachment":[{"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1659"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1659"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1659"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}