{"id":276,"date":"2018-11-27T09:44:31","date_gmt":"2018-11-27T09:44:31","guid":{"rendered":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/?p=276"},"modified":"2020-08-07T16:08:41","modified_gmt":"2020-08-07T15:08:41","slug":"obtaining-student-perspectives","status":"publish","type":"post","link":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/?p=276","title":{"rendered":"Gathering student perspectives: a case study of capturing student feedback"},"content":{"rendered":"<p>One of the key areas of growth activity over the past year or so has been to gather more student input into the design process. To this end we have a number of core approaches to gathering student perspectives during design phases:<\/p>\n<ul>\n<li>we administer the curriculum design student panel, which provides us with access to over 1500 OU students for rapid feedback<\/li>\n<li>we support and advise on developmental testing, frequently working in partnership with colleagues in LTI academic, editors and the module team<\/li>\n<li>we advise module teams on use of Real-Time Student Feedback for gathering input during presentation from students<\/li>\n<\/ul>\n<p>The examples below demonstrate how we go about deploying some of these approaches in our design work with module teams.<\/p>\n<h2><a name=\"_Toc524014574\"><\/a>Student perspectives on\u00a0aspects of module design\u00a0at postgraduate level<\/h2>\n<h4>Gill MacMillan (Senior Learning Designer)<\/h4>\n<p>In this example, we were able to use the <a href=\"https:\/\/www.open.ac.uk\/blogs\/learning-design\/?p=441\" >Curriculum Design Student Panel<\/a> to gather student feedback \u2013 during the design phase \u2013 on specific aspects of the structure of a postgraduate module:<\/p>\n<ul>\n<li><strong>Effectiveness of a weekly introductory slidecast\/video<\/strong>, in which an academic author sets the scene and outlines the key focus and discussions to be covered in that week<\/li>\n<li><strong>Usefulness of a \u2018Planning your week\u2019 overview<\/strong> table &#8211; outlining the activities in the week ahead (timings, type of activity etc.) in order to help students plan their study time<\/li>\n<li><strong>Student preference between two alternative layouts<\/strong> for the study planner<\/li>\n<\/ul>\n<p>A relevant cohort of students was identified, and while the number who then actually responded was relatively small, the feedback was very consistent and\u00a0gave a clear steer from students on all 3 aspects:<\/p>\n<ul>\n<li>The majority of students found the introductory slidecast\/video easy to use, informative and more effective than reading online text, and said they would start the week by looking at it in order to understand the aspects of the topic to be covered. (In addition, an issue was raised about the visibility of the transcript link when viewing the video on an iPad. This was fed back to the Learning Systems team who were already aware of the issue and have made improvements to the functionality).<\/li>\n<li>All the students found the \u2018Planning your week\u2019 overview useful<\/li>\n<li>The majority expressed a clear preference for the second alternative layout<\/li>\n<\/ul>\n<p>In terms of the overall findings and impact, the Module Chair was happy with the results and the process, recognised the usefulness of getting this direct student feedback, and went on to implement the findings. So there was a clear impact from the panel\u2019s input, and the Module Chair summarised this impact in a follow-up message to those students who had participated. Now that the module is live, Real-time Student Feedback is being used to get feedback from students as they study,\u00a0enabling us to\u00a0get further feedback on these, and other, aspects of the module design.<\/p>\n<h2>Testing innovative assessment<\/h2>\n<h4>Yvonne Murphy (Learning Designer)<\/h4>\n<p>This testing was carried out as part of the Developmental testing that the LTD team in LTI Academic lead on. We work in partnership with the LTD team initially, and then work to co-ordinate the input of D&amp;P colleagues in the testing. LTI Academic liaise with the module team to establish how the testing will run, recruit the students and set up the evaluation. Learning Designers then support by making sure the content is setup in an authentic manner on the VLE, and work with D&amp;P to get the materials ready and presented to an appropriate standard.<\/p>\n<p>For this particular testing relating to activities for a new WELS module (E309), a key part of our role was the qualitative analysis of student feedback.<\/p>\n<p>The development testing itself consisted of two student activities<\/p>\n<ul>\n<li>Creating a \u2018digital badge\u2019 using a PowerPoint template with embedded audio.<\/li>\n<li>Creating an Infographic comparing two datasets using a PowerPoint template with embedded audio.<\/li>\n<\/ul>\n<p>Both activities used <strong>Office365<\/strong> and required students to work <strong>collaboratively<\/strong> in pairs. There were 11 student participants who completed the E309 activities and associated questionnaire, some students gave additional feedback by phone.<\/p>\n<p>As a result of this, we had a lot of qualitative data from the student questionnaire which was analysed and captured in a\u00a0table summarising issues per participant per activity. Following the initial analysis we contacted some of the students and arranged a phone call with them to engage and explore their feedback more thoroughly.<\/p>\n<p>Some of the identified risks and opportunities were as follows:<\/p>\n<table width=\"0\">\n<tbody>\n<tr>\n<td width=\"283\"><strong>Risk &amp; Issues<\/strong><\/td>\n<td width=\"319\"><strong>Opportunity &amp; Mitigation<\/strong><\/td>\n<\/tr>\n<tr>\n<td width=\"283\">If using a personal Office365 account cannot \u2018share\u2019 with partner (using Office365 share function) if using an OU student account and vice versa (cannot share outside of organisation)<\/td>\n<td width=\"319\">Cannot use the \u2018share\u2019 function of Office 365 to collaborate. Advise to share via email\u00a0and on Module e-groups<\/td>\n<\/tr>\n<tr>\n<td width=\"283\">PowerPoint had to be installed for audio and the desktop version used (audio functionality not available online)<\/td>\n<td width=\"319\">Provide instructions to save PowerPoint to desktop rather than using the online version<\/td>\n<\/tr>\n<tr>\n<td width=\"283\">Unsure how to record audio<\/td>\n<td width=\"319\">Provide additional resource:<\/p>\n<ul>\n<li>One page visual document on recording audio<\/li>\n<li>Have a session in tutorial one around Office365 and PowerPoint<\/li>\n<li>Produce a Camtasia screencast on basic navigation<\/li>\n<\/ul>\n<p>&nbsp;<\/td>\n<\/tr>\n<tr>\n<td width=\"283\">Students lack confidence in IT and PowerPoint skills<\/td>\n<td width=\"319\">\n<ul>\n<li>Use digital badge activity as a \u2018practise\u2019 \u2018dummy\u2019 TMA to prepare students for creating a poster in TMA01<\/li>\n<li>Provide additional support and resources (as above)<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"283\">Unable to collaborate with partner due to clashes in time commitment \u2013 one partner did most\/all of the work<\/td>\n<td width=\"319\">Students to produce individual infographics for assessment but to collaborate with the preparation and research.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>The module team implemented all of the recommendations coming from the opportunities documented above (except the one page visual document as it was felt enough resource was provided with the screencast, tutorial, template and instructions).<\/p>\n","protected":false},"excerpt":{"rendered":"<p>One of the key areas of growth activity over the past year or so has been to gather more student input into the design process. To this end we have a number of core approaches to gathering student perspectives during design phases: we administer the curriculum design student panel, which provides us with access to [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":581,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[35,6],"tags":[32],"class_list":["post-276","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ld-under-the-hood","category-student-centred-learning","tag-featured"],"_links":{"self":[{"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/posts\/276","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=276"}],"version-history":[{"count":8,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/posts\/276\/revisions"}],"predecessor-version":[{"id":580,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/posts\/276\/revisions\/580"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=\/wp\/v2\/media\/581"}],"wp:attachment":[{"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=276"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=276"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.open.ac.uk\/blogs\/learning-design\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=276"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}