STELLAR final report

We’ve now published the Jisc Final report for the STELLAR project on this blog.  The report, all 80 pages of it, is now listed the Reports and Dissemination page as well as available from STELLAR Jisc Final Report.

The report can also be found in Jorum http://hdl.handle.net/10949/18379

Posted in Updates | Tagged , , , , | Leave a comment

STELLAR project finishes

Today is the last day of the eighteen month STELLAR project, we’ve had our last Steering Group meeting, been to a Jisc programme meeting during July and produced a fairly hefty final report which is with Jisc and we plan to publish shortly through this blog and elsewhere.

It’s been a really interesting project for the Project team and we’ve learnt an enormous amount about what it takes to establish a linked data environment for a digital library of learning materials.  Many of our experiences are documented on this blog, in the documents in the Reports and dissemination section and will be in the final report.

Important lessons learnt for us are particularly around the very significant effort needed around metadata, particularly in an environment like ours where there are several different content types that need to be handled.  We’ve also found areas where applying linked data tools within the digital library are going to start to pay dividends for us in our future development plans for that system.  Being able to easily (and automatically) link to related material openly available in iTunesU is really useful.

I’d like to say thanks to the project team who have been working on STELLAR: particularly Liz Mallett and Sarah Brown who took on the Project Management, to James Alexander who led the technical development, to Lara Whitelaw and Alex Addyman for their metadata expertise, to Ruth Cammies and colleagues in the OU Archive and cataloguing teams, to Tom Welch for his work on the surveying and to Mathieu d’Aquin from KMi for his work on Stellar and particularly the adaptation of DiscOU.  Thanks also to colleagues on our Steering Group chaired by Gill Needham and others who have helped from across the library, and also to colleagues in the University who helped with the surveying, took part in focus groups or completed the surveys.  Last but not least thanks to Jisc and their programme manager Neil Grindley for their support in funding this project.

We’ve a few plans underway to disseminate what we’ve learnt and to take forward the recommendations that the project has made and we’ll be crystallising those over the next few months.

Posted in Updates | Leave a comment

STELLAR search tool screencast

STELLAR smenatic web proof of concept screenshotThe STELLAR search tool is only available to OU staff as the content that it is searching is not completely rights-cleared for public access.  So the project has put together a very short (around 1 minute) screencast of the STELLAR search tool in use so you can see how it works in practice.  You can download the Mp4 version of the video from the link below.  Filesize 1.6mb.

STELLAR DiscOU screencast

The screencast shows a sample search in the DiscOU Stellar tool, showing how the results appear and then goes through the options that the tool gives to refine your search through a series of concept filters.  The screencast goes on to show how the content from the OU Digital Library is shown and accessed through DiscOU.

Posted in Enhancement, Linked Data | Tagged | Leave a comment

STELLAR May update

We’re now well into our Post-enhancement and evaluation stage as the project starts to draw to a close and this post will provide an update on the work over the last few weeks.

The STELLAR proof-of-concept tool
The project has created a semantic web tool to search the linked data representations of the digital library.   The tool has been created by Dr Mathieu d’Aquin from the Knowledge Media Institute and builds on previous work including the linked data materials created for the Jisc-funded LucSTELLAR smenatic web proof of concept screenshotero project that established data.open.ac.uk, and a tool called DiscOU.

Essentially the tool (shown above) allows you to paste in (or type in) either a whole section of text or just a few search terms into a search box.  Ideally you would put in a rich piece of text rather than just a few simple search terms.   The text is then passed through a semantic meaning engine and concepts are matched against the concepts contained within the digital library dataset.  A selection of the closest matches are then displayed, along with a thumbnail image of the item.  These link through to the object in the Fedora digital library.

The tool lets the user revise their query by using a set of ‘sliders’ on the left of the screen to choose which concepts most closely match what they want.  STELLAR concept featureSo it’s possible to decide that you don’t want to see so much material that talks about ‘Ice’ or ‘Snow’ for example, but you do want to see more material on ‘Atmosphere’.  Changing the sliders and clicking on Discover gives you a new selection of material to choose from.

The difference with a semantic web tool is that you aren’t just matching a string of text, but are analysing the meaning of those words and finding related material.  So you could put in a search for a particular thing, say Mt St Helens, and the semantic search system will recognise that material about other volcanoes might also be relevant.

As well as retrieving material from the digital library the tool can also show related material from other datasets in data.open.ac.uk, currently this includes material from OpenLearn.

STELLAR item displayEach item from the digital library is shown in a separate block, with the title of the item, a description of what it is and which course it comes from, alongside a thumbnail of the item itself.  For the proof-of-concept we just picked a selection of material from three OU modules (S100, D251 and L550) to include in the system to show how the system works, but items are indexed at a page level so you can get directly to the appropriate page.  Clicking on the title or thumbnail takes you directly to that item in the digital library and opens that up in a separate tab. Clicking on the course code takes you to a data.open.ac.uk page showing the extensive metadata about that course or element of the course (e.g. http://data.open.ac.uk/page/book/0851413080).  Finally the tool allows you to deselect items if they aren’t relevant to you.

Post-enhancement and evaluation stage
Current activity is mainly focusing on a series of evaluation activities such as focus groups to talk to stakeholders who were originally involved in the pre-enhancement stage.  From that survey we had a pool of some 170 people who were happy to be contacted again about STELLAR and we’ve drawn on that group for a series of workshops.  The workshops give them a chance to use the tool and comment on how they find it, how they might use it and what’s its value would be.  This will be followed up with some surveying.

Next steps
As we reach the last stage of the project we’ve also been starting to work on the final report and putting together our thoughts about the sustainability of semantic web technology in our digital library.

Posted in Enhancement, Evaluation, Linked Data, Post Enhancement Survey, Updates | Tagged , , | 1 Comment

Taking stock…

Throughout 2012 STELLAR has prepared the groundwork for the development work we are now undertaking. The pre-enhancement survey was conducted and the findings from this identified the value placed on legacy learning materials as well as informing the selection of the modules we have chosen to enhance. As we come the end of 2012 that enhancement is now under way. Currently the learning materials for the selected modules are being prepared for transformation into linked data and work is taking place to identify appropriate tools and ontologies.

Looking ahead, the new year promises to be a busy time for STELLAR. Early in 2013, a proof of concept tool will be developed which will highlight the enhancements made using linked data and allow us to demonstrate the improvements to stakeholders. We are in discussions with the OU’s Knowledge Media Institute (KMi) regarding work that they have previously done on a tool called DiscOU. This is currently being used as a browser plug-in which works with BBC programme pages.  It semantically analyses the content of the page and on that basis retrieves relevant pieces of OU content.  STELLAR will be working to adapt the semantic engine of DiscOU to build a similar ‘discovery’ tool for the learning materials, enabling university staff responsible for writing or amending module materials to locate old content they can refer to or reuse.

Posted in Uncategorized | Tagged , , , , , , , | Leave a comment

Stellar Pre-enhancement survey report

Stellar balanced scorecard imageSurvey finds the value of old learning materials

The pre-enhancement survey report for Stellar is now available [STELLAR-Project-Pre-enhancement-survey-report].  Although we have known for some while that there is value in old learning  materials as it may be able to be reused in new courses, this is the first time that a comprehensive piece of work has taken place to identify different aspects of value.

Using a balanced scorecard approach as recommended by the espida project[1] Stellar assessed four perspectives of value

  • Personal and professional perspectives,
  • Value to the HE and academic communities,
  • Value to internal processes and cultures and
  • Financial and bottom line perspectives of value.

Headline results from the online survey (completed by over 500 respondents) revealed remarkable uniformity of opinion in terms of the value of the materials across all four dimensions; across all departments and faculties; across all respondents’ primary roles within the OU community (academic, academic related, associate lecturer and secretarial and clerical); across the length of time staff had worked at the OU; and across those who were, and were not, involved in module production.

  • 89.2% of respondents (501) agreed or strongly agreed with the statement that maintaining an archive of non-current OU learning materials is important to the reputation of the OU.
  • 75.9% of respondents thought that this should be maintained in perpetuity.
  • 90.16% of respondents (504) agreed or strongly agreed that non-current learning materials are important to the context of the history of higher education.
  • 91.75% of those respondents who were involved in module production (356) agreed or strongly agreed that when producing new OU learning material, I am likely to look to previous material, whether for inspiration or for potential reuse.

When discussing the personal and professional dimension of value, it was revealed that new academics use the archive of past materials to help bed themselves in to the culture of course production at the OU; that course production was seen as an integral part of the scholarly output of academics; that there was little agreement as to how strongly asset creators felt ownership of the material produced; and that academics and course managers, particularly, had different views of the value of the archive – the former emphasising its historical value and the latter its practical value in terms of reuse. All agreed, however, that the OU produced world respected resources and that that should not be forgotten.

Value to the higher education and academic communities had three components: firstly, that current academics were standing on the shoulders of giants and that to fail to maintain the archive was to remove the opportunity to learn from it, both pedagogically and in terms of course content; Secondly, that it has great value to future researchers and PhD students; and, thirdly, that it forms a great part of the OU’s institutional legacy.

Investigating the archives value to internal OU processes and cultures revealed a reliance on personal or departmental archives.  It also revealed four facets of current reuse practices: firstly, that core materials in each subject are seen to be relatively stable and are often published separately from materials that change frequently, thus facilitating their reuse; secondly, a perception that many courses are removed from presentation for business or curriculum reasons and so much current course material is shelved prematurely and could be reused; Thirdly, that there is re-versioning of existing material for new and emerging markets; and, finally, that material no longer in presentation is reused in ways that may enhance the reputation of the OU.

When considering the financial dimension of value, interviewees focussed on four areas.  Firstly on the cost-savings to be made through reuse – a complicated calculation, but one that could be made a great deal simpler if the archive were set up in such a way as to facilitate reuse; secondly, that much content could be, or is being, re-versioned in order to generate income; thirdly, that the archive could be promoted in such a way that it enhances the student experience and increases their perception of value for money; and finally, that the digitisation of past resources, while expensive, may have benefits to the academic community.

The report produced is clearly of wider relevance as it assesses attitudes to the value of non-current learning materials. The views in the report may be useful to a range of groups in policy formation.  Within the library the data will help to inform the digital preservation policy that is currently in development.


[1] McKinney, P., 2005. espida and Sustainable Digital Preservation. Society of Archivists: http://hdl.handle.net/1905/443

Posted in Pre-enhancement survey | Tagged , , , , , , | Leave a comment