-
Archives
- December 2019
- July 2018
- October 2017
- August 2017
- July 2017
- November 2016
- September 2016
- May 2016
- February 2016
- January 2016
- November 2015
- October 2015
- July 2015
- June 2015
- March 2015
- January 2015
- December 2014
- November 2014
- October 2014
- September 2014
- August 2014
- May 2014
- March 2014
- February 2014
- January 2014
- December 2013
- November 2013
- October 2013
- August 2013
- July 2013
- June 2013
- May 2013
- April 2013
- March 2013
- February 2013
- January 2013
- December 2012
- November 2012
- October 2012
- September 2012
- August 2012
- July 2012
- May 2012
- April 2012
- March 2012
- February 2012
- January 2012
- December 2011
- November 2011
- October 2011
- September 2011
- August 2011
- July 2011
- June 2011
- May 2011
- April 2011
- March 2011
- February 2011
- January 2011
- December 2010
- November 2010
- October 2010
- September 2010
- August 2010
- July 2010
-
Meta
Category Archives: short-answer free text questions
Answer matching for short-answer questions: simple but not that simple
In describing our use of (simple) PMatch for answer matching for short-answer free-text questions, I may have made it sound too simple. I’ll give two examples of the sorts of things you need to consider: Firstly, consider the question shown … Continue reading
Short-answer questions : how far can you go?
Finally for today, I’d like to talk about where I believe the limits currently sit in the use of short-answer free-text questions. I have written questions where the correct response requires three separate concepts. For example, I have written a … Continue reading
Short-answer questions : when humans mark more accurately than computers
Hot on the heals of my previous post, I’d like to make it clear that human markers sometimes do better than computers in marking short-answer [less than 20 word] free-text questions. I have found this to be the case in two situations … Continue reading
Short-answer questions : when computers mark more accurately than humans
Back to short-answer free-text questions. One of the startling findings of my work in this area was that computerised marking (whether provided by Intelligent Assessment Technologies’ FreeText Author or OpenMark PMatch) was consistently more accurate and reliable than human markers. At the time, … Continue reading
Helpful and unhelpful feedback : a story of sandstone
One of the general findings that is coming out of my evaluation of student responses to multi-try e-assessment questions relates to that wonderful thing that I’ll call the ‘Law of unintended consequences’. I used to think that ‘students don’t read … Continue reading
decease or decrease?
Back in 2007, we were observing students attempting our short-answer free-text e-assessment questions in a Usability Laboratory. One student repeatedly typed ‘decease’ instead of ‘decrease’ and he didn’t realise he was doing it. At the time, the answer matching was linguistically … Continue reading
Spelling mistakes in student responses to short-answer free-text e-assessment questions
I get asked a lot about how the answer-matching copes with poorly spelt responses to our short-answer free-text responses, and this is certainly something that used to worry me. Fortunately all the evidence is that our answer matching has coped remarkably well with poor … Continue reading
More on length of student answers
So what else affects the length of student responses to short-answer free-text questions?
How long is short?
I’ve been looking at student responses to our short-answer free-text questions. I’ll start by considering something simple; how long are the responses?
Counting counts but syntax sucks
The quote I’ve used as the title of this post has been attributed to the late Professor Roger Needham at the University of Cambridge. I can’t believe I’ve been blogging for two months and am only now mentioning our work with … Continue reading
Posted in short-answer free text questions
Tagged accuracy, ALT-C 2010, e-assessment, JISC, OpenMark, PHEC 2010, PMatch, Roger Needham, short-answer free text
Leave a comment