Standards-based Assessment (Workshop 0121)
At the time of writing, the Question and Test Interoperability specification version 2.1 (QTIv2.1) is expected to become final in the next few months. This marks a significant stage in the development of the specification, which is currently the only standard for assessment resources. In the UK, the JISC has funded a number of projects supporting QTIv2.1 over the last few years, and these have led to the development of tools for rendering and creating questions, and the accumulation of a body of expertise in creating resources using QTIv2.1 and converting resources in other formats into QTIv2.1. The flexibility of assessments specified using QTI is particularly important within HE as an increasing number of coursework assignments are being converted into electronic assessments. In order to maintain the quality of feedback, sophisticated use of the arbitrary complexity of answer conditions and associated feedback messages becomes necessary.
This workshop will begin with a brief demonstration of some assessment scenarios and question designs from a variety of disciplines. A range of tools will be demonstrated, including:
- Editors for creating and editing questions
- Editors for creating and editing tests,
- Tools for converting questions in popular formats to QTIv2.1,
- Renderers for running the questions and assessments, both stand-alone and embedded in VLEs.
A hands-on session, which will occupy the majority of the workshop, will then enable participants to try the tools for themselves. The tools and examples used in the workshop form part of a new support site designed to assist users in adopting QTIv2.1 and can be freely used and, where appropriate, downloaded from the site.
Participants will be able to explore the range of questions offered by the QTI specification, particularly the support for adaptive questions and the ability to target feedback at specific misconceptions. This is of considerable importance given the recent upsurge of interest in the provision of rich feedback to aid learning. They will also have the opportunity to experiment with the conversion tools, using samples provided or their own collections of questions.