Friday, May 27, 2016

#QQML2016 information literacy assessment: the threshold achievement test

At the QQML conference, liveblogging a few of the sessions. Carolyn Radcliff (co-author Kevin Ross) presented on The next generation of information literacy assessment: the threshold achievement test. Radcliff started by introducing the ACRL Framework for information literacy. Radcliff works with Carrick Enterprises, who (as I blogged a little while ago) have a project to develop an assessment instrument based on the ACRL Framework: they aim to "measure dispositions and knowledge" and "assess at various stages of student development", with the assessment tool available on a variety of devices, and capable of being completed in the scope of a 50 minute class.
Firstly Radcliff considered "dispositions". They have identified : productive persistence; tolerance for ambiguity; feeling responsible to the community; mindful self-reflection. They have mapped the ACRL Framework to 4 modules, each of which can be covered in a 50 minute session. For each module they identify the dispositions and knowledge outcomes which are relevant.
Radcliff talked about the challenging (though fun) activity of writing test items (they have multiple choice, rating items etc.). They are aiming to include higher order items. They have tested and piloted the test in various ways (detailed feedback from students, larger scale pilots etc.)
I have already expressed some doubts about this testing approach, but it is obvious they are going about this in a very thoughtful and thorough way, and that a lot of people are interested. The website is at https://thresholdachievement.com/
Photo by Sheila Webber: staircase in Senate House, a clever advert for their Shakepeare exhibition

No comments: