Goodbye memorisation, hello open-book test
Claudia Janeth Hern谩ndez Cardona offers practical advice on using open-book tests in our student evaluations
I remember during my time as a college student when the teacher announced we would have an open-book test. This is a test in which the student can use study materials such as textbooks, notes and so on. This type of test is probably one of the least used by teachers, as it involves breaking a paradigm regarding test-taking and knowledge demonstration.
Of course, I thought that having access to all my notes and books would be a great advantage, but it wasn鈥檛 what I expected. While taking the test, I realised I鈥檇 underestimated the amount of information I would have to consult in such a short time. I also underlined and annotated my books in such a way that it was challenging to find the information I needed quickly.
- Help your students to become assessment literate
- Sensitive marking and the end of the line for the academic essay
- Three innovative authentic assessments to encourage soft skill mastery
Instead of feeling relaxed and confident, I felt overwhelmed and stressed by the amount of information available to me. I spent most of the time looking for information instead of answering the questions. Ultimately, I didn鈥檛 do as well as I鈥檇 expected and learned that (1) having too much information is not always an advantage, and (2) knowing how to organise and thus access said information is essential when time is limited.
Why use it in our classes?
My experience made me reflect on the benefits of these classroom evaluations. Unlike traditional tests, open-book tests require applying skills other than memorisation, such as information searching and application in specific situations.
With well-crafted questions such tests can assess capacity to apply knowledge to specific situations, aid problem-solving, evaluate cognitive and critical reasoning skills and test whether students can search for quality information by choosing the most appropriate sources.
These tests are often a new experience for students who, after taking them, are often surprised, since they are not the kind of tests they鈥檙e used to. This is why many students, at first, wrongly presume that being able to check their textbook during the test means they need to do little or no preparation.
How to design an open-book test
When designing this type of test, consider the following recommendations:
鈭 Review the objectives you wish to evaluate.
鈭 Define the number of questions, considering the objectives, contents and time to complete the test.
鈭 Design questions that involve high-level skills, conceptualisation, problem solving and reasoning.
鈭 When crafting the question/s, use direct verbs to clearly state the type of thinking and content the answer requires.
鈭 Avoid multiple-choice questions. Instead, use questions that encourage students to make judgements and demonstrate deep understanding of and applications for a topic. For example, we could enquire about possible outcomes by asking: 鈥淲hat would have happened if XXXX?鈥 To analyse connections, you can ask: 鈥淲hat is the relationship between A and B?鈥 In addition, to incentivise contextualisation and real-world solutions/applications, you can ask them: 鈥淲hat examples can you find of XXXX?鈥 These kinds of questions challenge their memories and engage their critical and analytical thinking skills. The questions we come up with will be the axis that will determine if this type of evaluation will be meaningful or not.
Before conducting an open-book test, it鈥檚 crucial to follow a few recommendations to ensure a just and effective evaluation experience for students. First, invite students to study the contents with higher relevance. Also, be sure to specify which materials they will be allowed to use during the test, such as notes or specific textbooks, and disclose the duration. If the open-book test is carried out online, search for speciality software to prevent fraud. For example, TestWe takes temporary control of the PC and prevents other people from taking over remotely.
Following these recommendations will ensure a successful application, allowing students to demonstrate their understanding and application of the knowledge they鈥檝e acquired throughout the course.
In our daily practice and lives, we often face different situations and naturally look up information to deal with them. Thus, open-book tests are extremely helpful when the main objective is to evaluate the students鈥 ability to analyse and evaluate information. It鈥檚 not about replacing traditional testing but complementing our teaching practice with these strategies.
Claudia Janeth Hern谩ndez Cardona is a pedagogical architect, educational innovation and digital learning, at Monterrey Institute of Technology, Mexico.
If you would like advice and insight from academics and university staff delivered direct to your inbox each week, .