Do you already use question variants in the drills that you created? When using question variants, Drillster will not repeat the exact same question, but its variant. Question variants increase the attractiveness of your drills.
A question variant is a differently worded instance of a question addressing the same knowledge element. Variants of a single questions may be completely different, but still cover the same knowledge element.
Aside from factual knowledge the introduction of question variants make it easier to use Drillster to train the application of knowledge. Think of the application of knowledge in case studies or calculations, the ability to use grammar rules in a language test, or the ability to identify the correct behaviors in the fields of security, hygiene or integrity.
The Drillster question selection algorithm remains unchanged. This means that the level of question repetition is the same. However, if there are sufficient question variants available, literal repetition is minimized.
The more question variants are produced, the smaller the chance of literal repetition. Since drills are never really finished, there is still a chance of literal repetition over time. It is up to the drill’s author to determine how desirable it is to avoid literal repetition.
To ensure the quality of knowledge retention, the use of question variants must satisfy a couple of conditions:
- There is no ordering or qualitative difference in the question variants. Drillster will randomly select questions from the set of variants. If a particular variant has already been presented to a user, any repetitions will as much as possible be taken from other variants. The level of unpredictability is important in order to guarantee that knowledge is actually retained and correctly memorized.
- Any feedback should be identical as much as possible for each of the question variants. It is still possible to use distinct feedback values for each variant, but since the variants all cover the same knowledge element, the feedback should probably be the same.
- If a given question has two variants, and a user has incorrectly answered one of them, the question will be repeated. This means that it is possible that one of the variants is repeated literally. If there are three or four variants of that question, the chance of literal repetition is lowered significantly (unless users continue to answer these variant questions incorrectly).
- By adding question variants it will not take longer to reach 100% proficiency for a drill. There will be a decrease of literal repetition, but on average the number of questions asked will be the same.
- Question variants may come in all shapes. For example, one variant might be a multiple choice question, and another may be an open ended question, or a set or sequence question. But it remains important that each variant covers exactly the same knowledge element. This is crucial for Drillster to provide accurate insight into the user’s true knowledge levels.
Questions are entered into the system in the usual way, either manually via the drill editor or via the upload function or API.
If you check the boxes of the questions that you would like to mark as equal questions, you see some buttons appear at the top of the drill editor. You can choose to mark the questions as equals. The questions are grouped and placed within a box frame. The questions are now variants and will be treated as equals when practising the drill.
The same can be done when a question has to be taken out of the set of question variants. Just check the box of the question and mark it as unequal. The question will not be deleted but placed as an individual question in the drill.
Do question variants influence my score? Variants of a question are regarded as one single question in terms of scoring.
It is possible to link questions as variants in existing drills with existing user scores. In that case the new combined score will be the average of each individual question score. Initially there will not be a difference in score after linking questions as variants. However, since there are now fewer unique knowledge elements in the drill, the proficiency level will rise quicker.
If new question variants are added to existing questions, and the total number of questions remains the same, there will be no impact to existing scores.