Drillster Support & Info

Tests

Tests

This is a list of questions related to the use of tests.


How do I turn a drill into a test?

Go to 'My Content' and click on the three blue dots button of the drill. A menu will open where there is an option labeled 'Define a test'. Select this option and follow the instructions on the next page to create your test. 

The drills you are using in the test can have question variantDrillster will also use this feature in the tests.  

Settings

Step 1. General

  • Test name: Give your test an applicable name
  • Drills: Select the drill(s) you want to add to your test
  • Instructions (optional): These instructions will be displayed to the user prior to the test.
  • Show advanced options:
    • Direction: When there are no restrictions set in the drill, you can apply if the test is productive, receptive or both.
    • Style: Set the question style to multiple-choice or open-ended (only available if not restricted by the drill)
  • Time limit: Set how much time a participant has to complete the test (hours, or minutes).
  • Unanswered questions: If switched on, participants are not required to provide all answers in order to complete the test (which means they can skip answering some questions and still complete the test).
  • Select the Test score transformations
    • Name of drill with matching level
      Id: adaptive-test-level-short-name 
      Properties: For adaptive tests only.
      Custom transformer for European Framework of Reference for Languages. Transforms the adaptive test score to A1, A2, B1, B2 or C2.
    • Name of drill with matching level
      Id: adaptive-test-level-name
      Properties: For adaptive tests only.
      Custom transformer for European Framework of Reference for Languages. Transforms the adaptive test score to the name of the drill that matches the result.
    • One to ten, proportional to the number of correct answers
      Id: one-to-ten
      Properties: Does not apply multiple-choice correction or configured weights
      A score range 1, 2, … 10, proportional to the number of correct answers. Standard rounding is applied.
    • One to ten with one decimal, proportional to the number of correct answers
      Id: one-to-ten-with-decimal
      Properties: Does not apply multiple-choice correction or configured weights
      A score range 1.0, 1.1, ... to 10.0, proportional to the number of correct answers. One decimal position is used, and a standard rounding is applied. The character that is used as decimal separator (comma or dot) depends on the language settings of the user.
    • Percentage of questions answered correctly
      Id: correct-answers-percentage
      Properties: Does not apply multiple-choice correction or configured weights
      Produces the percentage of correctly answered questions (0-100%).
    • Weighted percentage of questions answered correctly
      Id : weighted-correct-answers-percentage
      Properties: Does not apply multiple-choice correction
      Produces the percentage of correctly answered questions (0-100%), while including the (optionally) configured weight. It is possible to configure specific weights per drill in the test, or per question in the test.
    • Rapportcijfer op basis van 68% cesuur
      Id: sixty-eight-percent-grade-points
      Properties: Based on standard test score
      A numerical score range 1, 1½, 2, 2½ ... 10, where a test score of 0% corresponds with 1, 68% with 5½ and 100% with 10.
    • Rapportcijfer op basis van 70% cesuur
      Id: seventy-percent-grade-points
      Properties: Does not apply multiple-choice correction or configured weights
      Similar to sixty-eight-percent-grade-points, but for this transformer, 70% corresponds with 5½.
    • Rapportcijfer op basis van 80% cesuur
      Id: eighty-percent-grade-points
      Properties: Does not apply multiple-choice correction or configured weights
      Similar to sixty-eight-percent-grade-points, but for this transformer, 80% corresponds with 5½.
    • Omschrijving op basis van 70% cesuur
      Id: seventy-percent-grade-points-narrative
      Properties: Does not apply multiple-choice correction or configured weights, Dutch only
      Similar to seventy-percent-grade-points, but the resulting score is mapped to a Dutch (!) language narrative:
      9½ / 10 Uitstekend
      8½ / 9 Zeer goed
      7½ / 8 Goed
      6½ / 7 Ruim voldoende
      5½ / 6 Voldoende
      4½ / 5 Zwak
      3½ / 4 Onvoldoende
      2½ / 3 Ruim onvoldoende
      1½ / 2 Slecht
      1 Zeer slecht
    • Pass at 60% (inclusive) of questions answered correctly
      Id: sixty-percent-correct-narrative
      Properties: Does not apply multiple-choice correction or configured weights
      Produces either “failed” or “passed” (in user’s language) based on a number of correct answers compared to the total number of questions. If 60% or more questions are answered correctly, the result is “passed”, and otherwise “failed”.
    • Pass at 70% (inclusive) of questions answered correctly
      Id: seventy-percent-correct-narrative
      Idem, for 70%
    • Pass at 75% (inclusive) of questions answered correctly
      Id: seventy-five-percent-correct-narrative
      Idem, for 75%
    • Pass at 80% (inclusive) of questions answered correctly
      Id: eighty-percent-correct-narrative
      Idem for 80%
    • Pass at 80% (inclusive)
      Id: eighty-percent-narrative
      Properties: Based on standard test score
      Produces “passed” if the test score is 80% or higher, otherwise “failed”. The result is translated to the user’s language.
    • Qualify at 80% (inclusive)
      Id: eighty-percent-qualified-narrative
      Properties: Based on standard test score
      Idem to eighty-percent-narrative, but produces “qualified” or “not qualified” instead of “passed” and “failed”. The result is translated to the user’s language.
  • Result disclosure: Switch on which results you want to share with a participant at the end of each test.

Step 2. Questions

  • Question distribution: Default setting is 'Automatic'. If set on manual, you can adjust this setting with help of the line tags from your drill.
  • Drill weight: Set the weight of the drill. Default setting is 'Automatic'.
  • Total number of questions: When more drills are added to a test, the total number of questions can be too much. You can set the number of questions to a maximum in order to give the test the right length.
  • Question navigation: Switch on if you allow the user to see and answer the questions in any order.

Step 3. Summary

  • The summary of all settings you have set for this test.
  • Click on 'Create'.
  • You will find your test in the overview screen of 'My test definitions'. With the 3 points menu button, you can manage your test (e.g. add to a group).

The test appears under 'My content'. Tests and exams can be managed in this library of test definitions, for example adding tests to a group.

Back to top

 

Can everybody make a test?

All Drillster users can take tests. A premium account or license is needed to assign these tests to individual users or a group of users and to access reporting. Visit our website or contact us for more information. 

Back to top

 

What kind of tests am I able to make?

Drillster supports various test types, including diagnostic tests, adaptive tests, static tests, and PIN-secured exams. Detailed group and individual reporting are available. 

Back to top

 

What functionalities can I use?

The following functions can be launched: 
  • Modify the settings of a test definition.
  • Remove a test definition.
  • View the aggregated test results. If a test definition has been assigned to multiple groups, the aggregated test results for all groups can be viewed and downloaded in the ‘My test definition’ section. Results of a separate group can still be viewed and downloaded via the ‘My groups’ function.
  • Assigned to one or several groups.
  • Define co-authors.
  • Start the test. The author is able to ‘test’ the test that has been defined.
  • Set up a test as an anonymous or PIN-secured test (for tests whereby no Drillster account is required for the testee). 
  • Generate a SCORM package for tests that are not part of a group. SCORM packages for group tests can still be generated within the group in which the test definition has been placed. 

For more information on how to use these functions, see the article about Tests in the user manual. 

Back to top

 

Why am I unable to change the question direction of a test?

The question direction for a test is determined when the test is defined, and cannot be chosen by the user doing the test.

Back to top

 

Why am I unable to change the question style of a test?

The question style for a test is determined when the test is defined, and cannot be chosen by the user doing the test.

Back to top

 

Does the percentage shown while doing a test represent my score?

The percentage reflects the progress, meaning how many test questions out of the total have been answered.

Back to top

 

Can I see which answers were correct and incorrect after completing a test?

The organization that distributes the test determines whether you get access to the right and wrong answers. When is indicated in the definition of the test that participants can see their test scores, subscores, and correct and incorrect questions, then this will be visible after the last question has been answered. If you don’t see these results, it is not activated by the author of the test. Please contact your organization if you still want to have access to the results.

Back to top

 

How is the test score percentage calculated?

For open-ended questions, it is impossible to guess the right answer. For closed questions (multiple choice) there is a certain chance to guess the right answer. For each correct answer to a question, one point is added. For each incorrect answer to a multiple-choice question, the 1/n point is deducted from the total, where 'n' is the number of answer choices for that question. The final percentage is calculated by dividing the number of points by the number of questions asked. This is a widely used scoring system. It is used for example in the scoring of American SAT tests.

Back to top

 

My test score is lower than what I expected based on the number of correct answers. How come?

For closed questions (multiple choice) points are deducted for each incorrect answer. This is done to compensate for being able to guess the right answer. This method of score calculation called 'negative marking.

Users who have a premium or license account can post a caesura in the key definition if they wish to apply a score calculation that’s different from the negative marking manner. You can contact support@drillster.com for more information

Back to top

 

Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.