Reporting is an important element of the Drillster learning solution.
- Individual users have real-time access to information about the proficiency and progress of their drills and on their test results. When logged in to the Drillster account, the user can open a drill and see detailed information on the results. This applies to both the web application and the iOS and Android apps.
- Staff users (administrators, mentors, managers, instructional designers) have potentially access to reporting. This is only the case if they have been assigned view or manage rights for specific groups (training modules) in which users, drills and tests are grouped.
There are different types of reports you can request for:
- Group proficiency report: the current proficiency of all members and all drills in a group.
- Group highest attained proficiency report: shows the highest attained proficiency of all members and all drills in a group.
- Group eventual proficiency report: shows the eventual proficiency to which the proficiency of a user for a drill will decline to if the learner stops learning today.
- Learning objective met / not met: shows if users in a group have met / not yet met / no longer met/ the learning objective that the organization has set for a drill or a course.
- Group question statistics report: (number of correct answered questions / total number of answered questions) * 100%.
- Group time spent report: how much time each member spent on a drill.
- Group easy/ difficult questions report: an overview of questions the members found easy or difficult.
- Group test results: results of the last tests a participant took.
- Group member list report: list of participants (members).
Who has access to reporting?
Individual users only have access to reporting on their own training proficiency and progress.
Administrators or managers can get additional permissions to their Drillster account to allow them to view or manage reporting.
View rights allow staff users to view the aggregated and individual participants results of the groups for which they have been granted the view rights.
Manage rights allow staff users to view aggregated and detailed reporting and also to manage the content and users in a group (add users, disconnect users, add content, disconnect content, etc.).
Reporting is available:
- On screen (for users who have been granted view or manage rights for reporting)
- A dashboard shows aggregated data on the group and courses (average proficiency, average test results, % of users that have started the drill, etc.).
- Via a download function in drillster.com. Reports are not sent by email as they contain privacy information of users. If a report is generated, Drillster notifies the user if the report has been generated and available at the Drillster page.
- Via the Drillster API. Drillster can automatically exchange the data to your LMS, HRM or compliance systems. An implementation of the Drillster API is then required.
Reporting on learning objectives
When a learning objective is set on a drill, test or course, reporting can be produced on the people that have met or that have not yet met or no longer meet the learning objective.
Characteristic of a drill is that it is a permanent learning object. If people practice and provide correct answers, the proficiency will increase. If incorrect answers are given or if people have not practiced for a longer period of time, the proficiency will decrease.
If a learning objective is set, reporting can show whether or not users meet the objective or not. The organization can determine per group and per course or drill what the bandwidth is in which the learner meets the objective. The blue area in the above image shows when the learner is Yes meeting the learning objective.
When the proficiency reporting is downloaded for drills on which a learning objective is set, the reporting shows if Yes or No the objective is met.
If the objective is not met, the following information provides further insight:
- Current proficiency versus highest obtained proficiency.
- If the current proficiency equals the highest obtained proficiency, then the learner is still building up its knowledge.
- If the current proficiency is much lower than the highest obtained proficiency, then the learner isn’t maintaining the proficiency.
- Time spent
- If the time spent of a learner deviates from the average of the population, then it indicates whether the low proficiency is due to not practicing the drill or linked to the learner having difficulties mastering the material.
- Last time practiced
- If the learner has not practiced a drill for a long period of time, the learner is not actively working on the drill
- If the learner has recently practiced the drill, then it is likely that the learner is still practicing the drill with the purpose to maintain or improve the proficiency.