Empowering L&D Administrators: Gain Insights into Pass/Fail Rates for Enhanced Learning Outcomes
Purpose
In the SimGate Dashboard, this report offers L&D administrators a comprehensive overview, enabling them to:
View the pass/fail percentages of a specific learning experience
Track the number of learners who have passed or failed
Compare results across different sessions of the same experience
Help assess the effectiveness of learning programs or identify areas needing improvement
'Pass / Not Pass' Report Overview
The reports page on the dashboard contains the "Pass / Not Pass" report.
Opening this report displays a table showing all sessions that have pass/not pass data.
To have this data, a session must use a project that has all 4 completion fields filled in in the project settings (See DIY Report Configuration Settings below for set up).
Each session shows details about the session and the number of participants that passed and failed.
Only teams/individuals that are in the Completion State are counted.
Other teams/individuals are ignored and do not influence the percentages.
Report Toolbar
Filters
Options
Session filters limit the displayed sessions to only those selected
Project filters limit the chart to only sessions for the selected projects
Region filters limit the chart to only sessions that are in the selected regions
Filters influence each other
e.g. if you select a project, only sessions for the project should show up in the sessions filter
The refresh button refreshes the data in the chart
There is a timestamp next to the refresh button indicating how long ago the last refresh was
The download button allows data to be exported and downloaded as an excel file
VIDEO: SEE IT IN ACTION
DIY Report Configuration Settings
To display sessions in the report, the project must be correctly configured to accurately calculate which team members have passed or failed the course. If these settings are not properly configured, the project will not support this report, and user data for the course will not be calculated or displayed.
To configure these settings:
In Studio, go to the Settings page by selecting it from the top nav.
In the General Settings, scroll down to view the Completion State and Scoring Metric fields.
Configure a Completion State
Choose which state the user needs to be in to mark them as having completed the course and to calculate their score.
The passed % and failed % columns are calculated from teams that are in the Completion State. Other teams are ignored and do not influence the percentages.
Configure a Scoring Metric
From the Scoring Model, choose the scoring metric or metric rollup that you want to be used for the course completion score.
Configure a Completion Success %.
Users who have a percentage greater than or equal to this score will be marked as passed.
Completion success score % must be between 0 and 100.
Configure a Possible Maximum Score.
This will configure the pass or not pass range.
A user is considered to have passed the course if they achieved a score that is greater than or equal to the pass score range.
For example, if the Completion Success % is set to 75 and the Possible Maximum Score is 20, then a user has passed the course if their total score is greater than or equal to 15.
Configure the toggle for “Always mark the course completed”.
This will not affect the pass/not pass data and is optional.
Course will be marked as completed even if the participant fails.
Re-release and publish your project so these settings can be applied to future sessions.
NOTE: If these settings were not configured correctly before a user finished the course, user data from old sessions may not be calculated and displayed.
FAQ
Why is a session not being shown in the report?
The session may not be shown in the report due to improper configurations in the project. The settings in the project must be completed as shown in the How To page, in order for the report to be displayed accurately.
Why does the session data look inaccurate? ...a user should have been marked as passed, but they are marked as failed.
The reporting API is new and therefore there may be inconsistencies in the calculations of the pass and not pass scoring. This may be due to several scenarios, all involving a project update.
For example, a project is set up with a Completion Success % set to 75, and users have completed the course in older sessions. Then, this project has since been updated with a new Completion Success % set to 90. These older sessions are now relying on the updated settings of the project to calculate scores, therefore users who were previously passing, may be displayed as not passing.
While this is rare, there may be several sessions affected by such updates to a project setting.
Please contact us if this a problem for the affected sessions.
My session says that nine users are registered, but the report says there are ten participants... what is going on?
This may be due to a user being deleted from the session after they have completed the course. The reporting will still calculate and score the user data from that user and display it alongside active users.
Who can access these reports?
Currently, everyone except participants can access the reports on the dashboard.
In the future, reporting permissions will be tailored to the access level (ex. Admin vs Facilitator).
