The Scoring and Automation feature allows you to set up overall phase scores for candidates and set up automation.
Automation allows you to assign phase statuses to candidates (such as 'pass' or 'fail') and move 'pass' candidates to the next phase of your assessment process.
This guide shows how to add overall scores for phases and how to set up automation based on individual activity scores or overall phase scores.
Automation can be set up once you are displaying overall scores.
Note: You need to have the 'Automation Admin' role to access this functionality.
Frequently Asked Questions
Below are answers to some common questions about Scoring & Automation. Whether you're getting started or encountering challenges, you'll find guidance on using these features. If your question isn't covered here, please contact your account manager or customer support for additional support.
Q: Who can set up scoring and automation?
A: Only users with the Automation Admin permission can set up and modify scoring and automation settings. They must also have Admin status on the project of interest. Contact your account administrator if you need this permission.
Q: Can I use scoring and automation on my existing projects?
A: Yes, but it's best to set this up before candidates start. If candidates have already completed assessments, any automation will only apply to new candidates.
Q: The automation button is greyed out. Why?
A: Ensure overall scores are enabled, you have Automation Admin permission, and your phase structure is compatible (i.e., assessment OR exercises in one phase; not a mixture of both).
Scoring
Q: Why can't I enable overall scores for my phase?
A: The most common reasons are:
- The phase contains both assessments and exercises (these need to be in separate phases)
- You don't have Automation Admin permission
- There's an existing algorithm running in the background
Q: My overall scores aren't calculating as expected. What should I check?
A: If you scores aren’t calculating as expected, verify the following:
- Your activity and competency weightings add up correctly
- Optional activities aren't included in calculations
- All required activities are completed
- Pass scores are set appropriately for each activity
Q: Can I change my scoring method after setup?
A: Yes, but consider:
- Changes only affect future calculations
- You'll need to review all weightings
- The system will guide you through required changes
Automation
Q: Why aren't candidates automatically moving to the next phase?
A: If you experience this issue, check that:
- Automatic progression is enabled
- Candidates have met the pass criteria
- There is a next phase available
- All mandatory activities are completed
Q: What happens if I need to change automation settings?
A: While some changes are possible:
- Major changes require removing existing automation first
- The system will warn you about potential impacts
- Changes only affect new candidates
- Consider creating a new project for significant changes
Q: How do I handle candidates marked for 'refer'?
A: For referred candidates:
- Review their individual scores for all completed activities
- Make a manual decision based on their available scores. Do they meet minimum criteria for the role?
- Update their phase status on the results dashboard to either Pass or Fail
- Progress or reject as appropriate
Q: Will copying my project copy the scoring and automation settings?
A: Copying a project will copy your scoring and automation settings, however:
- Settings copy independently
- Changes in the original won't affect the copy
- You can modify settings in the new project
Q: What happens if I add or remove activities after setting up automation?
A: Removing activities will impact your automation settings, however the system will:
- Alert you to potential impacts when making changes
- Guide you through necessary updates
- Require review of existing settings
- Prevent changes that could affect fairness
Best Practice
Q: How do I decide on appropriate pass scores?
A: When setting your pass scores, you should consider:
- Historical performance data – what is the minimum requirement for the job role
- Job requirements – What behaviours and skills are most critical to the role
- Expected success rates – your volume of applicants versus how many you want to progress
- Starting conservative and adjusting based on data – high pass marks can cause adverse impact. Start conservative (e.g., 30/100%) until adverse impact can be assessed
Q: How often should I review my automation settings?
A: Following automation setup, you should review:
- Weekly when first implementing to ensure appropriateness
- Monthly once established
- Any time your requirements change
- When pass rates seem unusual