Understanding Our Detection Measures
We're excited to share our Integrity Guard functionality, currently in beta release. We're actively working to evolve this technology while collecting comprehensive validation data to ensure its reliability and accuracy. These measures currently monitor:
- IP address variations
- Device switching
- Tab or browser navigation behaviour
- Question engagement
Interpreting Potential Flags
As with any beta technology, we approach our findings with appropriate caution. Integrity Guard incidents provide useful feedback rather than definitive evidence, especially during this development phase. We view these insights as conversation starters, not final verdicts, and are continually refining our detection algorithms based on emerging data.
A flagged incident may have an innocent cause. Multiple flags appearing together warrant closer attention, but still require thoughtful consideration of the candidate's circumstances. As we gather more validation data, our ability to differentiate between concerning and benign patterns continues to improve.
Different assessment types may naturally produce different behavioural patterns. Consider the specific assessment type when evaluating any flagged behaviour:
- Personality & Motivation Assessments: These typically involve reflection and consideration, potentially resulting in varied completion times and occasional breaks.
- Numerical Reasoning Tests: Candidates may legitimately use calculators or scratch paper, which could involve tab switching or brief pauses.
- Adaptive Ability Tests: The increasing difficulty of questions may lead to naturally varying response patterns.
- Gamified Assessments: These interactive formats may show different engagement patterns compared to traditional assessments.
The example scenarios below are provided to support your consideration and interpretation of reported incidents.
- Scenario 1: A candidate shows multiple IP addresses but consistent device types
- Possible explanation: Completing the assessment while commuting or switching between home and office WiFi
- Recommended approach: Low concern unless paired with other suspicious indicators
- Scenario 2: A candidate shows frequent tab switching during numerical reasoning questions
- Possible explanation: Using a calculator application
- Recommended approach: Verify calculator use during follow-up conversation
- Scenario 3: A candidate answers all questions extremely quickly with high accuracy
- Possible explanation: Prior knowledge of questions or external assistance
- Recommended approach: Higher concern warranting validation through alternative assessment methods
Next Steps With Flagged Candidates
We recommend a validation approach that is fair, transparent, and respectful:
- Schedule a follow-up conversation with a tone of curiosity rather than accusation
- Explain the assessment process including that certain technical measures are in place to ensure fairness for all candidates
- Share relevant observations in neutral language: "We noticed some unusual patterns in how the assessment was completed"
- Invite explanation with open questions: "Can you walk us through your experience taking the assessment?"
- Consider a validation exercise where appropriate, such as:
- A brief live problem-solving session on similar content
- A discussion about their approach to specific questions
- A different format of assessment in a monitored environment
When following up on integrity flags, we recommend:
- Documenting all conversations with candidates about assessment integrity
- Recording the rationale for decisions made based on integrity concerns
- Maintaining consistent standards across all candidates
- Consulting with legal/HR teams before making adverse decisions based on integrity flags
We're actively collecting performance data on Integrity Guard to enhance its validity and reliability with each iteration. We welcome your feedback on its effectiveness in real-world scenarios as this helps us improve the functionality for everyone.
We're always here to consult on specific cases and help interpret the data in context. If you have further questions on Integrity Guard, please reach out to your Customer Success Manager.