Inside Amazon Connect Talent: The science of structured AI interviews
Inside Amazon Connect Talent: The science of structured AI interviews
Amazon describes Connect Talent, an AI-led structured interviewing service built on three principles: job-related evidence, separating interviewing from scoring, and fairness protections such as excluding video, voice tone, and identity from scoring. An independent I-O psychology firm found 100% of reviewed job descriptions retained critical job information, 91% of generated competencies were traceable to the job description, and Connect Talent's scoring aligned with expert decisions in 89.3% of cases (Cohen's kappa 0.79). Internal research found scores based only on a candidate's first response were up to 1.14 points lower on a five-point scale than scores using the full conversation, and that its structured scoring used all five scale points while holistic LLM-as-judge scoring clustered in the middle three.
Source: AWS Machine Learning Blog · aws.amazon.com