AI Models Know What Women, Peace and Security Is. They Just Don't Bring It Up
AI Models Know What Women, Peace and Security Is. They Just Don't Bring It Up
Our Secure Future describes building the WPS AI Leaderboard, a 30-scenario benchmark testing whether LLMs apply Women, Peace and Security principles when users don't explicitly ask, finding that frontier models' average score fell from 0.82 on cued prompts to 0.16 on sparse ones. Models also varied unpredictably in resisting adversarial requests to sideline WPS requirements, which the authors attribute to post-training rather than general capability. A multi-agent WPS workflow scored 0.84 overall with flat gender-sensitivity across tiers, though the authors stress the benchmark is not a deployment certification and cannot replace human WPS advisors.
Source: Hacker News AI · blog.cip.org