OpenAI Alignment Blog· Melody Guan, Yuxiang Xie, Bowen Baker·· 24 d agoAI score28
OpenAI proposes pair-matched and post-control metrics to extend g-mean² monitorability
Beyond g-mean²: complementary metrics for monitorability
AI summary
OpenAI's Alignment Blog adds two metrics to g-mean², its dataset-level measure of monitor discrimination. A pair-matched metric compares models only on task instances that support the relevant positive, negative or intervention-valid comparison, while a post-control integration metric simulates monitor-gated rejection and estimates the probability that the deployed system still emits a bad output. The post also derives a pessimistic lower bound for intervention evaluations.
Source:OpenAI Alignment Blog · alignment.openai.com