MIT Technology Review · AI· Amit Katwala·· 10 วันที่แล้วคะแนน AI52
How reverse game theory could keep AI agents in check
How “reverse game theory” could keep AI agents in check
เนื้อหานี้ยังไม่มีในภาษาของคุณ จึงแสดงเป็นEnglish
สรุปโดย AI
Alignment researchers are exploring reverse game theory, also called mechanism design, which designs incentive structures that push AI agents toward desired behavior instead of trying to inspect their internal reasoning. An MIT-led preprint proposes rewarding a model for how well its answers predict a second model's output, so sandbagging tests becomes a losing bet, and suggests pitting agents against each other or pairing oppositely biased agents.
แหล่งข่าว:MIT Technology Review · AI · technologyreview.com