Skip to content
Charlie O'Neill· Charlie O’Neill·· 2026-09-07AI score38

Let's Bet on RL Environments: Why Useful Data and Environments Will Win

Let’s bet on this shit

AI summary

An argument that people who claim everything will become RL environments are not acting on that belief, and that useful RL environments will grow exponentially scarcer and more valuable as models approach RSI. The piece urges building long-horizon tasks in domains of real expertise rather than Goodhart-style task farms, and argues a broad spread of environments beats a small set of frontier-hard ones.

Source:Charlie O'Neill · charlesponeill.com