Intelligence Is Free, Now What? Data Systems for, of, and by Agents

UC Berkeley's Aditya G. Parameswaran and collaborators argue that as inference costs fall from roughly $30 per million tokens in early 2023 to under $1 today, data systems must be redesigned around three challenges: systems for agents, of agents, and by agents. They note that in a text-to-SQL benchmark with multiple agents per task, only 10-20% of sub-plans are distinct, so 80-90% of sub-queries duplicate work, and propose reuse, approximation, and proactive data systems.