AgentSWE: coding agents fail to build the agents you want
Why it matters
25-task benchmark for creating/editing/optimizing agents. Strongest Creation mean 19.1; Editing 31.6; Optimization <5% gap closed on average. 11 Creation runs with ≥90 on development averaged only 9.9 held-out.
Read the source: arXiv (opens in a new tab)
All hits from 13 Oct 2026More AgentsGet the daily hits by email