OpenAI's SWE-Lancer Asks If LLMs Can Earn $1 Million Freelancing

OpenAI's new SWE-Lancer benchmark tests whether frontier LLMs can earn $1 million from real-world freelance software engineering tasks, scoring models in dollars rather than pass rates.