freelance

OpenAI researchers tested AI coding systems against real freelance software engineering tasks that humans earned $1 million to solve. They created the SWE-Lancer benchmark, sourcing 1,488 tasks from Expensify and Upwork. AI models like Claude 3.5 Sonnet and GPT-4o were evaluated on their performance. Results showed AI could earn over $400,000 but struggled with complex coding tasks, highlighting limitations in understanding and refining solutions. While AI can't replace human engineers yet, it may automate routine coding, allowing developers to focus on higher-level problems.

https://www.discovermagazine.com/technology/can-ai-coding-systems-earn-usd1-million-as-freelancers