Your front row seat to the rise of Autonomous DevTools
Mission: Shape the future of software in the open
We believe it is in the best interest of the software industry, which the world depends on, to deem certain types of tools as essential infrastructure.
We consider it vital that all essential infrastructure continue to have strong Open Source solutions available.
We predict a near future where Autonomous DevTools such as Coding Agents will be considered essential infrastructure.
Therefore, we promote the creation and maintenance of near state-of-the-art Autonomous DevTools, published as Open Source, in healthy competition with their proprietary counterparts.
Get started
With patience, the most tangled cord may be undone
- Lao Tzu
SWE-bench leaderboard
More on leaderboards page| Rank | Agent | Score (verified) | Group |
|---|---|---|---|
| 1 | OpenHands + CodeAct v2.1 (claude-3-5-sonnet-20241022) | 53.00% | OpenHands |
| 2 | Agentless-1.5 + Claude-3.5 Sonnet (20241022) | 50.80% | Agentless |
| 3 | Composio SWE-Kit (2024-10-25) | 48.60% | Composio |
| 4 | AppMap Navie v2 | 47.20% | AppMap |
| 5 | AutoCodeRover-v2.0 (Claude-3.5-Sonnet-20241022) | 46.20% | AutoCodeRover |
| 6 | Moatless Tools + Claude 3.5 Sonnet (20241022) | ~45% | Albert Örwall |
| 7 | SWE-agent + Claude 3.5 Sonnet | 33.60% | Princeton NLP |
Last updated: 2024-11-24