Updated
Updated
Items with an AI score under 20 are hidden. Show low-relevance items
AICognition's Devin gained a September 2024 update with MultiDevin, which lets a manager Devin delegate work to up to 10 worker Devins, currently available on the Enterprise plan. Devin now automatically responds to comments on its pull requests, suggests Knowledge additions, and can restore earlier checkpoints, and the company reports up to an 80% reduction in time for common tasks.
AICognition tested whether its Devin AI agent could recover Windows machines stuck in the Blue Screen of Death after the CrowdStrike outage. Following a playbook of eight steps, Devin mounted the drive, deleted the faulty CrowdStrike files, and debugged a failed volume detach. The blog says the machine was confirmed bootable, and that playbooks are most useful when the same fix must be repeated across many machines.
AIDevin's June 2024 update lets users directly operate its VSCode editor, terminal, and browser, and adds Playbooks for recurring engineering tasks. It also adds Knowledge sharing, Machine Snapshots that persist dev environments, event-driven triggers from Slack, GitHub, and Linear, a Secrets manager, and tools for verifying Devin's work. Access remains limited to a waitlist with weekly invite releases.
AICognition reports that its agent Devin resolved 79 of 570 sampled SWE-bench issues, a 13.86% success rate, without being given the files to edit. The report says this exceeds the best previous unassisted baseline of 1.96% and the best assisted result of 4.80%. It also describes the adapted evaluation setup, a 45-minute runtime limit, and cases where Devin failed on multi-file edits.
Why it matters: The report explains how SWE-bench was adapted for end-to-end agent evaluation, with failure cases that clarify where the 13.86% result comes from and its limits.
AICognition introduces Devin as an AI software engineer that can plan and execute complex engineering tasks with a shell, code editor, and browser. On SWE-bench, Devin resolved 13.86% of issues end-to-end, versus a previous state-of-the-art of 1.96%, on a random 25% subset of the dataset. Devin is in early access, with access available through a waitlist.
Why it matters: The post pairs Devin's end-to-end task demos with SWE-bench results against prior models, letting readers weigh the claimed capability against the evaluation setup.