# AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace

Source: [The Decoder](https://the-decoder.com/ai-coding-agents-ace-isolated-tests-but-complete-fewer-than-one-in-ten-tasks-in-a-simulated-workplace/) · 2026-11-22 · AI
Page: https://themorning.dev/story/ai-coding-agents-ace-isolated-tests-but-complete-fewer-than-one-in-ten-tasks-in-7cda7525825c687b
Kind: research · Impact: medium

## In brief

- A new test places AI coding agents in a simulated developer job with colleagues, project boards, and incomplete handoffs.
- In this setting, agents complete fewer than one in ten tasks, despite performing well on isolated tests.
- The source reports that even Opus 5.5 and Astra fall far short in this workflow.

## Why it matters

Benchmarks based on isolated coding tasks may overstate how reliably agents can carry work through messy, multi-step team workflows. Developers should not assume agents can close tickets autonomously without oversight.

## Versions

- Opus 5.5

## Coverage

- [AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace](https://the-decoder.com/ai-coding-agents-ace-isolated-tests-but-complete-fewer-than-one-in-ten-tasks-in-a-simulated-workplace/) — The Decoder, 2026-11-22

Tags: ai-agents, coding-agents, benchmarks, evaluation, workflow-automation

---

Brief generated by AI (claude-haiku-5-5) from the reporting listed under Coverage. Headlines belong to their publishers. The Morning Dev – https://themorning.dev
