Anthropic finally studied skill atrophy for developers
Anthropic just published research on how reliance on AI affects the actual skill of software engineers.
For those of you wondering if AI is going to shrink your brain, you’re going to want to read this.
This newsletter is for tech workers who want to multiply their impact using bleeding-edge AI tools. If you want to accelerate your career, you’re in the right place.
How the study was laid out
Anthropic just ran a randomized controlled trial with 52 software developers (mostly junior) who used Python regularly, were familiar with AI coding help, but had not used the async library Trio.
Participants did:
a warm-up (no AI),
a main task implementing two small features with Trio (AI allowed only for the treatment group),
then a quiz (no AI).
The quiz intentionally emphasized skills that matter when you’re supervising AI-written code: debugging, code reading, and conceptual understanding.
So what was the result?
AI help reduced learning, and didn’t meaningfully speed people up.
The AI group finished a bit faster on average, but it wasn’t statistically significant.
The AI group scored ~17% lower on the immediate knowledge quiz (roughly “two letter grades” in their framing).
The biggest gap showed up in debugging.
This is the part a lot of engineers should sit with. The “future-proof” skill is not “typing code fast.” It’s knowing when code is wrong, why it’s wrong, and what to change. This study suggests your tooling can quietly erode that muscle when you’re learning something new.
How you use AI matters!
