I agree with this. AI can generate code quickly, but making sure it’s correct, secure, and ready for production still takes real effort. Writing less code doesn’t always mean delivering faster.
AI Hasn’t Shifted The Bottleneck From Coding To Code Review
7 Comments
Counting changes that passed review but haven't deployed tells me more than any PR metric I track, because it measures the queue the Faros numbers stop short of. On AI-heavy teams I'd also count how many queued changes touch the same files, since a big batch of overlapping agent diffs is where rollbacks get painful. Does your research split batch size by whether a team has a manual verification step before release?
@[nik-13] it's funny that no matter how we innovate the technology, keeping an eye on flow, queues, and waits is still the heart of improvements. We're looking in detail at the whole pipeline for changes, and we'll be doing a whole report on what we find. You're absolutely right to identify manual validation as a big problem - I'm not sure why people allocate large AI budgets before fixing these basics?!!
Please log in to add a comment.
I'd track how long approved changes wait rather than how many are waiting. Little's law says the average number of items in a queue equals the arrival rate times the average wait. A team that merges 98% more pull requests will see that queue roughly double even if no single change waits a minute longer than before, so the count alone can't tell a busier pipeline from a slower one.
Time from approval to production is the half of lead time for changes that the merge-focused studies stop short of, and it's cheap to start with. Record the age of the oldest approved change that isn't in production yet, once a week. If that number climbs while review times hold steady, the constraint is the step after review, which is your argument with a trend line under it.
@[Mike Dabydeen] I sometimes assume people track lead and cycle times, so thanks for mentioning this. In this article, I'm using the count as proof that code review isn't holding them up. If code review was the constraint, downstream queues would be empty or have a single item in them.
I think a lot of organizations will read the popular articles about AI creating a review bottleneck and start investing there, when in reality it's not the constraint.
@[Steve Fenton] That test holds when changes can deploy one at a time. With a release train, approved changes collect between releases whatever review is doing, so a full downstream queue is there by design and doesn't tell you much about review.
The reading I'd add is the queue right after a release goes out. If it drops close to zero and then refills, review is keeping up and the train sets the pace. If approved changes are still waiting after the release, the step after review is holding them, which is your point with the batching effect taken out.
@[Mike Dabydeen] I'm massively against batching, so we're unlikely to come to terms on that point, but I understand how that changes how you look at these things. There are scenarios where Continuous Deployment isn't possible, and I can take a pragmatic view on that (it's just so many people use that as the excuse to batch in cases where it harms them).
Please log in to add a comment.
Please log in to comment on this post.
More Posts
- © 2026 Coder Legion
- Feedback / Bug
- Privacy
- About Us
- Contacts
- You Tube
- Tiktok
- Premium Subscription
- Terms of Service
- Early Builders
More From Steve Fentonverified
Related Jobs
- Remote QA Engineer - PHP Automation & CodeceptionHireHi · Full time · New York, NY
- Remote QA Engineer - PHP Automation & CodeceptionHireHi · Full time · New York, NY
- Bilingual Retail Sales Associate (Spanish) - VerizonVerizon · Full time · Germany
Commenters (This Week)
Contribute meaningful comments to climb the leaderboard and earn badges!