Back to News
RSS feedwww.seangoedecke.com

Human-AI Partnerships Align Coding Agents Rather Than Improve Their Capability

Summary

The article argues that the current comparison between AI-assisted software engineers and chess “centaurs” is misleading. In chess, human-AI teams were temporarily stronger than either humans or machines alone; in software engineering, the author says coding agents already make fewer mistakes than he does and work orders of magnitude faster. Their output can compile reliably, avoid common concurrency problems, and function across environments, but it can still be poor engineering because it is not maintainable, violates important requirements, or conflicts with a product’s long-term strategy. The human engineer’s main contribution is therefore alignment: communicating the organization’s technical values and correcting behavior shaped by training incentives, such as excessive comments, unnecessary tests, or decorative website text. The author says capability is relatively well understood to improve through larger models, better data, and stronger reinforcement-learning environments, while alignment is harder and more dependent on context. Each company may value different trade-offs, so a useful coding model must adapt to those values rather than follow one universal standard. This challenges claims that programmers will soon stop reading code, although the article acknowledges that junior engineers may still face difficult prospects and that humans may be most useful when work falls outside the models’ distribution.