MIT Sloan: gen‑AI tools help juniors most
MIT Sloan reported that generative AI code tools boost junior developers’ coding throughput the most, and warned enterprises not to replace juniors wholesale. The finding reframes hiring choices: tool‑augmented juniors can be high‑leverage, but orgs still need governance and senior oversight.
A set of randomized controlled trials covering GitHub Copilot deployments at Microsoft, Accenture, and an anonymous Fortune 100 electronics firm evaluated just under 5,000 developers (4,867) and measured a 26.08% increase (SE: 10.3%) in completed tasks for those with access to the tool. (economics.mit.edu) The experiments found that less‑experienced developers both adopted the coding assistant at higher rates and showed larger productivity gains than senior engineers in the same trials. (economics.mit.edu) Controlled lab work used by GitHub and Microsoft showed much larger single‑task effects—developers completed a JavaScript HTTP‑server task 55.8% faster in a Microsoft Research experiment, and GitHub’s enterprise analyses reported roughly a 55% faster task resolution in specific tests. (arxiv.org) MIT Sloan Management Review’s reporting flags a countervailing risk: rapid, widespread deployment in brownfield systems can compound technical debt and destabilize scalability, and the authors explicitly call for clear usage guidelines, technical‑debt prioritization, and targeted developer training. (sloanreview.mit.edu) A separate MIT Sloan study led by Professor Kate Kellogg (published June 13, 2024 with research partners including Boston Consulting Group and Hila Lifshitz) found junior professionals are not a reliable substitute for structured upskilling of senior staff because juniors often lack the expertise to surface AI’s novel risks. (mitsloan.mit.edu) Taken together, the field evidence quantifies measurable throughput gains (26.08% in the multi‑company RCT; ~55% in lab/enterprise tests) while also underpinning MIT Sloan’s governance prescription: retain senior oversight, enforce code review and technical‑debt controls, and invest in formal training rather than relying on informal peer teaching. (economics.mit.edu)
