Leadership Insight: The Shift to Problem Definition
As AI tools create exponential productivity shifts in coding, the role of engineering leadership is evolving. One tech leader argues that the most critical skill for leads is shifting from detailed code review to the strategic work of problem definition and system design.
The proliferation of generative AI is leading to significant productivity boosts, with some studies showing developers can complete coding tasks up to twice as fast. This efficiency gain, however, is not uniform; experienced programmers benefit the most, while those with less experience see minimal improvement. Consequently, the focus of engineering leadership is shifting from granular code implementation to the more strategic task of ensuring the right problems are being solved in the first place. This shift elevates the importance of frameworks for problem definition, such as the "5 Whys" and root cause analysis. Defining the gap between the current and desired state in a measurable way prevents wasted effort on solving the wrong issues. A bug discovered during the requirements phase is estimated to be 70 times less costly to fix than one found in the field, highlighting the economic imperative of strong upfront problem definition. Within Apple's ecosystem, this strategic focus aligns with the tight integration of hardware and software. The introduction of the Apple Neural Engine in the A11 Bionic chip, capable of 600 billion operations per second, has evolved to the A17 Pro's 35 trillion operations per second, enabling powerful on-device AI. This hardware advantage, combined with frameworks like Core ML and Metal, allows for complex AI workloads to run locally, making the definition of power-efficient, high-impact problems paramount. The on-device AI market is projected to reach $160.24 billion by 2029, driven by the need for enhanced data privacy and reduced latency. For a company like Apple, this trend underscores the importance of system design that leverages the unique capabilities of its silicon, such as the unified memory architecture. Engineering leaders must therefore guide their teams to define problems that can be solved optimally within the constraints and advantages of this integrated hardware. In parallel, AI and machine learning are revolutionizing manufacturing and supply chain management, areas critical to Apple's operations. Machine learning algorithms can now forecast demand with high accuracy, optimize inventory levels, and plan efficient delivery routes, reducing waste and cutting costs. By 2025, it's predicted that over half of supply chain organizations will use machine learning to augment their decision-making. This presents an opportunity for engineering leaders to influence cross-functional teams by defining problems that apply on-device AI principles to optimize these complex, real-world systems.
