PM Frameworks are 'Gut Decisions Dressed as Science'
A product management expert confessed that popular PM frameworks like RICE, ICE, and Kano rarely work in practice. They argued most prioritization is just "gut decisions dressed as science," and recommended focusing instead on core questions like problem validation and shipping small.
The critique of product management frameworks like RICE and ICE centers on their subjectivity. Factors like "Impact" and "Confidence" are often assigned numerical values based on opinion rather than objective data, which can lead to scores reflecting personal biases or the most persuasive person in the room. This creates a veneer of data-driven decision-making that may simply be justifying a predetermined gut feeling. The ICE framework, created by author and startup advisor Sean Ellis for growth-hacking teams, prioritizes speed and learning by evaluating Impact, Confidence, and Ease. However, its simplicity is also a key limitation; it doesn't account for the number of users an initiative will affect, a factor the RICE framework attempts to solve by including "Reach." Both frameworks can oversimplify complex decisions and may not be suitable for long-term strategic planning. The Kano model, developed in the 1980s by Noriaki Kano, categorizes features into Must-haves, Performance, and Attractive attributes to gauge their effect on customer satisfaction. While useful for understanding customer perceptions, critics argue that for tech products, these categories can be difficult to distinguish. Furthermore, the model's results can be unstable with small sample sizes, and customer expectations change over time, turning "delightful" features into basic expectations. The core issue is that frameworks are often misapplied as a substitute for critical thinking rather than a tool to guide it. They are most effective after the initial discovery and validation phases to compare already well-understood ideas. The goal of these tools isn't mathematical precision but to facilitate a clear and defensible decision-making process. Ultimately, many seasoned product leaders advocate for a balance between data and informed intuition. Data is crucial for validating hypotheses and optimizing existing processes, but innovative leaps often stem from a deep understanding of customer problems. The most effective product managers combine quantitative analysis with the pattern recognition they've developed through experience.
