AI Product Development Urged to Start with 'Uncomfortable' Customer Talks

Podcast host Ryan Estes recently cautioned AI founders against building products based on intuition rather than customer evidence. He advised, "If you cannot survive 10 uncomfortable customer conversations, you do not deserve to write a single line of code." Estes stressed that for agentic AI, validation must come from solving authentic, high-friction problems for users.

- Agentic AI represents a significant step beyond generative AI; instead of just creating content, these systems can autonomously plan and execute multi-step tasks to achieve a goal with limited human supervision. This is often accomplished by orchestrating multiple specialized AI agents that can reason, adapt to new information, and use external software tools. - A primary challenge in developing agentic AI is the complexity of multi-agent coordination, where different AI agents—like a "planner" and an "executor"—can produce conflicting instructions or get stuck in loops, failing to complete a task. Other significant hurdles include managing the high operational costs of numerous LLM calls, ensuring reliability against hallucinations, and integrating with legacy enterprise systems. - Within the user's domain of HR technology, one study found that AI and automation could replace more than half (52%) of a rewards team's workload, particularly in areas like benefits administration and responding to routine employee inquiries. Another survey revealed that while about a quarter of firms are already using AI for rewards applications, 40% anticipate using it to determine base salaries and performance-based incentives in the future. - The Chief Product Officer (CPO) role is evolving to require a deeper understanding of AI's technical and ethical implications, moving beyond just product strategy. CPOs are now expected to have working knowledge of model selection, navigate data privacy risks, and lead hybrid teams, as AI proficiency becomes a key factor in driving competitive advantage and innovation. - A major risk in deploying agentic AI in regulated fields like compensation is inheriting and scaling bias from training data, which can lead to discriminatory outcomes in pay and promotion decisions. To mitigate this, product leaders are embedding "human-in-the-loop" checkpoints for high-stakes decisions and implementing proactive audits to ensure fairness and compliance. - Looking ahead, Gartner predicts that by 2028, agentic AI will autonomously make 15% of daily work decisions, a significant increase from almost none today. This highlights the accelerating shift from AI as a tool for generating content to a system that executes complex business workflows. - While AI can accelerate customer discovery by synthesizing feedback and identifying market trends, founders are cautioned that it does not replace direct customer interaction. Research shows that 42% of startups fail due to a lack of market need, underscoring the risk of building products without validating them through direct, and often uncomfortable, customer conversations.

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.