Experts Urge Caution on AI Chatbots for Advice
As AI chatbots become more sophisticated, experts at Yale caution that they should be used as supportive tools rather than authoritative sources. For commerce platforms, this highlights the need for clear human oversight and escalation paths to human agents, especially when dealing with customer trust or high-stakes decisions.
- A major Oxford study found that top-performing AI models like GPT-4o achieved only 64.7% accuracy in recommending appropriate patient action, while others like Llama 3 fell below 50%. Researchers noted that chatbots often provide a dangerous mix of good and bad advice that users struggle to distinguish between. - AI's tendency to "hallucinate" can extend to creating fake citations to support its advice. In one analysis of chatbot responses for musculoskeletal health information, researchers found 10 faulty links that were either non-functional or led to incorrect articles. - Meta's strategy in India is heavily focused on conversational commerce, positioning WhatsApp as the primary hub for customer discovery, interaction, and transactions. To support this, Meta is rolling out AI-powered advertising tools; quick-commerce company Zepto reported an 18% lower customer acquisition cost after implementing them. - As of July 2025, Meta fully transitioned the WhatsApp Business API to a per-message pricing model, moving away from the previous conversation-based structure. This requires businesses to be more strategic about outbound messages, as marketing templates incur higher costs than utility or authentication messages. - For hyperlocal businesses, AI is being used to optimize logistics and demand forecasting as the sector expands into Tier-II and Tier-III cities. The Indian hyperlocal delivery market is projected to grow at a compound annual growth rate (CAGR) of 51.84% between 2021 and 2025. - To reduce checkout friction, fintech providers are using AI to improve UPI payment success rates. Features include AI-powered routing to the best-performing bank gateways and real-time validation of Virtual Payment Addresses (VPAs) to prevent failures from typos. - WhatsApp policy enforcement in India is stringent, with the company banning over 71 lakh business accounts in November 2023 alone for violations. The company is also under scrutiny by the Competition Commission of India (CCI) regarding its 2021 privacy policy update and data-sharing practices with Meta. - For Indian D2C brands, achieving a healthy gross margin of 40-60% is considered essential to cover variable costs like logistics and marketing. Mastering unit economics is critical as rising customer acquisition costs and competition are primary drivers of startup failure.
