AI personalization vs. automation risk

Flipkart is pushing artificial intelligence deeper into shopping, while a separate company’s reported $6 million failure showed what can break when humans are cut out. (business-standard.com) (economictimes.indiatimes.com) Flipkart Chief Executive Kalyan Krishnamurthy told employees in an internal note reviewed by Business Standard that artificial intelligence is now “central” to how the Walmart-owned company builds products, serves customers, and improves efficiency. The company named Hemant Badri to lead an “AI Transformation Charter” across supply chain, quick commerce, customer experience, and recommerce. (business-standard.com) In interviews published on April 12, 2026 and October 7, 2025, Flipkart executives said the company is using real-time signals from browsing, search, and video watching to update recommendations within a session instead of processing them hours later. Flipkart also said it is applying artificial intelligence to search, review summaries, demand forecasting, fraud detection, routing, and seller tools. (fortuneindia.com) (stories.flipkart.com) (enterpriseai.economictimes.indiatimes.com) That kind of personalization means software studies what a shopper clicks, searches, watches, or buys and then rearranges products, offers, and content to match that behavior. In retail, the pitch is simple: show more relevant items faster and reduce the number of steps between browsing and checkout. (fortuneindia.com) (stories.flipkart.com) The risk shows up when companies move from using artificial intelligence as an assistant to using it as a replacement for human review. Business Standard reported that Krishnamurthy paired Flipkart’s artificial intelligence push with a “human-in-the-loop” warning, saying technology should sharpen human intuition rather than replace it. (business-standard.com) The caution landed as The Economic Times highlighted a viral account on X about a company that removed its 12-person quality assurance team and installed an artificial intelligence testing system to save about $1.2 million a year. The report said the system later generated a faulty discount code that priced products at zero and led to nearly $6 million in losses. (economictimes.indiatimes.com) Quality assurance is the part of software work that checks whether a product behaves as intended before customers see it. In an online store, that can mean testing prices, coupons, checkout flows, inventory rules, and edge cases that can turn a small bug into a companywide loss. (economictimes.indiatimes.com) The Economic Times said the same company’s chief executive then asked a senior developer to contact the laid-off head of quality assurance for unpaid help fixing the problem. The newspaper attributed the account to a software professional’s post on X that had drawn more than 1 million views by April 12, 2026. (economictimes.indiatimes.com) Other companies have already run into similar limits. In May 2025, Klarna Chief Executive Sebastian Siemiatkowski said the company would add more human customer service after earlier artificial intelligence-driven cuts, saying the cost focus had produced “lower quality” support. (independent.co.uk) The split is becoming clearer: retailers want artificial intelligence to decide what shoppers see, but they are moving more carefully where errors hit money, trust, or operations. Flipkart’s own public line is that artificial intelligence should sit at the core of the business with a human still in the loop. (business-standard.com)