Apple's 'Visual Intelligence' to Target Retail
Apple is reportedly developing "Visual Intelligence" as a core feature for its AI wearables and Vision Pro platform, aimed at transforming retail and frontline operations. The technology would enable AI-powered visual recognition for tasks like shelf scanning and planogram compliance, and is featured in a new internal 'Sales Coach' app. Analysts expect this push into vision-based AI to be a defining feature of the company's AI strategy, potentially changing everything for augmented productivity.
- The new "Sales Coach" app replaces an older internal app called SEED and is designed for Apple Store employees and authorized resellers. It features a new "Liquid Glass" design and will include an AI chatbot to answer product and sales questions. The app provides training modules, sales tips, and product information to standardize and improve customer service. - Apple's broader AI strategy, branded "Apple Intelligence," heavily emphasizes on-device processing to ensure user privacy and reduce latency. This approach leverages the specialized Neural Engine hardware in Apple's own silicon to run complex machine learning algorithms locally. For more intensive tasks, a "Private Cloud Compute" solution is used, which still prioritizes data security. - "Visual Intelligence" is a key feature of this strategy, allowing devices to interpret and act on visual information from the camera or screenshots. Current consumer applications include translating signs, adding events from flyers, and identifying products. CEO Tim Cook has highlighted it as one of the most popular Apple Intelligence features. - The technology is expected to be a core component of future Apple wearables, including new camera-equipped AirPods and smart glasses, moving beyond the iPhone. Apple is reportedly developing its own proprietary visual models for these future devices. - In enterprise settings, particularly retail, the Vision Pro is already being explored for immersive employee training, 3D product visualization, and remote collaboration. Companies like SAP are integrating their business applications with visionOS to enhance data analysis and workflow management. - The retail technology market for visual recognition is active, with companies like Trax, Simbe Robotics, and Scandit offering solutions for inventory management, planogram compliance, and shelf analytics. These systems use AI-powered image recognition from cameras, smart devices, and robots to provide real-time insights into store operations. - This move aligns with a larger industry trend of embedding AI into retail operations to improve efficiency and customer experience. Major brands are already using AI-powered visual recognition to analyze packaging effectiveness and optimize in-store product placement. The market for computer vision in retail is projected to grow significantly, reaching nearly $9.88 billion by 2029. - The "Sales Coach" app launched as an update to the existing "SEED" app on February 23, 2026, and is available to Apple employees and authorized resellers, who need a partner code for registration. The AI chatbot within the app is a forthcoming feature, and it is not yet confirmed if it will use Apple's own large language model or a third-party one.