New VMware Private AI Lab Opens

WWT and VMware have launched a new Private AI Foundation Lab. The facility is designed for enterprises to test, validate, and operationalize AI services on top of VMware's platform. It's a hands-on way for customers to build out their private AI strategies.

The new lab is a key part of Broadcom's strategy to position VMware Cloud Foundation (VCF) as the default private cloud infrastructure for enterprises tackling AI. This initiative directly addresses enterprise concerns over data sovereignty, compliance, and the unpredictable costs of running GPU-heavy workloads in the public cloud. Under the hood, the Private AI Foundation is built on VCF and integrates NVIDIA's AI Enterprise software. This provides a full stack for running AI workloads, from NVIDIA GPUs and DPUs like the H100 and A100, to the NVIDIA NeMo platform for model development and customization. The architecture is designed to give data scientists self-service access to tools while allowing IT to manage GPU resources efficiently. Broadcom is making VMware Private AI Services a standard component of VCF 9.0, effectively turning it into an AI-native platform at no extra cost. These services include essentials for the AI lifecycle like a Model Store, a Vector Database, GPU Monitoring, and an Agent Builder for creating generative AI applications. This move is a direct challenge to public cloud AI services, emphasizing a lower total cost of ownership (TCO) and greater control. By virtualizing and managing GPUs, enterprises can avoid resource hoarding and fragmentation, which are common issues that drive up costs. The platform allows for multi-tenancy, enabling different business units to securely share a single model instance, mirroring the efficiency of public cloud offerings. The strategy extends to the cloud-native ecosystem, where VMware's vSphere Kubernetes Service (VKS) is now a certified Kubernetes AI Conformant Platform. This ensures interoperability for AI workloads on Kubernetes. Broadcom is also fostering an open ecosystem by expanding hardware certification programs for "VCF AI ReadyNodes" with partners like Supermicro, Intel, and Dell, and embracing open networking standards. For developers, the platform aims to streamline the delivery of AI applications by integrating tools like GitOps, Argo CD, and Istio Service Mesh directly into VCF. This approach balances developer autonomy with centralized IT control, a critical factor as more enterprises move AI projects from experimentation to production. Broadcom's partnership with Canonical will also bring trusted open-source software to VCF, further accelerating modern and AI application development.

Get your own daily briefing

Scout delivers personalized news, insights, and conversations tailored to your role and industry.

Download on the App Store

Shared from Scout - Be the smartest in the room.