Broadcom Unveils VMware AI Factory to Provide Faster Time to Production AI and Greater Control Over AI Tokenomics
Broadcom Inc., a global technology leader in semiconductor and infrastructure software solutions, is introducing VMware AI Factory—the software-defined foundation of VMware Private AI Cloud.
According to Broadcom, VMware AI Factory provides customers with a simplified path to production AI with new automation innovations for deploying AI-ready infrastructure and supporting Day 2 operations.
“Enterprises want to run AI where their data lives, but the journey from metal to model is slow, complex, and expensive,” said Paul Turner, chief product officer, VMware Cloud Foundation Division, Broadcom. “VMware AI Factory changes that. We give customers a software-defined foundation that automates infrastructure deployment, unifies lifecycle management, and lets them choose their preferred hardware and vetted models. The result is faster time to first model, predictable private cloud costs, and better control over AI tokenomics.”
VMware AI Factory brings AI applications directly to enterprise private data within a secure private cloud environment. VCF’s infrastructure automation capabilities can reduce the time from bare metal server deployment to serving the first AI model from weeks to a matter of hours, the company said.
VMware AI Factory streamlines AI infrastructure management by fully automating hardware provisioning, software stack enablement, and end-to-end lifecycle management. By integrating hardware and software operations into a unified, automated solution, organizations can rapidly scale AI workloads while minimizing operational complexity.
As part of the VMware AI Factory, private AI services help make AI operational, governable, and cost-effective. VCF pools and shares GPU resources across the organization so teams can run multiple models on shared hardware instead of dedicating infrastructure to each workload.
Enterprises can pivot to new models while keeping costs low through shared infrastructure and governed models-as-a-service. New and forthcoming private AI services include:
- Multi-tenant Model Sharing: Model Runtime now supports secure sharing of AI models between tenants or lines of business through isolated namespaces, maintaining data privacy while eliminating redundant model deployments that waste GPU allocation and infrastructure resources.
- AI Gateway: Unified model governance between on-premises and cloud environments through a single consumption interface, enabling access to locally hosted models with enhancements such as intelligent prompt routing, token and usage rate-limiting, and application authorization.
- Secure AI Sandboxes and Governance: Secure virtualized container spaces will isolate dynamic agent-generated code execution, with a control layer defining how agents are invoked, what tools they access, and how their outputs are validated before being acted upon.
To further streamline VCF AI Factory deployment, Broadcom is announcing a new partnership with MetalSoft to deliver integrated heterogeneous bare metal automation for VCF that drops bare-metal provisioning time from weeks to minutes, the company said.
VMware AI Factory combines VMware Cloud Foundation (VCF) with certified Dell PowerEdge servers and VCF AI ReadyNodes from Cisco, Lenovo, Supermicro and others, and customers preferred AI software and accelerator architectures.
Broadcom and AMD are collaborating to deliver a VMware AI Factory that pairs VCF with AMD Instinct GPUs and the open AMD ROCm software ecosystem
“Enterprises adopting AI need freedom to choose their infrastructure without locking into a single vendor stack,” said Suresh Andani, corporate vice president, Compute and Enterprise AI Group, AMD. “Pairing AMD Instinct MI350 Series GPUs with the open ROCm software ecosystem on VMware Cloud Foundation gives customers a validated path to private AI with predictable economics and no per-token pricing. This collaboration lets organizations run production AI where their data lives while maintaining choice and control over their full stack.”
For more information about this news, visit www.vmware.com or www.broadcom.com.