DE — heise online
NVKE: Nvidia Launches Its Own Kubernetes Engine as Preview
Software2 min read
Nvidia has released NVKE, a new Kubernetes Engine, as a preview on GitHub. It lets companies that run their own GPU data centers offer Kubernetes to their customers as a managed service.
What happened
Nvidia showed its new Kubernetes Engine, called NVKE, as a preview on GitHub. Operators of GPU data centers can use it to give their customers Kubernetes as a managed service, similar to AWS EKS. A central management cluster creates separate Kubernetes clusters on bare-metal servers when customers ask for them. The code is free under the Apache 2.0 license, but Nvidia does not yet recommend NVKE for live production use.
Key facts
- Each customer cluster gets its own control plane, its own etcd database, and its own node pools.
- The management cluster needs an odd number of servers with TPM 2.0 chips, such as one, three, or five.
- The NVKE API listens on unencrypted HTTP port 30080 on every management node.
- New clusters use ovn-kubernetes for networking. Calico is only kept for existing installations.
- NICo, the server-management layer, needs a Kubernetes cluster with at least three nodes.
How it works
NVKE sets up the servers without GPU and fabric software. Nvidia's GPU Operator then installs the drivers and related tools, and Nvidia's AI Cluster Runtime provides the setup recipes. Operators control everything with the nvkectl command-line tool or the NVKE REST API. They can also use the API to scale node pools and install Kubernetes upgrades. For high availability and upgrades, NVKE needs a virtual IP address, which it sets up with kube-vip.
Why it matters
NVKE is a sign that Nvidia wants to make its full hardware and software stack the default for running AI servers. But the preview still has gaps. It has no security roles, so any allowed caller can create or delete any cluster. It also has no tested way to upgrade to a newer NVKE release or to back up and restore the management cluster. Companies that want to try it should add their own TLS encryption and login checks first.
What to watch
- Whether Nvidia adds role-based access control to the API.
- Whether a safe upgrade and backup path arrives before NVKE is ready for production.
- How NVKE compares with open-source tools such as Gardener and Kamaji, which run customer control planes as pods.
Glossary
- Kubernetes
- Software that runs and manages many containers across a group of computers.
- NVKE
- Nvidia's new Kubernetes Engine, which builds and manages customer Kubernetes clusters on GPU servers.
- NICo
- Nvidia Infra Controller, which manages bare-metal servers through software APIs instead of manual steps.
- GPU Operator
- Nvidia tool that installs the drivers and software a GPU needs inside a Kubernetes cluster.
- TPM 2.0
- Trusted Platform Module, a security chip on a server that stores keys and proves the machine's identity.