EXPLORINEER
en

UK — The Register

Qualcomm offers test drive of its rack-scale Nvidia AI challenger

Chips1 min read

Qualcomm has opened cloud trials of its Dragonfly AI200 server rack to selected customers. The goal is to run AI models with less power than Nvidia's systems.

What happened

Qualcomm let chosen customers test its Dragonfly AI200 rack-scale system over the cloud. The test runs on Cirrascale's AI Innovation Cloud. Cirrascale also showed the system at the SC26 computer conference in Chicago on November 17 and 18. Qualcomm says customers who like the results may move on to full production use.

Key numbers and facts

  • Each AI200 accelerator card (a chip board that speeds up AI work) has 768 GB of LPDDR memory.
  • 56 cards together give about 43 TB of memory in one liquid-cooled rack.
  • Qualcomm says the system can run AI models from 7 billion to 10 trillion parameters (the numbers that set how a model learns).
  • The Dragonfly line also includes the AI250 and AI300 accelerators and the C1000 server CPU.

Background

AI inference means using a trained AI model to answer questions or make outputs. It is becoming one of the biggest jobs in data centers, the huge buildings full of computers. Nvidia leads this market. Its Blackwell-based NVL72 systems use fast but expensive HBM3e memory. Qualcomm chose LPDDR memory instead, which is more common in phones. This keeps costs and power use lower, but it does not automatically match Nvidia's speed.

Why it matters

AI systems use huge amounts of electricity, and running costs can be very high. If Qualcomm's approach saves power and money, more companies may pick it instead of Nvidia. The test will show whether the promised savings are real.

What to watch

  • Whether test customers report real power and cost savings.
  • Whether the AI200 can match Nvidia's speed on real AI tasks.
  • Whether the trials turn into full production deployments.
  • How the Dragonfly AI Infrastructure Management Suite software performs in large setups.

Glossary

Qualcomm
A chip company that makes processors for phones and now also for data centers.
Cirrascale
A cloud company that rents AI computing power to customers and offers test access to new systems.
Nvidia
A chip company and the leader in making chips used for AI.
LPDDR
A type of low-power memory that is more common in mobile phones.
HBM3e
A type of fast but costly memory stacked close to the chip, used in high-end AI systems.
Dragonfly AI Infrastructure Management Suite
Qualcomm's software for setting up, watching, and managing AI racks.

Ad

Add 150 words. Learn 10 a day.

Dicter word books send only the words you learn to your review notes.

ChipsThe Register

Chinese web giant Tencent says new US GPU ban ‘sets everyone back in China’

Tencent president Martin Lau said the new US ban on Chinese companies remotely accessing GPUs will hurt in the short term but will ultimately push China to speed up domestic alternatives. He said the ban will affect Tencent's model training and GPU rentals, while made-in-China chips should be able to handle inferencing workloads.

ChipsThe Register

Business as usual, but Huang ain't coming back, says Nvidia

Nvidia's board says it has no plans to bring back Jensen Huang as CEO after he resigned last week, and it is strengthening oversight and searching for a new leader. Interim CEO Colette Kress reported quarterly revenue up 103 percent to $115.8 billion and raised the fiscal 2028 growth outlook to about 75 percent, though analysts questioned the company's future direction.

ChipsTechCrunch

Nvidia clarifies when it will — and won’t —keep financing neoclouds

Nvidia CFO Colette Kress, now interim CEO, said on the quarterly earnings call that the company's loan guarantees, such as the $105 billion backstop for OpenAI's PORTS-Pike Ohio data center campus, take effect only after the customer has secured the financing and equipment needed to build the facility. If a project is delayed or fails to meet those conditions, the guarantee "doesn't exist anymore." Kress said Nvidia will be far more selective about financing customers going forward, though it is not pulling back entirely.

ChipsZDNet Korea

"No Return for Jensen Huang"…Why Nvidia Turned Its Back on Its Founder

Speculation persists that Jensen Huang could return as Nvidia CEO after he stepped down over an extramarital affair controversy, but Nvidia board chair Harvey Jones said the board unanimously accepted his resignation and has no intention of reinstating him. Analysts point to the company's CEO-centric governance, the unresolved national security concern over the alleged Chinese intelligence link of one of the affair partners, and the ethics violation tied to the other affair involving a junior employee as reasons the board is unlikely to reverse course.