EXPLORINEER
en

US — TechCrunch

Amazon is taking its biggest shot at Nvidia yet with new TorchNeuron dev tool

AI1 min read

Amazon released TorchNeuron, a tool that helps AI apps written in PyTorch run on Amazon's own AI chip, Trainium. It is a direct challenge to Nvidia's strong hold on AI hardware.

What happened

Amazon Web Services (AWS) released a new developer tool called TorchNeuron. It helps AI startups move their apps onto Amazon's Trainium chip. Developers can switch an app to Trainium by changing one line of settings, and they do not need to rewrite the code.

Key facts

  • Amazon says about 85% of AI apps are written with PyTorch.
  • PyTorch has been part of the Linux Foundation since 2022. Facebook first built it.
  • Deepgram, an AI voice app company, says it processes 70% more audio per dollar after moving to Trainium.
  • Apps written in PyTorch can also run on AMD GPUs or Apple chips with a simple setting change.

Why Nvidia is so strong

Nvidia's CUDA software lets apps run on Nvidia chips. Nvidia has spent years making sure PyTorch works well with CUDA. So many AI apps now run best on Nvidia hardware by default. That is a big reason Nvidia is the top choice for AI chips.

Why it matters

Amazon is trying to break Nvidia's software advantage. If it is easy to move apps to other chips, companies may have more choices and maybe lower costs. Amazon also says it will change PyTorch's code so it is less tied to Nvidia. Some experts worry this could make PyTorch harder to use, so the results are not yet clear.

What to watch

  • Whether Amazon's code changes to PyTorch are accepted by the main project.
  • Whether startups actually move to Trainium and save money.
  • Whether developers get more choice, or just more setup problems.

Glossary

TorchNeuron
A tool from Amazon that helps PyTorch AI apps run on Amazon's Trainium chip.
Trainium
Amazon's own custom chip for training and running AI models.
PyTorch
A free, open-source toolkit developers use to build, train, and run AI models.
CUDA
Nvidia's software that lets apps run on Nvidia chips.
Amazon Web Services (AWS)
Amazon's cloud computing company that rents computers and tools over the internet.
Linux Foundation
A nonprofit group that maintains many open-source software projects.

More in this topic

AIZDNet Korea

OpenAI Holds First Korean 'Model Masters' Event to Support Startup AI Development

OpenAI held its first 'OpenAI Model Masters' event in Korea on the 23rd at its Seoul office, where 11 startups demonstrated services built on its models. The program, which provides API credits to startups recommended by venture capitalists, aims to help turn AI ideas into real products. OpenAI highlighted the selected startup Cutback's video-editing work as a standout example.

AITechCrunch

Grok releases the first seven minutes of its AI-generated ‘Odyssey’

Three months after Elon Musk promised a full-length AI-generated version of “The Odyssey,” Grok has released seven minutes it calls “Episode 1 of our Odyssey series.” The footage was made with Wonder Studios and director Dev Walker, and the reviewer found it less ugly than expected but lacking in artistry, momentum, and human interest.