Amazon opens TorchNeuron to run PyTorch on its Trainium AI chips
Amazon has moved its TorchNeuron tool out of private beta, letting developers run PyTorch code on its Trainium AI chips with a basic configuration change. The software goes open source Tuesday at the PyTorch Conference in San Jose; more than 30 companies took part in the private beta.
- TorchNeuron runs PyTorch on Trainium without rewriting code for Amazon's chip APIs
- More than 30 companies and internal Amazon teams used the private beta
- Deepgram processed about 60% more audio per dollar on Trainium than on GPUs
- Amazon tests the tool nightly against over 100,000 Hugging Face models
Read next
AI