Andy Jassy says Amazon’s Nvidia competitor chip is already a multi-billion-dollar business

Can immoderate company, large oregon small, truly topple Nvidia’s AI spot dominance? Maybe not. But determination are hundreds of billions of dollars of gross for those that tin adjacent peel disconnected a chunk of it for themselves, Amazon CEO Andy Jassy said this week.

As expected, the institution announced during the AWS Re:Invent league the adjacent procreation of its Nvidia-competitor AI chip, Trainium3, which is 4 times faster yet uses little powerfulness than the existent Trainium2. Jassy revealed a fewer tidbits astir the existent Trainium in a station connected X that shows wherefore the institution is truthful bullish connected the chip.

He said the Trainium2 concern “has important traction, is simply a multi-billion-dollar gross run-rate business, has 1M+ chips successful production, and 100K+ companies utilizing it arsenic the bulk of Bedrock usage today.”

Bedrock is Amazon’s AI app improvement instrumentality that allows companies to prime and take among galore AI models.

Jassey said Amazon’s AI spot is winning among the company’s tremendous roster of unreality customers due to the fact that it “has price-performance advantages implicit different GPU options that are compelling.” In different words, helium believes it works amended and costs little than those “other GPUs” retired determination successful the market.

That is, of course, Amazon’s classic MO, offering its ain homegrown tech astatine little prices.

Additionally, AWS CEO Matt Garman offered adjacent much insight, successful an interview with CRN, astir 1 lawsuit liable for a large chunk of those billions successful revenue: No daze here, it’s Anthropic.

“We’ve seen immoderate tremendous traction from Trainium2, peculiarly from our partners astatine Anthropic who we’ve announced Project Rainier, wherever there’s implicit 500,000 Trainium2 chips helping them physique the adjacent generations of models for Claude,” Garman said.

Project Rainier is Amazon’s astir ambitious AI clump of servers, dispersed crossed aggregate of information centers successful the U.S. and built to service Anthropic’s skyrocketing needs. It came online successful October. Amazon is, of course, a major capitalist successful Anthropic. In exchange, Anthropic made AWS its superior exemplary grooming partner, adjacent though Anthropic is present besides offered connected Microsoft’s cloud, via Nvidia’s chips.

OpenAI is present besides utilizing AWS successful summation Microsoft’s cloud. But the OpenAI concern couldn’t person contributed overmuch to Trainium’s gross due to the fact that AWS is moving it connected Nvidia chips and systems, the unreality elephantine said.

Indeed, lone a fewer U.S. companies similar Google, Microsoft, Amazon, Meta person each the engineering pieces — silicon spot plan expertise, homegrown high-speed interconnect and networking exertion — to adjacent effort existent contention with Nvidia. (Remember, Nvidia cornered the marketplace connected 1 large high-performance networking tech successful 2019 erstwhile CEO Jensen Huang outbid Intel and Microsoft to bargain Infiniband hardware maker, Mellanox.)

On apical of that, AI models and bundle built to beryllium served up by Nvidia’s chips besides trust connected Nvidia’s proprietary Compute Unified Device Architecture (CUDA) software. CUDA allows the apps to usage the GPUs for parallel processing compute among different tasks. Just similar the Intel vs. SPARC spot warfare of yesterday, it’s nary tiny happening to re-write an AI app for a non-CUDA chip.

Still, Amazon whitethorn person a program for that. As we antecedently reported, the adjacent procreation of its AI chip, Trainium4, volition beryllium built to interoperate with Nvidia’s GPUs successful the aforesaid system. Whether that helps peel much concern distant from Nvidia oregon simply reinforces its dominance, but connected AWS’s cloud, remains to beryllium seen.

It whitethorn not substance to Amazon. If it is already connected way to bash multi-billion-dollars from Trainium2 chip, and the adjacent procreation volition beryllium that overmuch better, it whitethorn beryllium victor enough.