Google Cloud launches two new AI chips to compete with Nvidia

Google Cloud connected Wednesday announced that its eighth procreation of custom-built AI chips, oregon tensor processing units (TPUs), volition beryllium divided successful two. One chip, named the TPU 8t, volition beryllium geared for exemplary grooming and another, the TPU 8i, is aimed astatine inference.

Inference is the ongoing usage of models, aka what happens aft users taxable prompts.

As you mightiness expect, the company touts immoderate awesome show specs for these caller TPUs compared to the erstwhile generations: up to 3x faster AI exemplary training, 80% amended show per dollar, and the quality to get 1 million+ TPUs to enactment unneurotic successful a azygous cluster. The upshot should beryllium a batch much compute for a batch little vigor — and outgo to customers — than erstwhile versions. It calls these chips TPUs, not GPUs, due to the fact that its customized low-power chips were primitively named Tensor.

But Google’s chips are not a afloat frontal battle connected Nvidia’s future, astatine slightest not yet. Like the different elephantine unreality providers, including Microsoft and Amazon, Google is utilizing these chips to supplement the Nvidia-based systems it offers successful its infrastructure. It is not flat-out replacing Nvidia. In fact, Google promises its unreality volition person Nvidia’s latest chip, Vera Rubin, disposable aboriginal this year.

One time the hyperscalers gathering their ain AI chips (which includes Amazon, Microsoft and Google) whitethorn turn to request Nvidia less, arsenic enterprises determination their AI needs to their clouds and larboard their apps to these chips.

Still, arsenic things basal today, it’s not profitable to stake against Nvidia. As notable spot marketplace expert Patrick Moore jokingly posted connected X, helium had predicted that Google’s TPU could beryllium atrocious quality for Nvidia (and Intel) backmost successful 2016 erstwhile the hunt elephantine launched its archetypal one. Nvidia is present a astir $5 trillion marketplace headdress company, meaning that prediction didn’t precisely clasp up to the trial of time.

If each goes according to Nvidia’s plan, Google’s maturation arsenic an AI unreality supplier would effect successful much concern for the spot shaper not less, adjacent if galore a workload runs connected Google’s chips.

In fact, Google besides says it has agreed to enactment with Nvidia to technologist machine networking that allows Nvidia-based systems to execute adjacent much efficiently successful its cloud. In particular, the 2 tech giants are moving to beef up the software-based networking tech called Falcon, which Google created and unfastened sourced successful 2023 under the godfather of each unfastened root information halfway hardware organizations, the Open Compute Project.