$60B AI chip darling Cerebras almost died early on, burning $8M a month

Today, Cerebras Systems is simply a nationalist institution that sells AI chips for inference to giants similar OpenAI and AWS. It held a blockbuster IPO connected Thursday, with some of its co-founders billionaires, and ended the week worthy astir $60 billion.

But successful 2019, erstwhile it was 3 years old, it came dangerously adjacent to nonaccomplishment – incinerating a shocking magnitude of money. It was trying to lick a method occupation nary 1 successful the semiconductor manufacture thought could beryllium done. 

“We were spending astir $8 cardinal a month,” laminitis CEO Andrew Feldman told TechCrunch of that period. “At this point, we had incinerated astir $200 cardinal trying to lick 1 method problem.” 

Every fewer weeks, Feldman was forced to marque the achy locomotion of shame to the committee gathering to study different nonaccomplishment and much wealth burned. 

But helium had nary choice. Without a solution, Cerebras was dormant anyway.

It was founded with an thought that was elemental connected paper. The microprocessor manufacture had spent its full 50+ years making CPUs faster and cheaper by cramming much transistors onto a silicon wafer and dicing wafers into ever tinier pieces. But AI required truthful overmuch compute power, galore chips had to beryllium strung unneurotic and past forced to pass with each other. Cerebras’ founders believed turning a whole, adjacent bigger wafer into 1 giant, almighty chip, would enactment faster. 

The occupation was, nary 1 had ever successfully done this before, for immoderate reason, AI oregon not. Orchestrating that galore microscopic physics components onto a larger, but inactive thin, aboveground introduced compounding engineering problems. 

Once Cerebras crossed the archetypal threshold of designing the mega spot and past manufacturing it with TSMC, the squad deed the existent roadblock. 

They couldn’t lick “packaging.” This involves everything aft manufacturing the silicon itself: adhering it to a motherboard, getting powerfulness to it, dealing with heating and cooling arsenic good arsenic the pipes that would present and instrumentality data, Feldman said. 

Cerebras’ chips “were 58 times larger. We were utilizing 40 times arsenic overmuch powerfulness arsenic anybody had ever used,” helium said. There were nary premade vigor sinks. No vendors. No manufacturing partners. The brightest minds successful microprocessor engineering had tried for decades to physique specified big, yet much dense chips, and failed. 

The Cerebras squad was near with proceedings and mistake successful which “we destroyed an tremendous fig of chips” and an tremendous magnitude of cash. But without functional packaging, the spot was useless. 

After exhaustive investigation of each failure, the squad yet solved capable problems: however to chill it and determination information around. In 1 instance, they had to invent their ain instrumentality that could bolt-in 40 screws simultaneously to unafraid the wafer to a committee without cracking it. 

Feldman inactive remembers the time successful July 2019 erstwhile it all, miraculously, worked.

They installed the packaged spot into a computer, turned it connected and the full founding squad (pictured below) “just stood successful the laboratory and stared astatine it,” helium said. “Watching a machine tally is astir arsenic breathtaking arsenic watching overgarment dry. But determination we were watching lights flashing connected the computer, stunned that we'd solved this.” 

“That was 1 of the top moments of my life,” helium said. That's significant, due to the fact that this aforesaid founding squad had antecedently built and sold a pioneering unreality server startup, SeaMicro, to AMD for $334 cardinal successful 2012.

Cerebras Systems founding squad successful 2015: Andrew Feldman, Gary Lauterbach, Michael James, Sean Lie and Jean-Philippe FrickerImage Credits:Cerebras Systems

The time the spot yet worked was besides astir 2 years aft OpenAI had talked to Cerebras acquiring it, which Feldman confirmed to TechCrunch occurred like the publically revealed emails said it did. 

Those talks fell done amidst increasing squabbling among the OpenAI founders, respective of whom are angel investors successful Cerebras. 

Today OpenAI is simply a lawsuit and a partner, having loaned Cerebras $1 cardinal secured by warrants. Those warrants conditionally assistance OpenAI astir 33 cardinal shares of Cerebras’ stock, the S-1 discloses. (33 cardinal shares are worthy implicit $9 cardinal astatine Friday's closing terms of $279.) 

Interestingly, Cerebras besides agreed to not merchantability its wares to circumstantial OpenAI competitors arsenic portion of that indebtedness deal. Feldman wouldn’t corroborate that the evident institution this involves: Anthropic. He did, nevertheless accidental that regularisation is temporary. 

“It's constricted successful time, and it was designed to marque definite that we could get OpenAI the capacity,” helium said.

The information was, Cerebras hasn’t yet grown large capable to grip aggregate fast-growing exemplary makers anyway.  He likened selling AI compute capableness to an all-you-can devour buffet. Instead of trying to worldly itself connected each imaginable customers, “We're going to enactment with portion of the buffet only, and we're going to get comfy with that, earlier we onslaught the rest,” helium said.