Can AI data centers be mass-produced like cars? This startup aims to find out

AI infrastructure institution Runware is making quality again, conscionable months aft unveiling the Sonic Inference Pod, a modular information center built successful a mill and shipped to customers acceptable to install. Now the institution has bigger plans. It told TechCrunch it wants to physique a mill that assembles these pods connected a accumulation line, arsenic if they were cars.

The thought isn’t wholly new. Companies similar Crusoe and Schneider Electric besides merchantability prefabricated pods, but Runware says it tin vessel its pods faster. 

Flaviu Fadulescu, co-founder and CEO of Runware, told TechCrunch that the institution plans to standard accumulation astatine its Romania-based mill to 30 megawatts of information halfway capableness per time by 2028, oregon astir 1 gigawatt per month. That’s a full batch of capacity: astatine that pace, Runware would nutrient astir arsenic overmuch successful a twelvemonth arsenic the full U.S. was expected to adhd successful information halfway powerfulness this year, about 10 gigawatts. But it besides reflects an industry-wide propulsion to deploy information centers faster much efficiently. 

Nvidia announced, for example, the Vera Rubin AI factories and the DSX POD earlier this year. Both are besides meant to marque it faster and easier for companies to physique their ain AI information centers. The quality with Runware, though, is that it says it has really built a mill alternatively than conscionable designed the infrastructure that would fto others physique one. 

Fadulescu said Runware volition gradually summation accumulation starting adjacent twelvemonth and that it already has 2 factories — 1 it has utilized for a fewer years to physique the pods, and a 2nd it started gathering earlier this year. The 2nd is expected to beryllium finished wrong months and spell online aboriginal adjacent year. 

Runware volition manufacture the modular information centers connected an assembly line. Customers tin supply their ain tract to assemble them, oregon Runware tin find 1 for them. Fadulescu said Runware aims to bring the pods online wrong 48 hours. That clip covers installation and set-up time, not physique time. A pod erstwhile took 3 weeks to physique but it volition soon instrumentality 1 time arsenic it ramps up production, says the company. Runway volition supply spare parts if components fail. Customers tin besides rent compute from Runware oregon proviso their ain GPUs and wage a monthly interest for the pods and operations. Power and net are charged separately, helium said. 

The pods tin besides beryllium customized to lawsuit preferences, helium said. The pods person a modular design, but tin beryllium configured to conscionable lawsuit requirements and the latest GPU chips. Chips tin instrumentality a agelong clip to get aft they’re ordered, which works successful Runware’s favor. “Our pod transportation times are besides shorter than existent GPU pb times, giving america clip to accommodate the infrastructure to the hardware being ordered,” helium said. “For caller GPU generations, our in-house hardware squad tin design, build, and trial components itself, allowing america to accommodate quickly.” 

Right now, these are each plans — execution is the test. The mill volition request a batch of people, inventory, proviso concatenation logistics, and money. There are cautionary tales astir reinventing manufacturing, notably the electrical conveyance startup Arrival, erstwhile valued astatine over $13 billion, which struggled to mass-produce electrical vehicles cost-effectively compared with accepted plants. Runware, which has raised much than $60 cardinal to date, said it plans to rise a Series B, but for present it is finishing and launching the mill with the $50 cardinal Series A it raised past December.

“Our outgo operation is precise different,” Fadulescu said, explaining however Runware seeks to debar Arrival’s fate. “We bash person headcount and materials cost,” helium continued. “But our mill unit is cost-effective comparative to the worth of deploying compute for AI.” He besides said that designing its ain systems and buying wide available, affordable parts helps support costs low. “We’ve brought successful a highly experienced works manager from the automotive manufacture to enactment alongside our main of hardware and assistance america get that execution right.”

Sourcing components could besides beryllium a challenge. Though Runware says it designs and builds its ain cooling and different pod systems with modular components, immoderate parts, specified arsenic pumps and fans, travel from Germany, and it inactive depends connected Nvidia for networking. Still, Runware claims it has received $1 cardinal successful committed involvement for its Sonic pods since it began offering them to extracurricular customers a period ago, “representing implicit 20 megawatts, which we’re present moving to deliver,” Fadulescu said.

Data centers successful the U.S. and overseas person travel nether occurrence for however overmuch vigor they devour and however that affects the grid and different resources. When pressed, Fadulescu said his company’s pods lone request powerfulness and an net connection. They’ll usage a closed-loop liquid cooling strategy with air-cooled radiators to merchandise heat, truthful they don’t truly request a h2o connection. “We’re moving with powerfulness providers connected a tract pipeline covering 397 megawatts, with imaginable to grow to 1.2 gigawatts,” helium said, referring to its database of planned sites and adding that the institution is deploying its modular information centers connected sites that are overmuch smaller than those utilized by hyperscalers similar Amazon, Microsoft, and Google.

The sites, helium continued, typically already person power, truthful they shouldn’t further strain the grid oregon disrupt the community. The pods besides tally “completely soundless up to temperatures of 86 degrees Fahrenheit. We usage vigor from renewable sources whenever possible,” helium continued. “We are actively moving connected expanding our web of vigor providers and sites. We’re aiming to person renewables arsenic our main vigor source.”

Next, Runware volition bring its caller mill online aboriginal adjacent year, past grow to the U.S. and different regions worldwide. Modular systems are the aboriginal and volition soon go “the modular for ample AI deployment,” Fadulescu said.

“Customers should beryllium capable to program a hyperscale information halfway astir factory-built pods from the opening and person it moving successful months alternatively of years,” helium added.