Lemon Slice nabs $10.5M from YC and Matrix to build out its digital avatar tech

Developers and companies are progressively deploying AI agents and chatbots wrong their apps, but truthful acold they’ve mostly been restricted to text. Digital avatar procreation institution Lemon Slice is moving to adhd a video furniture to those chats with a caller diffusion exemplary that tin make integer avatars from a azygous image.

Called Lemon Slice-2, the exemplary tin make a integer avatar that works connected apical of a cognition basal to play immoderate relation required of the AI agent, similar addressing lawsuit queries, helping with homework questions, oregon adjacent moving arsenic a intelligence wellness enactment agent.

“In the aboriginal days of GenAI, my co-founders started to play astir with antithetic video models, and it became evident to america that video was going to beryllium interactive. The compelling portion astir tools similar ChatGPT was that they were interactive, and we privation video to person that layer,” co-founder Lina Colucci said.

Lemon Slice says this is simply a 20-billion-parameter exemplary that tin enactment connected a azygous GPU to live-stream videos astatine 20 frames per second. The institution is making the exemplary disposable done an API and an embeddable widget that companies tin integrate into their sites with a azygous enactment of code. After an avatar is created, you tin alteration the background, styling, and quality of a quality astatine immoderate point.

Besides human-like avatars, the institution is besides focusing connected being capable to make non-human characters to suit antithetic needs. The startup is utilizing ElevenLabs’ tech to make the voices of these avatars.

Founded by Lina Colucci, Sidney Primas, and Andrew Weitz successful 2024, Lemon Slice is betting that utilizing its ain general-purpose diffusion exemplary (a benignant of generative exemplary that learns to enactment backwards from noisy grooming information to make caller data) for making avatars volition acceptable it isolated from competitors.

“The existing avatar solutions I’ve seen to day adhd antagonistic worth to the product,” Colucci said. “They are creepy, and they are stiff. They look bully for a fewer seconds, and arsenic soon arsenic you commencement interacting with them, it feels precise uncanny, and it doesn’t enactment you astatine ease. The happening that has prevented avatars from truly taking disconnected is that they haven’t been bully enough.”

To money that effort, the institution connected Tuesday said it has raised $10.5 cardinal successful effect backing from Matrix Partners, Y Combinator, Dropbox CTO Arash Ferdowsi, Twitch CEO Emmett Shear, and The Chainsmokers.

The institution says it has guardrails successful spot to forestall unauthorized look oregon dependable cloning, and that it uses ample connection models for contented moderation.

Lemon Slice would not sanction the organizations utilizing its technology, but said the exemplary is being enactment to enactment for usage cases similar education, connection learning, e-commerce, and firm training.

The startup faces stiff contention from video procreation startups similar D-ID, HeyGen, and Sythesia, arsenic good arsenic different integer avatar makers Genies, Soul Machine, Praktika, and AvatarOS.

Ilya Sukhar, a spouse astatine Matrix, thinks that avatars volition beryllium utile successful areas wherever videos are prominent. For instance, radical similar learning from YouTube alternatively than speechmaking agelong blocks of text. He noted that Lemon Slice’s method prowess and its ain volition springiness it an borderline implicit different startups.

“It’s a profoundly method squad with a way grounds of shipping ML products, not conscionable demos and research. Many of the different players are bespoke to peculiar scenarios oregon verticals, and Lemon Slice is taking the generalized ‘bitter lesson’ scaling attack (of information and compute) that has worked successful different AI modalities,” helium said.

Y-Combinator’s Jared Friedman believes that utilizing a diffusion-style exemplary allows Lemon Slice to make immoderate benignant of avatars arsenic compared to immoderate different startups that are focused connected either human-like oregon crippled character-like avatars.

“Lemon Slice is, I believe, the lone institution taking the cardinal ML attack that tin eventually overcome the uncanny vale and interruption the avatar Turing test. They bid the aforesaid benignant of exemplary arsenic Veo3 oregon Sora: a video diffusion transformer.  Because it is simply a general-purpose exemplary that does the full happening end-to-end, it has nary ceiling connected however bully it tin get; the others apical retired beneath photorealistic. It besides works for some quality and non-human faces and requires lone an representation to adhd a caller face,” helium said.

The startup presently has 8 employees, and plans to usage the funds to prosecute engineering and go-to-market staff, on with paying the compute bills to bid its models.