ByteDance’s new AI video generation model, Dreamina Seedance 2.0, comes to CapCut

OpenAI whitethorn beryllium dialing backmost its efforts successful the video procreation marketplace with the shutdown of its Sora app, but ByteDance connected Thursday confirmed that its caller audio and video model, Dreamina Seedance 2.0, is present rolling retired successful its editing platform, CapCut.

ByteDance says the exemplary allows creators to draft, edit, and sync video and audio contented by utilizing prompts, images, oregon notation videos.

The phased rollout volition statesman with CapCut users successful Brazil, Indonesia, Malaysia, Mexico, the Philippines, Thailand, and Vietnam, with much markets added implicit time.

The quality of the motorboat successful CapCut follows a caller study that said the model’s planetary rollout would beryllium paused, portion it worked to code intelligence spot issues that drew criticism from Hollywood implicit alleged copyright infringement. That apt explains the constricted fig of markets wherever the exemplary is presently disposable wrong CapCut.

In China, the exemplary is disposable to users of ByteDance’s Jianying app.

Image Credits:ByteDance

The video procreation exemplary works without notation images, adjacent if the creator lone uses a fewer words to picture the country they person successful mind, ByteDance says successful its announcement. CapCut is besides bully astatine rendering realistic textures, movement, and lighting crossed a scope of ocular perspectives and angles, which the institution notes could beryllium utilized to edit, enhance, oregon close creators’ ain footage.

Another usage lawsuit would beryllium allowing creators to trial imaginable ideas based connected aboriginal concepts oregon sketches earlier filming the existent video.

In addition, Dreamina Seedance 2.0 tin beryllium utilized for a wide scope of content, including cooking recipes, fittingness tutorials, concern oregon merchandise overviews, and videos with question oregon action-focused content, wherever AI video models person historically faced challenges, the institution explains.

At launch, the exemplary supports clips of up to 15 seconds agelong crossed six facet ratios.

Image Credits:ByteDance

In CapCut, the exemplary volition rotation retired crossed antithetic areas, including editing features specified arsenic AI Video and procreation tools similar Video Studio. It volition besides travel to ByteDance’s AI procreation platform, Dreamina, and its selling platform, Pippit.

Given its quality to make realistic content, ByteDance says it has added information restrictions, truthful the exemplary won’t person the quality to marque videos from images oregon videos that incorporate existent faces. CapCut volition besides artifact the usage of unauthorized procreation of intelligence property. (However, if the restrictions were moving properly, the exemplary would beryllium disposable present successful the United States. Likely, much tweaks are inactive being made.)

The contented produced by Dreamina Seedance 2.0 volition besides see an invisible watermark, which volition assistance to place contented made with the exemplary erstwhile it’s shared off-platform, ByteDance added. This could assistance successful things similar takedown requests from rights holders successful the lawsuit that the exemplary allowed copyright contented through.

ByteDance says it volition spouse with experts and originative communities arsenic the exemplary rolls retired to iterate and amended upon the model’s capabilities.