ByteDance has confirmed the rollout of its new audio and video generation model, Dreamina Seedance 2.0, within its editing platform, CapCut. This launch comes as OpenAI appears to be scaling back its video generation initiatives, notably with the closure of its Sora app. Users in Brazil, Indonesia, Malaysia, Mexico, the Philippines, Thailand, and Vietnam will be the first to experience the features of Dreamina Seedance 2.0, with additional markets to follow over time.
The model enables creators to draft, edit, and synchronize video and audio content using prompts, images, or reference videos. ByteDance’s announcement highlights the model’s ability to generate realistic textures, movement, and lighting, even when merely a few words are used to describe a scene. This functionality is designed to assist creators in enhancing their own footage, as well as testing concepts based on initial ideas before actual filming.
As the launch unfolds, CapCut users are set to benefit from various editing features, including AI Video and generation tools like Video Studio. The model is also integrated into ByteDance’s AI generation platform, Dreamina, and its marketing platform, Pippit. Despite initial reports suggesting a pause in the global rollout due to intellectual property concerns raised by Hollywood, ByteDance is pressing forward, albeit with limited availability in select markets.
The introduction of Dreamina Seedance 2.0 is significant, as it addresses a wide range of content creation needs, including cooking tutorials, fitness videos, and business presentations. Unlike previous AI video models that struggled with motion or action-based content, this model boasts improved capabilities in these areas. Currently, the model supports video clips of up to 15 seconds across six aspect ratios.
ByteDance has also implemented safety measures to prevent unauthorized use of images or videos featuring real faces. Content generated by the model will feature an invisible watermark, enabling the identification of material produced through Dreamina Seedance 2.0. This measure aims to facilitate copyright protections and assist rights holders in addressing potential infringements.
In China, the model is already available to users of ByteDance’s Jianying app, reflecting the company’s commitment to expanding its AI-driven offerings. As it moves forward, ByteDance plans to partner with experts and creative communities to refine and enhance the capabilities of Dreamina Seedance 2.0.
In light of the shifting dynamics in the video generation landscape, particularly the retreat of OpenAI from this segment, ByteDance’s launch signifies its ambition to capture a growing market for AI-generated content. The success of Dreamina Seedance 2.0 could redefine content creation standards and set new benchmarks for user-generated media in the digital age.
See also
Luma AI Launches Uni-1, Outperforming Google Models at 30% Lower Costs
LLMs Face 94% Success Rate in Data Poisoning Attacks, Impacting Key Industries
Beihang University Introduces CASE Framework, Boosts LLM Accuracy by 10% After 1000 Edits
Magic Eraser vs. Generative Fill: Which AI Tool Offers Faster Image Cleanup?
