ByteDance's Next-Gen AI Model Generates Clips from Text, Images, Audio, and Video

ByteDance has launched its next-generation video generator, as major tech companies continue to advance beyond the latest AI models. In a blog post, the Chinese company behind TikTok stated that Seedance 2.0 supports prompts combining text, images, video, and audio.

The company claims it has achieved a significant leap in generation quality, with improvements in generating complex multi-subject scenes and executing instructions. Users can refine text prompts by providing Seedance 2.0 with up to nine images, three video clips, and three audio clips.

The model can generate audio clips of up to 15 seconds, while also accounting for camera movement, visual effects, and motion. According to ByteDance, it can also reference text-based storyboards.

Over the past year, AI-driven video generation models have progressed steadily. Google Veo 3 added the ability to generate video clips with audio support, OpenAI introduced Sora 2 and launched a new app that allows users to create hyper-realistic dynamic and sound videos. AI startup Runway also released a new version of its AI video model, claiming unprecedented accuracy.

An example shared by ByteDance shows two figure skaters performing together. The company states that Seedance 2.0 is capable of reliably executing a series of high-difficulty moves—including synchronized jumps, aerial spins, and precise ice landings—while strictly adhering to real-world physical laws.

Users on social media have already begun showcasing the capabilities of this new tool. One posted an AI-generated video featuring a cinematic fight scene starring Brad Pitt and Tom Cruise. Rhett Reese, screenwriter of Deadpool, reposted the video with the comment: I don’t want to say it. We might be done.

Other posts demonstrate Seedance 2.0’s ability to generate anime-style clips, animations, cinematic sci-fi scenes, and videos that resemble content created by professional creators. It remains unclear whether Seedance 2.0 offers copyright protection, as a quick search on X reveals numerous clips featuring characters from Dragon Ball Z, Family Guy, Pokémon, and more.

Currently, Seedance 2.0 is only available through ByteDance’s Dreamina AI platform and its AI assistant Doubao. It is uncertain whether it will be integrated into TikTok—especially following the app’s change in ownership in the United States.