ElevenLabs Launches Dubbing Studio to Enhance Video Localization Control

Following the $80 million Series B funding, ElevenLabs announced the launch of Dubbing Studio, enabling users to have better control over video localization. This new tool provides unprecedented video translation control features, including transcription editing, customized translation, and precise timing adjustments, marking a significant enhancement since the introduction of the AI Dubbing tool last October.

ElevenLab's AI Dubbing tool already supports video translation in 29 languages. Dubbing Studio further refines various aspects of the dubbing process, including script generation and editing, naturalness adjustment of translations, and re-generation of translated audio clips to match the desired delivery style.

The user experience begins with a simple project setup, including language selection and file upload. This is followed by a series of powerful features:

• Subtitle and translation editing: Users can now easily adjust translations based on context. For example, if a translation sounds awkward or repetitive, such as translating "In a land where the sun scorches the Earth" to "在一个阳光灼热大地的地方," users can modify it to sound more natural.

• Voice customization: Dubbing Studio is capable of separating the voices of each speaker and cloning them to ensure consistency in sound quality across languages. Users can also adjust settings for stability, similarity, and style of the voices.

• Synchronization and timing adjustments: Aligning dialogue with on-screen actions is crucial for a seamless viewing experience. Dubbing Studio allows users to adjust timecodes and insert audio clips to ensure perfect synchronization.

• Editing flexibility: The interface includes speaker cards displaying the original and translated texts, a timeline with a single audio track, and detailed adjustment settings. This comprehensive setup ensures users can modify various aspects of the dubbing process.

• Manual import options: For users seeking more control, the manual dubbing options allow for the upload of separate audio files, background music, and CSV files providing detailed dialogue instructions.

The launch of Dubbing Studio ultimately enables creators and businesses to attract a wider audience by making their content accessible and culturally relevant across different languages. It provides the level of control that many professional creators seek to enhance the production value of their multilingual video content.