ElevenLabs launches free AI voice separation tool to eliminate environmental noise

ElevenLabs, the AI voice innovation company that has gained fame in the field of voice cloning, text-to-speech, and speech-to-text technology, has recently added a new member to its product line - the AI Voice Isolator. This product has officially launched on the ElevenLabs platform and is specifically designed for creators, allowing them to easily remove unnecessary background noise and interference from multimedia content such as movies and podcasts.

This AI Voice Isolator follows the release of the company's Reader application and is initially available to users for free (with certain usage restrictions). It is worth noting that although there are many tools on the market to improve audio quality, including offerings from industry giants like Adobe, whether ElevenLabs' Voice Isolator can stand out remains to be seen.

How does the AI Voice Isolator work?

Background noise is often a major concern for creators when recording various audio and video content. Whether it's accidental conversations, wind noise, or traffic noise, these unnecessary sounds can unintentionally mix in and affect the audio quality of the final product, even masking important voices. Traditional methods such as using noise-canceling microphones are effective but expensive and not always accessible, especially for creators with limited resources. This is where ElevenLabs' AI Voice Isolator comes in as a powerful backup.

In short, this tool shines in post-production. Users simply need to upload the audio or video file for processing, and the system uses its underlying models to analyze and accurately identify and remove noise, ultimately extracting clear and pure human voices. ElevenLabs confidently claims that its voice isolation effect is comparable to that of a professional recording studio. Design Director Ammaar Reshi even demonstrated the tool's ability to remove hairdryer noise and restore clear human voices.

Real-world testing

To verify the actual performance of Voice Isolator, we conducted multiple rounds of testing. The tests covered speech samples with different background noise interferences, ranging from simple sounds like opening and closing doors and knocking on tables to more complex sounds like applause and moving household items. The results showed that the tool completed the audio processing in a very short time, eliminating almost all noise, with only a few extreme sounds like knocking on walls and snapping fingers remaining. However, the overall speech quality remained highly clear and natural.

Future prospects

Although Voice Isolator has demonstrated powerful noise processing capabilities, especially in dealing with non-fixed noise, ElevenLabs does not stop there and plans to continue optimizing the product's performance. The company is currently keeping a low profile regarding technical details and has not disclosed much information about the underlying models or whether audio data is used for model training. However, the company emphasizes respect for user privacy, and users can choose whether to allow personal data to be used for training purposes through the privacy policy.

Currently, Voice Isolator is only available through the ElevenLabs platform, but the company plans to open API access in the coming weeks, with the specific timing yet to be determined. For first-time users, ElevenLabs offers a free trial plan with a monthly limit of 10 minutes of audio (approximately 10,000 characters). If exceeded, users will need to upgrade to a paid plan starting at $5 per month. This move undoubtedly provides creators with more flexible options and helps them easily create high-quality audio content.