AI Voice Generation Platform Shocking the World with Updates to Combat Abuse

2023-06-21

The AI voice generation platform that shocked the world is getting an update to fight abuse The AI voice generation platform that shocked the world is undergoing updates to combat misuse. ElevenLab's voice cloning feature has been used for both positive and negative use cases. Will the latest update be able to prevent abuse? Generative artificial intelligence has the ability to create various types of content, including text, art, images, and even voice. Since its beta release in January, AI startup ElevenLabs has been supporting text-to-speech generation and voice cloning, accumulating over one million registered users. On Tuesday, ElevenLabs announced the completion of a $19 million Series A funding round and made significant updates to its platform, including addressing its biggest controversy. Since its launch, Elevenlabs' voice generation technology has had both positive and negative impacts. Elevenlabs has explicitly stated some positive use cases, including "independent authors creating audiobooks, developers providing voiceovers for characters in video games, helping visually impaired individuals access online written content, and powering the world's first AI-powered broadcasting channel." While these application cases have been positive and have driven progress for many different industries, there have also been equally harmful applications. This voice cloning tool can take personal voice clips to generate new audio, which has been used for malicious purposes, making public figures appear to make terrible, discriminatory statements. Shortly after the beta release, Elevenlabs immediately responded to "abuse cases of voice cloning" on Twitter. The company proposed potential solutions to address this issue, such as additional account verification, voice copyright verification, moving voice cloning to a paid level, and even manually verifying each request. Today, the company has released what seems to be a solution to address the problem - the AI voice classifier. This tool can determine if uploaded audio contains artificially generated audio from Elevenlabs. Elevenlabs stated in the release, "The release of the AI voice classifier is the latest step in the company's pursuit of transparency and its commitment to creating a safe environment for generating media." According to a previous announcement post about the tool, it maintains an accuracy rate of over 99% when identifying unmodified audio. However, if the audio undergoes codec or reverberation conversions, the accuracy rate drops to over 90%, and the more processing the audio goes through, the more the accuracy decreases. This tool cannot prevent abuse but can only help clarify confusion after the initial harm has occurred. Its effectiveness in solving the problem is questionable, but it is a small step. This is not the first instance of AI generation technology being abused to target public figures. For example, an AI music generator can create a song that sounds like a collaboration between Drake and The Weeknd, even though neither artist was involved. AI art and image generators have also been used to create false, realistic images of public figures engaging in certain activities. Some of these images have been used as negative political propaganda, while others are purely for entertainment purposes, such as a meme of Pope Francis wearing a down jacket. In addition to the AI voice classifier, Elevenlabs also announced the introduction of "Projects" to its product suite. "Projects" is a workflow for editing and creating long-form voice content, which is now available for early access. It aims to provide a one-stop service for audio editing needs and offers "Google Docs-level simplicity" for audio creation. The addition of the "Projects" feature is similar to what we see on other creative platforms such as Vimeo, TikTok, and Adobe Express. These platforms aim to implement artificial intelligence in a way that optimizes user workflows and simplifies and enhances content creation. Source: https://www.zdnet.com/article/the-ai-voice-generating-platform-that-shocked-the-world-is-getting-an-update-to-fight-abuse/

RECENT AI NEWS

RECENT AI TOOLS