ElevenLabs Launches Free AI Voice Isolator, Rivaling Adobe’s Offering

ElevenLabs, known for its AI voice cloning and speech synthesis, has launched a free AI Voice Isolator tool to remove unwanted background noise from audio content, directly competing with Adobe’s similar offering.

Key features and functionality: The AI Voice Isolator allows creators to enhance the speech quality of their content by removing ambient noise and sounds in the post-production stage:

• Users can upload their audio files, such as films, podcasts, or YouTube videos, to the ElevenLabs platform, where the AI models process the content to detect and remove unwanted noise.
• The tool aims to extract clear dialogue, similar to studio-recorded content, making it accessible to creators with limited resources who may not have access to expensive noise-canceling microphones.
• Demos showcase the Voice Isolator’s effectiveness in removing various background noises, such as leaf blowers, to produce clear speech.

Testing the tool’s performance: VentureBeat conducted tests to evaluate the real-world applicability of the Voice Isolator:

• The tool successfully processed audio files in seconds, removing most background noises, including door sounds, table banging, clapping, and household item movements.
• It struggled to remove certain sounds, such as wall banging and finger snapping, indicating room for improvement.
• The Voice Isolator does not currently work on music vocals, although users may have success with some songs.

Pricing and availability: ElevenLabs is offering the Voice Isolator through its platform, with plans to open API access in the coming weeks:

• Users can access the tool for free with a monthly limit of 10 minutes of audio processing.
• Paid plans, starting at $5/month, are available for users needing to process larger audio files.
• The company has not shared specific details about the underlying models or data usage for training, but users can opt out of personal data use for model training through a form linked in the privacy policy.

Looking ahead: While the Voice Isolator’s ability to remove irregularly occurring background noise sets it apart from other tools, there is still room for improvement in its performance. As ElevenLabs continues to refine the tool and open up API access, it has the potential to become a valuable asset for content creators seeking to enhance the audio quality of their projects without significant investments in hardware.