Tone Transfer

Tone Transfer is a web-based tool that uses machine learning to transform everyday sounds into musical instruments in real-time. Developed by Google's Magenta team, Tone Transfer allows users to upload or record audio and convert it into various instruments such as flute, saxophone, trumpet, and violin.

Key features:
- Upload or record audio and instantly hear it transformed into different instruments
- Supports a range of instruments, including flute, saxophone, trumpet, and violin
- Adjust the mix, octave, and loudness of the transformed audio to achieve the desired sound
- The underlying technology, DDSP, is open-sourced

How it works:
1. Users upload an audio file or record a sound directly into the browser
2. Choose the instrument to transform the audio into
3. The DDSP model processes the audio and transforms it into the selected instrument in real-time
4. Users can fine-tune the output by adjusting the mix, octave, and loudness

Integrations:
- Available as a web app, accessible through a browser
- A VST plugin version, called DDSP-VST, is available for use in digital audio workstations (DAWs)

Use of AI:
Tone Transfer utilizes a technology called Differentiable Digital Signal Processing (DDSP), which enables the model to learn and replicate the characteristics of different musical instruments.

AI foundation model:
The tool is powered by the DDSP model, an open-source project developed by Google's Magenta team.

How to access:
Tone Transfer can be accessed through a web browser at the official website. The DDSP-VST plugin is also available for download and use in digital audio workstations.