Generative AI for Music lovers
Learning a new machine learning techniques, especially the cutting edge ones, is difficult due to the fast moving academic literature or…
Learning a new machine learning techniques, especially the cutting edge ones, is difficult due to the fast moving academic literature or dry technical content. This is why AWS has created AWS DeepComposer, so that they could bring generative AI in a fun, hands-on way to all our developers.
What is AWS DeepComposer?
AWS DeepComposer gives developers a creative way to get started with machine learning. You can get hands-on, literally with the musical keyboard and the latest machine-learning techniques to expand your machine learning skills. The device itself is a 32-key, 2-octave keyboard. That has playback and record buttons along with other features to make it easier to play cards or create melodies such as arpeggiator. You don’t need any musical talent to get started.
on the left AWS DeepComposer
DeepComposer also has a replica of the keyboard right inside the AWS management console, which you can play using a virtual keyboard from your laptop. The accompaniment is generated instantly using generative models running on Sci-Fi instances with Intel Xeon Scalable processors. With AWS DeepComposer, you can train and optimize generative VI models to create original music.
AWS DeepComposer uses generative adversarial networks, also referred to as GANs, a generative AI technique that puts two networks against each other to generate new creative content.
Example:
GANS is Similar to an Orchestra and a Conductor: The More They Work Together, the Better They Can Perform!
Imagine a orchestra and conductor. An orchestra doesn’t create amazing music the first time they get together. They have a conductor who both, judges their output and coaches them to improve. So an orchestra trains, practices, and tries to generate polished music. The conductor is both judging the quality of the output with the right notes played with the right temple and at the same time, like providing feedback and coaching to the orchestra. Like for example, strings, more volume, haunts, softening this part, everyone with feeling specifically to achieve a style that the orchestra and conductor knows. The more they work together, the better they can perform.
The generative AI that AWS DeepComposer teaches developers, uses a similar concept. They have two machine learning models, that work together in order to generate musical compositions in distinctive styles.
Workflow of AWS DeepComposer:
Developers can simply get started with the AWS DeepComposer keyboard to input a melody that will transform into a completely original song in seconds, all powered by AI, you can input the melody by connecting the AWS DeepComposer keyboard to your computer or play the virtual keyboard in the AWS DeepComposer console.
AWS DeepComposer accepts music in the media format. You can either input a melody using the keyboard or choose from one of the readily available melodies on the console to generate an original musical composition in seconds using the pre-trained genre models in the AWS DeepComposer console. Choose from jazz, rock, pop, symphony or even the Jonathan Coulton pre-trained models.
In addition to the pre-trained genres, you can also build your own custom genre model in Amazon sage maker. You can then publish your tracks to SoundCloud in one click or export MIDI files to your favorite digital audio workstation like GarageBand and get even more creative.
Launch of AWS DeepComposer
Not just generating, you can even publish your tracks to SoundCloud or export MIDI files to your favorite Digital Audio Workstation (like Garage Band) and get even more creative. 🎶