Never mind ChatGPT — music might be the next big frontier for AI content generation. Google recently published research on MusicLM, a system that creates music in any genre with a text description. This isn’t the first AI music generator. As TechCrunchnotes, projects like Google’s AudioML and OpenAI’s Jukebox have tackled the subject. However, MusicLM’s model and vast training database (280,000 hours of music) help it produce music with surprising variety and depth. You might just like the output.
The AI can not only combine genres and instruments, but write tracks using abstract concepts that are normally difficult for computers to grasp. If you want a hybrid of dance music and reggaeton with a “spacey, otherworldly” tune that evokes a “sense of wonder and awe,” MusicLM can make it happen. The technology can even craft melodies based on humming, whistling or the description of a painting. A story mode can stitch several descriptions together to produce a DJ set or soundtrack.
MusicLM has its problems, as with many AI generators. Some compositions sound strange, and vocals tend to be incomprehensible. And while the performances themselves are better than you’d expect, they can be repetitive in ways human works might not. Don’t expect an EDM-style drop or the verse-chorus-verse pattern of a typical song.
Just don’t plan on using the tech any time soon. As with other Google AI generators, the researchers aren’t releasing MusicLM to the public over copyright concerns. Roughly one percent of the music produced at the time of publication was copied directly from the training songs. While questions regarding licensing for AI music haven’t been settled, a 2021 whitepaper from Eric Sunray (now working for the Music Publishers Association) suggested that there’s enough “coherent” traces of the original sounds that AI music can violate reproduction rights. You may have to get clearances to release AI-created songs, much like musicians who rely on samples.
AI already has a place in music. Artists like Holly Herndon and Arca have used algorithms to produce albums and museum soundtracks. However, those are either collaborative (as with Herndon) or intentionally unpredictable (like Arca’s). MusicLM may not be ready for prime time, but it hints at a future where AI could play a larger role in the studio.