ElevenLabs’ new music-generation model can switch genres mid-track

Voice AI company ElevenLabs launched a new version of its music-generation model, called Music v2, that can switch genres mid-track. The company said that the model is designed to handle both complexity in vocals and composition. The new release comes nearly 10 months after the startup launched the first version of its music-generation model.

ElevenLabs noted that the model can go from opera to heavy metal and back, deliver fast rap without losing coherence, and add non-musical sound effects to a track. With the new model, artists can pick a part of a song and re-create it using prompts without touching other parts of the track.

Plus, instead of generating short clips, artists can build a song by sections, including the intro, verse, and chorus, then stitch them together. ElevenLabs added that the model performs more reliably across languages, lyrics, vocals, and arrangements.

In the last few months, AI labs have been racing to release models that can generate professional-grade music. Google, Stability AI, and Suno have also released new music-generation models with capabilities to generate longer and more complex tracks. At the Google I/O developer conference, Google added the ability to easily create covers, edit songs by sections, and generate music videos using its Flow Music tool.

ElevenLabs emphasized that the new model is built on licensed data and cleared for commercial use, so users can freely use the tracks. Striking deals with labels is key, given that other AI music startups, like Suno and Udio, faced court cases over copyright issues.

The new model is available on ElevenLabs’ ElevenCreative tool for marketing and branding teams, along with its newly launched ElevenMusic platform for creating AI-generated songs, with availability on ElevenAPI coming soon.