YuE2: Frontier AI Music Generator With Editable Scores
Link to open source: https://yue2ai.app/
YuE2 is an AI music generation model designed to turn lyrics and musical ideas into complete songs with vocals and instrumental accompaniment.
Users can provide their own lyrics and describe the musical direction they want, including genre, instruments, vocal character, mood, and tempo. YuE2 then uses these instructions to develop the musical structure and generate a song that can be played directly in the browser.
YuE2 also connects symbolic music planning with audio generation. It can create melody and chord information before rendering the final audio, giving the music generation process a more structured foundation.
How does YuE2 work?
YuE2 currently provides two main ways to start a music project:
Text to Music starts with lyrics and a style description. Users write or paste their lyrics, describe the desired sound, and generate a complete song with vocals and accompaniment.
Music to Music adds a reference recording to the workflow. Users upload an audio reference, provide lyrics, and describe a new musical direction. YuE2 then uses these materials to explore a different rendition.
Main features include:
Text to Music — turn lyrics and musical instructions into a complete song.
Music to Music — use a reference audio track to guide a new musical rendition.
Lyrics to Song — transform written lyrics into vocals with instrumental accompaniment.
Style Control — describe genre, mood, instruments, vocal character, and tempo.
Style Presets — start with directions such as piano pop, acoustic folk, indie pop, jazz and soul, or electronic pop.
Song Structure Labels — organize lyrics using Verse, Chorus, and Bridge sections.
Symbolic Music Planning — YuE2 can plan melody and chords before audio generation.
Editable Scores — musical plans can be represented in ABC notation, allowing melody and harmony to be inspected and revised.
Reference Audio — upload an audio file when using Music to Music.
Multiple Audio Formats — the online studio currently provides MP3, WAV, and FLAC output options.
Seed Control — users can reuse a seed when comparing different versions of a musical idea.
The basic workflow is straightforward: add lyrics → choose or describe a musical style → add optional reference audio → select an output format → generate and listen to the song.
What can you create with YuE2?
YuE2 can be used to explore different types of songs and musical directions. The website currently provides listening examples covering styles such as Cyber Metal, Nu-Disco, Jazz-Funk, Easy Listening, Heartland Rock, and Flamenco.
The examples also include songs in English, Chinese, Japanese, and Spanish, showing how different lyric languages and musical styles can be explored within the platform.
Because lyrics and style instructions are kept separate, users can keep the same words while trying different arrangements, instruments, moods, or vocal directions.
Who uses YuE2?
YuE2 can be used by songwriters, musicians, producers, content creators, video creators, game creators, and other users interested in AI-assisted music creation.
Songwriters can use it to hear how written lyrics might work as a song. Musicians and producers can explore different arrangements and genres, while creators can develop early music ideas for videos, games, and other creative projects.
Users do not need to install the YuE2 model locally to use the online studio. Music creation, generation, and playback can be handled directly through the browser.
Overall, YuE2 combines lyrics-to-song generation, Text to Music, Music to Music, style control, reference audio, symbolic melody and chord planning, and multiple audio output formats in one AI music workflow.
