Lyrics In, Full Song Out — YuE Open-Source Music Generation

Plot twist: you thought ‘AI music’ meant paid sites like Suno — but the most complete open-source music model YuE already does ‘lyrics in, full song out’ — complete songs with vocals and accompaniment, paper accepted at ICLR 2026. Model and weights fully open (Apache 2.0): use it, study it, run it yourself.

The Stable Diffusion of Music Generation

YuE is an open AI music model — feed lyrics + style, get complete songs (vocals + accompaniment). ‘Open’ means everything: weights, training pipeline, demos — download, run, even fine-tune your own. The rarest openness in this field — its ‘Stable Diffusion moment.‘

Why the Author Built It

The YuE Project team (HKU-linked academic research). The paper says it: exploring ‘open and fine-tunable’ music generation — turning music AI from black-box service into open research object.

Suno or This?

Convenience → Suno; freedom, research, integration → YuE is the only open answer. At 32kHz it’s near-releasable, and you own all control.

Trust Check

ICLR 2026 paper — the hardest trust signal. Apache 2.0 (even commercial OK). Active demos + Discord.

Where It’s Headed

Higher quality (48kHz), more languages, stabler long songs — making AI music an open, researchable daily tool.

Install

git clone https://github.com/multimodal-art-projection/YuE.git
cd YuE && pip install -r requirements.txt
python scripts/demo.py --lyrics "your lyrics" --genre "pop"

Gotchas: weights are GBs — check disk; 12GB VRAM works but slow; lyric quality directly affects output.

FAQ

• Q: How long per song? A: 10-30 min for a 3-5 min song on consumer GPUs.
• Q: Chinese lyrics? A: Yes — multilingual supported.
• Q: Commercial? A: Apache 2.0 allows it — confirm content copyright locally.

‘Service-convenience’ or ‘own-it-yourself’ camp? Comment which — and what style you’d generate.