https://map-yue.github.io/ [m-a-p] M-A-P Multimodal Art Projection [hkust] HKUST Xiang Gang Ke Ji Da Xue [logo] YuE: Open Music Foundation Models for Full-Song Generation GitHub Paper Abstract We tackle the task of long-form music generation--particularly the challenging lyrics-to-song problem--by introducing YuE (Le ), a family of open foundation models based on the LLaMA2 architecture. Specifically, YuE scales to trillions of tokens and generates up to five minutes of music while maintaining lyrical alignment, coherent musical structure, and engaging vocal melodies with appropriate accompaniment. It achieves this through: (1) track-decoupled nexttoken prediction to overcome dense mixture signals, (2) structural progressive conditioning for long-context lyrical alignment, and (3) a multitask, multiphase pre-training recipe to converge and generalize. In addition, we redesign the in-context learning technique for music generation, enabling versatile style transfer (e.g., converting Japanese city pop into an English rap while preserving the original accompaniment) and bidirectional generation. Through extensive evaluation, we demonstrate that YuE matches or even surpasses some of the proprietary systems in musicality and vocal agility. In addition, fine-tuning YuE enables additional controls and enhanced support for tail languages. Furthermore, beyond generation, we show that YuE's learned representations can perform well on music understanding tasks, where the results of YuE match or exceed state-of-the-art methods on the MARBLE benchmark. [Yue-main] YuE Model Checkpoints HF-Link S1-Model COT ICL English Link Link Chinese Link Link Japanese & Korean Link Link S2-Model Link Upsampler Link Examples Intro: The Model Song YuE (Le ) means "music" and "happiness" in Chinese. For those who find words starting with Yu difficult to pronounce, it can be pronounced as "yeah." Modeling Diverse Genres & Vocal Styles Note: * - Lyrics are GPT-generated * - Future work will include more world music samples, e.g. Beijing Opera Metal: Step Back - The riff is sick. - I am not an expert in metal music. Maybe this vocal technique is called vocal fry? - Lyrics following looks good. Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] Bass Metalcore Thrash Metal Furious bright vocal male Angry aggressive vocal Guitar [verse] Step back cause I'll ignite Won't quit without a fight No escape, gear up, it's a fierce fight Brace up, raise your hands up and light Fear the might. Step back cause I'll ignite Won't back down without a fight It keeps going and going, the heat is on. [chorus] Hot flame. Hot flame. Still here, still holding aim I don't care if I'm bright or dim: nah. I've made it clear, I'll make it again All I want is my crew and my gain. I'm feeling wild, got a bit of rebel style. Locked inside my mind, hot flame. [outro] Hot blaze. Hot blaze. Still here, still holding aim Jazz: Quiet Evening Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] female blues airy vocal bright vocal piano sad romantic guitar jazz [verse] In the quiet of the evening, shadows start to fall Whispers of the night wind echo through the hall Lost within the silence, I hear your gentle voice Guiding me back homeward, making my heart rejoice [chorus] Don't let this moment fade, hold me close tonight With you here beside me, everything's alright Can't imagine life alone, don't want to let you go Stay with me forever, let our love just flow [verse] Moonlight paints a picture upon your lovely face Every glance between us fills the empty space Time stands still around us when you're in my arms Nothing else can matter, safe from any harm [chorus] Don't let this moment fade, hold me close tonight With you here beside me, everything's alright Can't imagine life alone, don't want to let you go Stay with me forever, let our love just flow [bridge] Every touch ignites a fire, burning deep within Every smile you give to me makes my head spin Promise me you'll stay awhile, don't ever say goodbye Together we'll chase every star across the sky [chorus] Don't let this moment fade, hold me close tonight With you here beside me, everything's alright Can't imagine life alone, don't want to let you go Stay with me forever, let our love just flow [outro] Stay with me forever, let our love just flow Rap: This is My Life Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] rap piano street tough piercing vocal hip-hop synthesizer clear vocal male [verse] Woke up in the morning, sun is shining bright Chasing all my dreams, gotta get my mind right City lights are fading, but my vision's clear Got my team beside me, no room for fear Walking through the streets, beats inside my head Every step I take, closer to the bread People passing by, they don't understand Building up my future with my own two hands [chorus] This is my life, and I'm aiming for the top Never gonna quit, no, I'm never gonna stop Through the highs and lows, I'mma keep it real Living out my dreams with this mic and a deal [verse] Late nights grinding, writing down these rhymes Clock is ticking fast, can't afford to waste time Haters gonna hate, but I brush it off Turn the negativity into something strong Mama working hard, wanna make her proud Echoes of her prayers cutting through the crowd Friends turned strangers, but it's all good Focused on my path like I always knew I would [chorus] This is my journey, and I'm running this race Heart full of fire, you can see it in my face Obstacles ahead, but I got no fear Victory is close, yeah, it's almost here [bridge] They said I couldn't do it, said I'd never rise But now I'm soaring high, reaching for the skies Lessons that I learned made me who I am Standing tall now, I don't give a damn [verse] Echoes in the alley, music's getting loud Feeling the adrenaline pumping through the crowd Spotlights on me, it's my time to shine Living in the moment, everything's aligned Looking back now at the roads I've crossed Every single battle, every line I've tossed Made me stronger, wiser, ready for what's next Writing my own story, turning pages of the text [chorus] This is my song, and I'm singing it proud Voices united, hear us shout out loud From the underground straight into the stars Carving out my name, leaving all these scars [outro] Yeah, this is for the dreamers, the ones who never quit Keep your head up high, and don't you ever submit Life is what you make it, so make it something great Step into your purpose, go and seize your fate Pop: I Won't Back Down - Same lyrics but different tags (1-pop/2-pop/3-no pop) Your browser does not support the audio element. Your browser does not support the audio element. Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] inspiring female uplifting pop airy vocal electronic bright vocal vocal [verse] Staring at the sunset, colors paint the sky Thoughts of you keep swirling, can't deny I know I let you down, I made mistakes But I'm here to mend the heart I didn't break [chorus] Every road you take, I'll be one step behind Every dream you chase, I'm reaching for the light You can't fight this feeling now I won't back down I'm the whisper in the wind, the shadow by your side The warmth you feel within when you can't hide You know you can't deny it now I won't back down [verse] They might say I'm foolish, chasing after you But they don't feel this love the way we do My heart beats only for you, can't you see? I won't let you slip away from me [chorus] Every road you take, I'll be one step behind Every dream you chase, I'm reaching for the light You can't fight this feeling now I won't back down I'm the whisper in the wind, the shadow by your side The warmth you feel within when you can't hide You know you can't deny it now I won't back down [bridge] No, I won't back down, won't turn around Until you're back where you belong I'll cross the oceans wide, stand by your side Together we are strong [outro] Every road you take, I'll be one step behind Every dream you chase, love's the tie that binds You can't fight this feeling now I won't back down Ballad: Hospital Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] Sad varied vocal male Country Folk full vocal rich vocal Piano Serious [verse] She arrives here each day This small lady with hair of grey And she merely grins and stumbles On her way [verse] In these hospital hallways She strolls along these silent ways To a chair Where an old woman used to stay And an old woman used to pray I'm in the autumn of my days [verse] I've known the gladness I've known the stress I've just gone through the doctor's mess Please don't sigh, my dear love mine [verse] He arrived here not long past And the physicians were in doubt If the moment for him to pass Was nigh [verse] But when the time arrived And he closed his eyes to rest She pleaded to the Lord above His spirit to bless And as she turned away to grieve It felt like she could sense I'm in the dawn of a new life [verse] I've known the gladness I've known the stress I've just faced the doctor's test Please don't sigh, my dear love best [verse] She'll stay there for quite a while And recall their love with a smile And set it there, the freshest flowers in style [verse] She stands near that silent door Her tired heart is sore and worn And the tales that they once told Still ring in her ears so cold [chorus] I'm in the autumn of my life I've known the joy I've known the strife I've just come out of the sickroom light Please don't sigh, my dear delight 'Cause you and I, we've shared some light [chorus] And our love has reached far and wide And in the glow of stars at night You and I will always unite [end] Mandarin Pop: My Love Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] Pop vibrant vocal Piano R&B Uplifting Drums Guitar male full vocal Inspiring Mandarin [verse] Hey Ni Ci Ke Shi Fou Huan Hao Ya Kuang Feng Zai Chuang Wai Si Yi Di Gua Xiang Qi Yi Tong Man Bu De Na Yi Xia Ni Jiang Hui Ban Wo Dao Tian Ya Wo Men Lao Lao Qian Shou Bu Sa Wu Xu Zai Wei Ju Hai Pa [verse] Oh Dear Xiao Rong Shi Fou Huan Can Lan Tian Zhen Shi Fou Yi Jing Xiao San Ji Jie Geng Ti Liao Xu Tian Yi Bao Nuan Zhu Yi Bie Zai Shou Feng Han Bi Jing Ru Jin Wo Yi Bu Zai Ni Shen Pang Zuo Ban [chorus] Someday Ta Gei Yu De Shi Yan Yi Xiao San Ruo Ni Hui Yi Na Zuo Tian Qing Ni Neng Gou Nian Wo My Love [inst] Ni Wo Xin Bing Wei Zou San [verse] Oh Dear Xiao Rong Shi Fou Huan Can Lan Tian Zhen Shi Fou Yi Jing Xiao San Qi Wen Bian Di Liao Yao Zhu Yi Bao Nuan Bie Rang Zi Ji Shou Feng Han Bi Jing Ru Jin Wo Yi Bu Zai Pei Zai Ni De Na Yi Duan [chorus] Someday Na Yue Ding De Mei Hao Wei Di Da Tang Ruo Ni Zhui Yi Wang Xi Qing Ni Shi Zhao Nian Wo My Love Wo Yu Ni Bing Fei Tian Ya [chorus] Someday Ta Gei Yu De Shi Yan Yi Xiao San Tang Ruo Ni Hui Yi Guo Wang Qing Ni Shi Zhao Nian Wo My Heart [outro] Ni Wo Xin Cong Wei Zou Yuan Pop: Quiet Evening Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] female airy vocal bright vocal piano sad romantic guitar pop [verse] In the quiet of the evening, shadows start to fall Whispers of the night wind echo through the hall Lost within the silence, I hear your gentle voice Guiding me back homeward, making my heart rejoice [chorus] Don't let this moment fade, hold me close tonight With you here beside me, everything's alright Can't imagine life alone, don't want to let you go Stay with me forever, let our love just flow [verse] Moonlight paints a picture upon your lovely face Every glance between us fills the empty space Time stands still around us when you're in my arms Nothing else can matter, safe from any harm [chorus] Don't let this moment fade, hold me close tonight With you here beside me, everything's alright Can't imagine life alone, don't want to let you go Stay with me forever, let our love just flow [bridge] Every touch ignites a fire, burning deep within Every smile you give to me makes my head spin Promise me you'll stay awhile, don't ever say goodbye Together we'll chase every star across the sky [chorus] Don't let this moment fade, hold me close tonight With you here beside me, everything's alright Can't imagine life alone, don't want to let you go Stay with me forever, let our love just flow [outro] Stay with me forever, let our love just flow Soul: Hold You Anyhow Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] female romantic keyboard soul emotional bright vocal airy vocal blues classic rock guitar bass drums [verse] I've got to hold you, anyhow Not later, this hour [verse] I know it's dark, whoa I can't mark So come on and take my hand Please, take my hand Now, don't start fretting, trying to understand [chorus] The stars are shining, let's not miss this prime I know it's night, whoa I feel the hype So come on and take the flight Please, take the flight [verse] I know it's hard making this request There's no other path I can take to be your quest [chorus] If only your kin would consent Situations like this we could prevent No, no I won't reveal to anyone I'll hold it within [chorus] I know it's dark, whoa I can't mark So come on and take my heart Please, take my heart [outro] 'Cause I desire you, truly I do Oh, stay by my side Yes, oh, darling I require you I want you, I want you to light my way Country: Lonesome Road Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] male mellow vocal Guitar Piano Country dark vocal Blues introspective Sad [verse] Da-dum, da-da-da-da-da-da-da Da-dum, da-dum Walking down this lonesome road Thinking 'bout the love untold Why haven't I told you I've whispered to the midnight stars [chorus] Friends keep asking if I'm fine I just smile and say you're mine Maybe you feel the same way too Oh darling, if you do Why haven't you told me Da-dum, da-da-da-da-da-da-da [verse] I've sung it to the morning sun That with you, my life's begun Why haven't I told you My heart's an open book today Waiting for the words to say Why haven't I told you [chorus] Friends keep asking what's the news I just grin and think of you Time to take a chance Let my feelings show Maybe you feel the same way too Oh darling, if you do Why haven't you told me [bridge] Da-dum, da-da-da-da-da-da-da Da-dum, da-dum No more holding back these words Let them fly just like the birds [chorus] Now I'm standing here tonight Hoping that I got it right Maybe you feel the same way too Oh darling, if you do Let's not waste another day Why haven't we told us [outro] Da-dum, da-da-da-da-da-da-da Da-dum, da-dum Now we've finally told us Our new life's begun Alternative Rock: Corner Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] male emotional alternative rock dark vocal introspective acoustic guitar electric guitar indie rock drums [verse] Standing on the corner, shadows in the night The city's heartbeat echoes under lights Hands deep in pockets, wandering alone Footsteps tracing paths to the unknown Suddenly he pauses, looks up to the sky [chorus] Lost within the chaos, seeking out a sign In a world of color, drawing blurred lines Moving forward, looking back, unsure of the way Trying to find a place where he can stay [verse] He crosses empty streets, under neon glow Faces in the crowd, stories left untold Raises up his arms, reaching for the truth Grasping at the fragments of his youth [chorus] Lost within the chaos, seeking out a sign In a world of color, drawing blurred lines Moving forward, looking back, unsure of the way Trying to find a place where he can stay [bridge] Doesn't want to leave, doesn't want to fight Caught between the darkness and the light No need for reason, nothing to prove Just a soul in transit, with nothing to lose [outro] Doesn't want to leave, doesn't want to fight Chasing after shadows in the night He doesn't need the truth, doesn't need a name Just looking for a spark to fan the flame Indie: Act Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] indie rock guitar electric guitar full vocal mellow vocal romantic dream pop emotional keyboard drums [verse] Three more days pass and no more heartache These are the thoughts I make I've been searching through the dark Though my spirit starts to break That I could be brave The South would be so glad of me [verse] How would you act [verse] When the moon hides behind the cloud And you're only two steps from breakdown? [chorus] Lemonade, Madeira, heart in disguise So we take our shiny stars And use them as scars Now there's nothing left for me to fear My own tears and silent cheer But I'll stand here The South would be so glad of me [inst] [verse] So I'll meet you the next day Shall we say it's done? Trying to make flames ignite Seeing as they've run You don't know how to cherish that But I know how to cherish that I believe we'll be okay The North would be so glad for you [chorus] What would you say When moons fade in the night And you're just one breath from breaking? [outro] [done] Childrens' Song Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] Er Tong female clear vocal Dong Hua high-pitched vocal Sheng Le You Qu Da Ji Le Qi Huan Le [verse] [verse] Ge Ge Da Da ,Song Song Kua Kua ,Wai Wai Niu Niu ,Keng Keng Wa Wa . Da Nao ,Jin Tian Zai Ci Qi Dong Ge !Xing Lei ~!Wo Shi Ge Ge Da Da De Da Nao ,Shi Er Mi Hu Shi Er Ming Xi . Wo Shi Ge Ge Da Da De Da Nao ,Yo He !Gao Qing Chu Liao !Wo Shi Song Song Kua Kua De Da Nao ,You Shi Yu Kuai You Shi Fan Men . Wo Shi Song Song Kua Kua De Da Nao ,Ai ~Shi Zai Tai Fan La !Ge Ge Da Da ,Song Song Kua Kua ,Wai Wai Niu Niu ,Keng Keng Wa Wa . Yo ~Zhen Bu Qing Song Ya ! [chorus] Wo Shi Huang Huang De Da Nao ,Si Yi Si Hou Zuo Pan Ding . Wo Shi Huang Huang De Da Nao ,Mo !Jiu Xuan Ding !Wo Shi Tu Ao De Da Nao ,Zhuang Zhuang Shen Qu Sui Wo Ling . Wo Shi Tu Ao De Da Nao ,Yo !Yao Jing Xing !Zhou Zhou Ba Ba ,Ruan Ruan Mian Mian ,Wan Wan Qu Qu ,Ao Tu Bu Ping . Da Nao ,Jin Tian Ye Duo Xie Ni La ! [end] Mei Guan Xi ! Modeling Diverse Languages Note: * - Lyrics are picked from authors' playlists, and rewritten by GPT. * - We actually support a large spectrum of languages, both western and eastern. We currently provide demos in English, Chinese (Mandarin and Cantonese), Japannese and Korean. * - The model supports code-switching between languages. * - Will work on more samples from different languages. Musicality may vary. Mandarin-English Hiphop: Ku Lao - Chinese gangsta rap Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] hiphop synthesizer tough male rap street bass vocal piano [intro] Ge Lia Miao Bie Zheng Na Xu Yi Tao Du Shi Chang Liang Ren Xiong Di Ni Bie Nao Ge Lia Miao Bie Zheng Na Xu Yi Tao Ni Xin Li Mian Cang Zhao Ta Dou Li Chuai Zhao Pao [chorus] Ren Cheng Ku Lao Ku Lao Ku Lao Ku Lao Jie Tou Ku Lao Xiang Yao roll roll roll roll Fu Gui Cai Bao Ren Cheng Ku Lao Ku Lao Ku Lao Ku Lao Jie Tou Ku Lao Xiang Yao roll roll roll roll Fu Gui Cai Bao [chorus] Du Huan Ta Jiang Hu Ku Lao ei Jiang Hu Ku Lao Ta Ke Wang Rong Hua Cai Bao ei Rong Hua Cai Bao Shi Jie Neng Gou Na Ban Yan Shi Jie Yi Na Ban Miao Ai Yo Ni Ye Ting Wen Ta ayo Ru Ci Cou Qiao [verse] Da Huo Du Zai Jiang Ni Hen Niu La Ni Ben Shi Que Shi Da La Wo Yi Ran Bei Ni Zhe Fu La O~ Ni Gen Na Guo Wai Xi Ha Ka Ting Xiang La Guang Cai Na Shi Xiang Dang Liang La Sheng Guo Tou Ding De Yue Liang La Ta De Dian Hua Sheng Xiang Qi ring ring Ji Ju Hua Li Ji Ju bling bling Ling Yong Qian Huan Liao ring ring Shuo Zai Hui Ta Jiang pingping wu Ta Te Hao Shuang Cong Bu Tuo La Neng Lu Lian De Shi Er Jue Bu Fan Sha Dai Zhao Mao Zi Rang Ni Xin Shen Bu Zhu Ta Yi Xian Shen Jiu Hao Si Han Feng Gua Lai Ta Zhi Xiao Nu Li Jiu You Hui Bao Que Bu Ming Xiao Kuan Yi Dai Ren Ye Bu Zai Yi Ke Wang Xun Su Pin Bo Yi Fan Ba Ni Dang Gong Ju Shi Huan Zou Zhao Shan Lu un [verse] Ta Fang Yan Shuo De Liu Yu Ren Jiu Han Hao Xiong Di Lu Qi Ge Bo Yu Zuo Na Ba Tou Ke Ta Que Pian Ai Na Dian Xiao Bian Yi Shi Ta Ming Sheng Sao Di Ba Ta Dang Zhi You Ke Ta Ba Ge Men Dang Xiao Di Dui Ta Jiang Zhen Xin Hua Ta Bu Zhen Xi Qing Yi Jian Jian Di Bei Ta Yi Qi [verse] Ge Lei Shi Qing Du Xiang Gan Zhe Xiong Di Te Bie Han Xin Zhong Ou Xiang Zhou Run Fa Ta Yao Zuo Ge Jie Tou Ba Gan Chong Gan Chuang Ni De Shan Yi Ta Dang Shi Nuo Ruo Yin Fa Zheng Zhi Yu Nu Huo Yi Hui Hui Ba Ta Dang You Ke Zhe Ban Xia Qu Hui Zou San Shuo Dui Liao Ni Bie Kua An For free (Zhe Yi Tiao Bu Shou Fei E ) [chorus] Ren Cheng Ku Lao coolLao coolLao coolLao Jiang Hu Ku Lao Xiang Yao roll roll roll roll Fu Gui Cai Bao Ren Cheng Ku Lao coolLao coolLao coolLao Jiang Hu Ku Lao Xiang Yao roll roll roll roll Fu Gui Cai Bao Du Jiao Ta Jiang Hu Ku Lao ei Jiang Hu Ku Lao Ta Xiang Yao Fu Gui Cai Bao ei Fu Gui Cai Bao Shi Jie Neng Gou Na Yao Yan Shi Jie Mei You Na Yao Zhai Ai Yo Ni Ye Ting Wen Ta ayo Ru Ci Cou Qiao [verse] Ge Men Kou Qi Fang De Kuang Zi Cheng Jie Tou Wang Zhong Wang Jin Biao De You Shi Lai Kuai Shen Cai Fei Yang Gou Shan Liang Chang Mian Yi Ding De Cheng Zhu Xiao Sa Zi Ru Ya Ge Chang Chu Men Kai Liang Fa La Li Shi Yao Cheng Wei Qiang Zhong Qiang [verse] Ta Shi Xian Dui Ni Yi Dun Qiang Xi Guan Shi Hou Zai Gei Ni Dian Xi Wang Bu Zhi Bu Jue Xin Ren Kuai Hao Guang Lin Shi Bu Jiu Shi Ta De Guan Yang Ta Reng Ran Neng Si Chu Chuang Dang Ke Qing Yi Que Nan Yi Zai Wang You Chou Xian Zai Ta De Mian Pang Shen Ye De Xiang Zi Li Deng Guang Xia Xiang Zhi Gu Du De Ye Lang [verse] Jian Jian Da Huo Bu Peng Chang Ta Bu Ming Suo Yi Bu Zhuan Xiang Ta Chang Yan Wei Lai Lu Huan Chang Dan Dang Xia Ta De Lu Yao Huang Ta De Xin Jing Jian Shi Chang Du Zi Zhi Shi Nan An Xiang Ta Yuan You Peng Tai Lin Se Tai Bo Liang Que Wei Kan Qing Ji Mo Yang Bing Wu Shen Chou Da Hen Cang Ke Wei He You Yu Zhe Zhuang Kuang Yi Xiao Neng Fou Jie Yuan Chang ask me MR Jiang Hu Lang Wang Zhao Jia Zhong Cai Yu Bao Ta Bu Zhi Ru He Shi Hao Shi Er Huan Le Shi Er You Zuo Ren Shi Zai Tai Nan Ao Ai Zhe Jiang Hu Lang [outro] Ge Lia Miao Bie Zong Xia Hu Nao Du Shi Jing Ming Ren Xiong Di Ni Bie Nao Ge Lia Miao Bie Zong Xia Hu Nao English + Japanese + Korean Code Switching Kpop: Wan Bi naGuan Xi - The arrangement of this sample is amazing. - OG song: https://www.youtube.com/watch?v=v1NMaIQ58N0 OFFICIAL by EXID Your browser does not support the audio element. Lyrics [Genre] bright vocal R&B Love airy vocal K-pop Dance Synthesizer Keyboard female Piano [intro] [verse] Wan Bi naGuan Xi Duan karaJian rebaneGan iJi gaCi satsutamamano pain You're not the only one I blame I know I'm not the only one I know you got another one (uh huh) Ai noMo Fa niNi reruwa Abracadabra... in love with you [verse] Luo maruZhi Xian (oh yeah yeah) Do you want her do you want me (oh no no) Yan enai wanna be your number one (nee baby) Come a little closer (hush hush) [chorus] Just take my hand boy Will you be mine konomamakonoKong woZhui iYue shiteLian reQu tsute into your world Jin suguni Just wanna be Wanna be your [chorus] Just take my hand boy Will you be mine kokokarakonoYe woZhui iYue shiteLian reQu tsu te into your world Yong Yuan ni Just wanna be Wanna be your [verse] Official, official, official, official, official, official girl Can we be official, official, Official, official, official, official, boy? [verse] Ai Mei namamademataYu shikunatsuteGan iMi gaJiang riZhu gu love Rain Oh Baby give me one more time [chorus] Let me be ur official or issge haejweo yeoperado I want you to love me want you to love me ya ya You and I uri dul da got this feeling babe Want you to want me so tell me honestly [bridge] geunyang nan weonhae neoyi 9 to 5 I'm on it All day all night long da bonae we burn it We got it we want it ne mamsoge issneungeo da ggeonae uri duli suri suri masuri like magic ya Go tell her about us now And ddeonaja dangjang uri tonight [bridge] hotsureteikuZhi Xian (oh yeah yeah) Do you want her do you want me (oh no no) Wei uwa wanna be your only one (nee baby) I don't wanna hear no... (hush hush) [chorus] Just take my hand boy Will you be mine konomamakonoKong woZhui iYue shiteLian re Qu tsute into your world Jin suguni Just wanna be Wanna be your Just take my hand boy Will you be mine kokokarakonoYe woZhui iYue shiteLian reQu tsute into your world Yong Yuan ni Just wanna be [chorus] Wanna be your Official, official, official, official, official, official girl Can we be official, official, Official, official, official, official, boy? [end] Cantonese Ballad: Ai Ni Wu Xu Jiang Dao Li Your browser does not support the audio element. Lyrics [Genre] female Cantonese Melancholic Classical airy vocal Piano bright vocal Pop Nostalgic Violin [verse] Wo Ye Bing Fei Wu Wei Ju Wo Ye Bing Fei Bu Zhi Xian Ran Er Zai Shen Qing Xiang Yong Zhi Ji Na Pa Jian Nan Chong Shan Jun Ling Wei Ni Ye Yuan Zuo Tan Tu Ai Ni Wu Xu Jiang Dao Li [verse] Dan Yuan Yong Zhen Xin Shi Yi Qu Pei Ban Ni Yi Xiang Dao Xin Zhong De Ni Cong Wei You Guo De Yong Qi Meng Ran Chong Man Jian Fa De Shen Ti [chorus] Pang Ren Quan Du Zu Lan Lian Dao Li Ye Nan Rong Reng Quan Xin Ben Fu Tong Ye Bu Hui Heng Si Zhui Zhu Na Pian Hong Shui Ren Zen Yang Meng Chong Du Nan Bi Wo Wei Ni Zhe Ban Feng [chorus] Qian Lu Jing Ji Zai Duo Wu Ren Ke Zu Wo Bu Kan Zhao Shi Qian Nan Mo Xian Du Gan Fu Wo Bu Gou Cheng Shou Jin Cun You Zhe Fen Wan Gu [verse] Wo Ye Ke Wang Bei Guan Huai Dan Gan Xin Cheng Wei Wei Shi Lai Shou Hu Ni Rong Yao Ni Bu Si Yu Wo Yi Jiu Zhi Yi Zou Xia Qu Sa Tuo Xiao Zhao Wei Ni Kang Feng Yu [chorus] Ta Ren Shi Zhong Zhi Yi Lian Chang Li Ye Bu Gu Reng Quan Xin Fu Chu Ku Du Bu Jue Ku Reng Zhi Zhao Yi Fen Qing Shui Ren Dao Wo Wan Gu Yi Bu Ru Wo Wei Ni Na Ban Du [chorus] Qian Fang Zu Ai Zhong Zhong Wu Ren Ke Rang Wo Ting Kan Zhao Na Jian Nan Xian Zu Du Qian Xing Wo Bing Fei Wu Qing Jin Cun Zhe Qiang Chi Cheng [chorus] Shuai Xia Qu Zai Zhan Qi Jiu Xiang Shi Xiao Qiang Bing Ming Ming Yi Shou Cuo Zhe Reng Nu Li Qu Qian Xing [chorus] Ta Ren Cong Bu Ren Ke Lian Dao Li Ye Bu Tong Reng Quan Xin Fu Chu Ai Du Bu Jue Nong Reng Zhi Zhao Yi Duan Qing Shui Ren Zen Yang Chong Dong Yi Bu Ru Wo Wei Ni Na Ban Feng [chorus] Yan Tu Feng Yu Zai Meng Wu Ren Ke Zu Wo Xing Wang Zhao Shi Qian Nan Mo Xian Du Gan Ying Na Pa Wu Pei Ban Yi Jiu Cun Zhe Fen Jian Ding Qi Dai Qing De Ren Quan Bu Qing De Hen Jian Ding [bridge] [verse] Mandarin Rock: Ni Yao Tiao Wu Ma - We actually did in-context-learning here, using part of the original song as prompt. You can hear the vocalist sounds similar. - OG song link: https://www.youtube.com/watch?v=4ZaHdnfI6iQ <> by Xin Ku Zi Le Dui - The generated song is more like a western hardrock. No direct copying here. Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] full vocal mellow vocal male electric guitar rock energetic Mandarin rebellious drums clear vocal range vocal [verse] Ni Yao Tiao Wu Ma [verse] Mei Dang Chao Shui Yong Dong Zhi Ji Ni Shi Fou Ye Gan Dao Xin Sui Zai Yong Ji Er Gu Ji De Fang Jian Li Wo Yi Wu Fa Hu Xi Zai Zhe Leng Ku Wu Qing De Du Shi Zhong Yu Shi Shang Tui Fei De Ju Hui Li [chorus] Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Yao Tiao Wu Ma [verse] Mei Dang Chao Shui Yong Dong Zhi Ji Wo Zi Ran Ye Hui Gan Dao Bei Shang Zai Yong Ji Er Gu Ji De Fang Jian Li Wo Yi Wu Fa Hu Xi Zai Zhe Leng Ku Wu Qing De Du Shi Zhong Yu Shi Shang Tui Fei De Ju Hui Li [chorus] Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Ni Yao Tiao Wu Ma I know y' all was waiting for this flow to come (Wo Zhi Dao Ni Men Yi Zhi Qi Dai Wo De Jie Zou Dao Lai ) [verse] Wo Men Du Shi Di Yi ,Dui Ba (We all number one right)Zhe Jiu Shi Wo De Gan Shou (that's just how I feel)Na Yao ,Shui Xiang Tiao Wu ?(So who wants to dance)Wo Men Xiang Yao Tiao Wu (We wanna dance) [bridge] Wo Men Ke Wang Wu Dong [chorus] Ni Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Ni Yao Tiao Wu Ma Ni Ni Ni Ni Yao Tiao Wu Ma [end] Ni Ni Ni Ni Yao Tiao Wu Ma Emergent Spontaneous Performance & Advanced Vocal Techniques Note: * - Lyrics are rewritten by GPT and directly generated by GPT. * - We are showcasing advanced vocal techniques and spontaneous performances that demand years of professional training and talent, which have been learned by our 7B model. Chinese Folk Singing + Beijing Opera + Shanbei Folk Vocal - Our model encodes the rich diversity of world music styles, preserving cultural heritage within its weights. Here's a sample blending Chinese Folk Singing, Beijing Opera, and Shanbei Folk Vocals. - Shanbei Folk Vocals originate from the traditional songs of Shaanxi farmers and shepherds, expressing their daily lives and emotions through raw, heartfelt melodies. A reference song from Black Myth Wukong: https://www.youtube.com/watch?v=O9M_XH8YSlQ Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] Violin Mandarin Piano Melodic bright vocal New Age airy vocal Calm female Classical [verse] Shan Po Shang De Na Ge Guo Lin Zi Er Wei You Na Ge Cui Hong Hong Jun [verse] [chorus] San Zhan Deng Na Ge Liang Lai Liang Zhan Deng Mie Diu Xia Wo De Qing Ge Ge Jia Dao Liao Zhao Jia A [inst] [verse] Lan Hua Hua Xia Jiao Lai Zuo Qiao You Qiao Qiao Jian Zhou Jia Na Lao Tou Hao Si Na Yi Gen Hao Ai [verse] Ni Yao Zou Shi Ni Kuai Kuai Zou Qian Jiao Ni Zou Hou Hou Jiao Wo Lan Hua Hua Liu [chorus] Ai [chorus] Shou Peng Zhao Na Ge Ping Guo Dou Li Zhuang Zhao Zao Bu Gu Zu Lan Wo Xiang Ge Ge Shen Bian Kao [outro] Wo Qiao Jian Wo De Qing Lang Ge You Jiang Bu Jin De Na Xie Ke Zan Men Liang Ge Beng Guan Sha Xiang Ban Zai Yi Huo Ai Ai [end] Scatting - Originating in vocal jazz, scat singing or scatting is vocal improvisation with wordless vocables, nonsense syllables or without words at all. - Scatting starts when running out of lyrics at the end of the song. - You can jump to 2:20 if you only want to listen to scatting. - But the vocal performance is beautiful anyways. Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] female blues airy vocal bright vocal piano sad romantic guitar jazz [verse] In the quiet of the evening, shadows start to fall Whispers of the night wind echo through the hall Lost within the silence, I hear your gentle voice Guiding me back homeward, making my heart rejoice [chorus] Don't let this moment fade, hold me close tonight With you here beside me, everything's alright Can't imagine life alone, don't want to let you go Stay with me forever, let our love just flow [verse] Moonlight paints a picture upon your lovely face Every glance between us fills the empty space Time stands still around us when you're in my arms Nothing else can matter, safe from any harm [chorus] Don't let this moment fade, hold me close tonight With you here beside me, everything's alright Can't imagine life alone, don't want to let you go Stay with me forever, let our love just flow [bridge] Every touch ignites a fire, burning deep within Every smile you give to me makes my head spin Promise me you'll stay awhile, don't ever say goodbye Together we'll chase every star across the sky [chorus] Don't let this moment fade, hold me close tonight With you here beside me, everything's alright Can't imagine life alone, don't want to let you go Stay with me forever, let our love just flow [outro] Death Growl - It is pretty loud. Turn down your headphone!! - You can start at 0:50. - The lyrics following is quite well even under this extreme low vocal-to-accompaniment ratio. - Solo is a bit long and repetitive. - Actually, we support chinese genre tags to some extent. Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] Bian Chi Jin Shu powerful vocal male Ji Ta Si Wang Jin Shu Can Ku Bei Si boomy vocal Bao Li [solo] [solo] [verse] I, the Moon of night The child of the cosmic sight My shine dimmed and lost within the sky That I may find harmony in this land [verse] I, child of rebellion From pure emptiness defied Towards the loftiest soul, to boundless liberty To uncover the fiery essence of my plea [solo] [verse] I, spark of creation The truth of nature I embrace I carry the flame of Prometheus So I can light the dark and guide the stars [chorus] I, celestial rebel Infusing frenzy in my soul With hope embraced, with tears unleased Is the wisdom of gods in man whole? [solo] [solo] [verse] The light of the morn The thrill of the eve Sustained am I by this cosmic wave Where high above blends with deep below [verse] Let it be spoken, let it be known Wandering I march towards the broken throne [solo] [solo] [solo] [solo] [solo] Mix Voice - Mix voice is the blending of the chest voice and the head voice. It is also the elimination of the bridge- that pesky gap that connects the two registers. - Commonly seem in power metal. Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] Power metal Guitar male Energetic bright vocal airy vocal [intro] [intro] [intro] [verse] Moments of love Moments of pain Floating by within my brain Now, then, soon, a single chain Nights of fun Nights of woe Come and leave as I still know A week, a month, a thousand days, they go Oh, someday I will depart to find a new way [chorus] No, and this world won't pause to spin along with me 'Cause time Marks time Marks on without us free Ever goes [verse] Sure time Speeds time Speeds along and never gone Flows continuously [verse] Times of hope Times of strife Endless journey is our life Can't give up now, not till we're through We yearn for more serenity, and perhaps a new life This one is brief, no matter what you do [chorus] Oh, don't ever lose the faith to live a great life No, don't squander your precious time to make it strife [chorus] Time Flows time Flows on leaving us behind Never pauses Yes time Moves time [chorus] Moves along and never gone Flows continuously [solo] [beat] [beat] [chorus] Please please let me find The path that's truly mine Make a move and we shine so fine [chorus] No more idle days No more futile ways Life's too brief to sigh Long enough to fly [chorus] Time Flees time Flees away without a sound Never slows [chorus] Yes time Moves time Moves along and never gone Flows continuously [new_end] Powerful Belt, Riffs and Runs 01 - This sample is from an old checkpoint. - Tons of riffs and runs. But less control. Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] pop In the heart of knowledge, where dreams take flight, A vision unfolds, bathed in radiant light. The AMC stands proud, a beacon so bright, Where art meets machine, a future in sight. With creativity sparked, and minds set ablaze, Innovation will flourish in myriad ways. From pixels to patterns, in harmony blend, A journey begins, where boundaries extend. Artists and thinkers, together they'll weave, A tapestry rich, in which all can believe. With each brushstroke and code, a story will grow, In this realm of wonder, new ideas will flow. Let's celebrate this moment, this path we embrace, In the dance of the digital, we'll find our place. At HKUST, where the future ignites, The Arts and Machine, a symphony of sights. So here's to the dreamers, the makers, the bold, In this vibrant new division, let visions unfold. Together we'll craft, innovate, and inspire. At AMC, we'll reach ever higher! [outro] Powerful Belt, Riffs and Runs 02 - This one is new. - Sounds great. But a lot of distortion at high vocal range. We plan to address it in the next version. Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] Keyboard Uplifting Piano Pop airy vocal bright vocal Electro pop Hopeful female Synthesizer [verse] Was 25 striving to find my path to Neptune A short escape didn't seem so wrong Was filled with doubts tied up hard like concrete Running on low, so nearly gone Thought I wasn't wise And I wasn't so strong [verse] Sitting in the darkened room We were tied with endless gloom And I thought the blame was mine Couldn't bear it anymore [chorus] With the strength from within (No more hiding in the shade) I lifted my spirit high (I made a choice to fly) I took one step after another and I [chorus] Faced the mirror and chose to remain Wasn't gonna let love lead me astray This way [verse] I thank my brother for keeping my spirit from drowning When the reality was like chewing on lead Now every dawn There is no more sadness, oh yeah I can truly find myself anew I know I am worthy Able to be cared It wasn't for me to quit Now I must soar beyond Let the cosmos prove it wrong Yeah the truth will make me strong [chorus] By the strength of soul (There was no turning back) I raised myself anew (I knew I couldn't slack) I took one step after another and I [chorus] Stared at the mirror and chose to remain Wasn't gonna let heartache drive me insane That way no There ain't no Not in the name of pain In the name of pain (In the name of pain) That way There ain't no I'm not giving in [chorus] By the strength of will I made myself stand tall I take one step after another and I Looked to the future (Looked to the future) Looked to the future (Looked to the future) [chorus] With the strength from within (No other path to win) I lifted myself once more (I realized I must endure) I take one step after another and I [outro] Stared at the mirror and chose to remain Wasn't gonna let heartbreak drive me insane This way [outro] A cappella - We do not support the tag "a cappella". But this sample is prompt with in-context-learning. - Lyrics are rewritten by GPT. - OG song: https://www.youtube.com/watch?app=desktop&v=Urf7wDavQKw&t= 0s Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] happy clear vocal full vocal uplifting hip-hop rap range vocal [verse] How does a waif, an outcast, child of a strumpet and a Welshman, placed in the midst of an overlooked Nook in the Atlantic by Destiny, destitute, in disarray Rise up to be a legend and a sage Well the news spread wide, they claimed, this lad is remarkable, man Raised a fund just to dispatch him to the mainland Gain your knowledge, don't neglect where you originated, and The world will hear your fame, what's your name, lad Alexander Hamilton (Alexander Hamilton) We are standing by for you (standing by for you) You could never give in You never learned to slow your spin [chorus] Oh, Benjamin Franklin (Benjamin Franklin) America praises you Will they know what you achieved? Will they know you changed the scheme? The world will always remember, Benjamin [verse] You'll come back In no time You'll recall that you're mine You'll come back Fate will shine You'll recall that I'm fine [verse] Mountains stand, kingdoms crash We've journeyed together, through every clash And when times get tough, I'll dispatch a force that's truly enough to show you my love's vast [chorus] Ba baba ba ba Ba bababa bayaba Baba ba ba bayaba Ba baba ba ba Ba bababa bayaba Baba ba ba ba I won't let my chance go past I won't let my chance go past Hey yo, I'm as strong as my land I'm brave, eager, and grand And I won't let my chance go past [verse] I'ma gain entry to King's College fair I perhaps shouldn't boast, but eh, I shock and astound The hitch is I've got much wit, but lack grace I must shout just to be noticed With each word I impart wisdom I know the scene on the street is thrilling But Lord, amid all the bleeding and brawling I've been studying and penning We ought to address our fiscal condition Are we a land of states, what's the state of our land I'm beyond patient waiting! I'm fervently shattering every anticipation Every deed is an act of innovation I'm smiling in the face of losses and grief For the first time, I'm looking beyond today [chorus] And I won't let my chance pass by I won't let my chance pass by Hey, yo, I'm just like my land I'm brave, strong, and ready to stand And I won't let my chance pass by I won't let my chance pass by I won't let my chance pass by Time to make a try Make a try And I won't let my chance fly [bridge] Not giving up my quest You will thrive with our newfound land We'll strive and toil for you We'll make it fine for you If we build a sturdy base We'll hand it down to you We'll offer the world to you and you'll astound us all through Someday, someday Yeah you'll astound us all through [chorus] I long to be in The place where dreams take flight The place where dreams take flight The place where dreams take flight I long to be in The place where hopes ignite The place where hopes ignite The place where hopes ignite No one truly grasps how the path is laid The skill of the chase How the stars are made We merely suppose that it's made But no one else can take this place [bridge] The place where it starts [chorus] I kept every gift you gave to me From the instant I received them I felt you were mine You claimed you were mine I believed you were mine [outro] Oh, I long to hold you once more It's merely a question of Time Will they recount your tale Time Who thrives, who fades, who narrates your story Time Will they speak of your glory Time [outro] Who weeps, who hopes, who shares your story Who dreams, who schemes, who cares your story Harmonica solo improvisation - A harmonica improvisation at 2:00. Your browser does not support the audio element. Lyrics Generate music from the given lyrics segment by segment. [Genre] Folk Pop male dark vocal Inspiring Piano Uplifting Guitar mellow vocal [verse] Ban Ma Ban Ma Bie Zai Chen Shui Liao Rang Wo Kan Jian Ni Shang Hen Lei Lei De Wei Ba Wo Bu Yuan Hong Peng Ni Na Dao Ba Hen Zhi Xiang Qing Fu Ni Piao Yi De Fa Si [verse] Ban Ma Ban Ma Ni Yi Gui Yu Gu Xiang Er Wo Que Zai Han Leng Zhong Xu Du Nian Hua Ni De Cheng Shi Dui Wo Guan Bi Liao Suo You De Men Fei Zhong Jiu Wo Zhi Neng Zai Ci Ta Shang Gu Du De Lu Tu [chorus] Ban Ma Ban Ma Ni Lai Zi Nan Fang De Fei Hong Zhe Shi Fou Ye Shi Yi Duan Dong Ren Xin Xian De Gu Shi Ruo Ni Shen Pang De Xi Zi Wu Fa Liu Xia Shui Hui Pei Ban Wo Zhi Dao Tian Ming [chorus] Ban Ma Ban Ma Ni Huan Ji De Wo Ma Wo Shi Na Ge Zhi Hui Ge Chang De Sha Gua [chorus] Ban Ma Ban Ma An Mian Ba An Mian Ba Wo Jiang Bei Qi Ji Ta Chi Kai Bei Fang [verse] Ban Ma Ban Ma Ni Huan Ji De Wo Ma Wo Shi Na Ge Zhuang Zuo You Chou De Hai Zi [chorus] Ban Ma Ban Ma An Mian Ba An Mian Ba Wo Hui Jiang Ni De Qing Cao Dai Hui Gu Xiang Ban Ma Ban Ma Ni Huan Ji De Wo Ma [chorus] Wo Zhi Shi Yi Ge Cong Mang De Lu Ren A Ban Ma Ban Ma An Mian Ba An Mian Ba Wo Yao Mai Diao Wo De Fang Zi Man You Yu Tian Ya [outro] Voice Cloning & Style Transfer Voice Cloning Demo 1 Voice Cloning Demo 2 Style Transfer Demo Thanks to the following organizations for their support Tu Pian 1 Tu Pian 2 Tu Pian 3 Citation Copy @misc{yuan2025yuescalingopenfoundation, title={YuE: Scaling Open Foundation Models for Long-Form Music Generation}, author={Ruibin Yuan and Hanfeng Lin and Shuyue Guo and Ge Zhang and Jiahao Pan and Yongyi Zang and Haohe Liu and Yiming Liang and Wenye Ma and Xingjian Du and Xinrun Du and Zhen Ye and Tianyu Zheng and Yinghao Ma and Minghao Liu and Zeyue Tian and Ziya Zhou and Liumeng Xue and Xingwei Qu and Yizhi Li and Shangda Wu and Tianhao Shen and Ziyang Ma and Jun Zhan and Chunhui Wang and Yatian Wang and Xiaowei Chi and Xinyue Zhang and Zhenzhu Yang and Xiangzhou Wang and Shansong Liu and Lingrui Mei and Peng Li and Junjie Wang and Jianwei Yu and Guojian Pang and Xu Li and Zihao Wang and Xiaohuan Zhou and Lijun Yu and Emmanouil Benetos and Yong Chen and Chenghua Lin and Xie Chen and Gus Xia and Zhaoxiang Zhang and Chao Zhang and Wenhu Chen and Xinyu Zhou and Xipeng Qiu and Roger Dannenberg and Jiaheng Liu and Jian Yang and Wenhao Huang and Wei Xue and Xu Tan and Yike Guo}, year={2025}, eprint={2503.08638}, archivePrefix={arXiv}, primaryClass={eess.AS}, url={https://arxiv.org/abs/2503.08638}, }