<aside> 💡 Pop2Piano is the task of generating a piano arrangement from a given pop music audio.
</aside>
[KOR] POP2PIANO : POP SONGS 2 PIANO ARRANGEMENTS
Arranging pop music into piano music is something that only music experts can do. This arrangement of music is used for hobbies, education, and business purposes. The MIR field has developed a lot using deep learning technology. Deep learning can analyze the genre or mood of pop music (Music Tagging, Music Mood Estimation) [1] and automatically generate pop MIDI (MIDI Generation) [2]. In addition, there has been a lot of progress in estimating piano MIDI from raw audio*(Music Transcription)*. However, as far as we know, there was no work of arranging pop music directly into piano performance using deep learning. We call this work Pop2Piano.
Pop2Piano is the work of generating piano arrangements conditioned on pop music. Through the automated data collection/purification process, we created a dataset with thousands of pop music and piano arrangement MIDI pairs.
We are conducting research to automatically arrange pop music on the piano by learning patterns of these data using deep learning. Below is a sample of the data. (It is optimized for stereo audio. One side is the piano and the other side is the original. )
(KPOP Male Group) BTS - Butter
2zalY1icUeI___171___jH--Wof3HfQ___171.mp3
(KPOP Female Solo) Rosé - On the Ground
rose_YOQm9NSASDM___175___xOSmS2VEjpQ___167.mp3
(POP Mixed Vocal) Ryan Gosling & Emma Stone - City of stars