Exploring the Potential and Challenges of Interactive Music Generation with GPT-4

Abstract

In recent years, media generated by generative AI has received a lot of attention. Recently, Diffusion-based text to music automatic composition systems have been attracting attention. This research focuses on the commonality that both music and language can be expressed symbolically, and explores the ability to compose music on GPT-4 by treating music as a plain text expression using ABC notation. As a result of the experiment, we confirmed that the text has a certain compositional ability by matching the latent space architecture and musical knowledge. Based on this, we developed the "Grazie Piano Tuner", a composition support system, which has the ability to change the melody by controlling the emotional parameters. Currently, we are working on implementing a means to control emotional parameters as time-series information. In the presentation, we will discuss the possibilities and challenges of a composition support system using LLM while introducing actual examples using this system.