音楽のリアルタイム・CGによる可視化

抄録

  This report writes about the computer graphics system which generates 3 dimensional computer graphics driven by music in real-time. The motivation of this research was "What can I do to generate images for all kind of music in real-time?"

  The approach was made aesthetically and technically.

 - One of the interpretation of music is to 'show' the tone and dynamics.

 - Graphical interpretation shuld be abstract for all kind of music.

 - User interface should be musical keyboard or drum pad or some kinds of instrument.

 - Performance information should be processed in real-time.

  The reaction should be caused in 0.1 sec.

  The drawing speed should be 10 Hz in the least. Generally, needs 30 Hz or higher.

  The system "Sound Visualizer" was developed under the research.

  The system specification:

 (1) Accepts MIDI signals and generates 3D CG 'Sound Objects' in real-time.

    The Sound Objects expresses musical dynamics in real-time.

    The drawing frame rate is over 30 Hz.

 (2) Has fast drawing algorithm using parallel processor computer SGI/Onix.

 (3) Provides virtual reality environment with musicians.

    Some musicmans said "This is really fun."