In this paper, we present the development of a virtual-sound table-tennis system using a 3D-immersive auditory display based on the boundary-surface control (BoSC) principle. Sound table-tennis is a modified version of table-tennis for visually impaired people, in which the players are required to roll a ball from one end of the table to the other, instead of hitting ball over the net. Using a sound-ball and special racket, players may hit the ball by listening for the direction from which the ball is rolling towards them. Our proposed system reproduces the rolling sound by using 3D-immersive auditory display, referred to as a ‘Sound Cask’, and the player is asked to assess the direction of the ball by perceiving the virtual sound source to return the ball. Using a motion sensor, the system detects the hitting action of the player and reproduces the rolling sound. We introduce system configurations and design methods and conduct experimental studies to confirm the applicability of the system. From experimental results, localization was found to improve after the training session of virtual-sound table tennis.