In this paper, a transmission data format and a corresponding free viewpoint generation method are proposed to realize free viewpoint 3D video functionality under restricted transmission capacity. In former works, so called hybrid approach by which model and ray information are transmitted and free viewpoint video is generated from the received signal has been already studied. However, further improvement regarding the data compaction performance and the scalable accessibility was required especially for the transmission data format. Therefore, we propose a novel data format based on ray space description with polygonal mesh. From experimental results, it was confirmed that our proposed scheme efficiently reduced the transmitted data amount while providing the scalable accessibility achieved by adjusting the number of recorded planes assigned for ray information.