In recent years, the large amount of photovoltaic generation system (PV) is installed in the distribution system. However, violent voltage fluctuation caused by PV output will make it difficult to maintain the distribution line voltage within a proper range. Furthermore, the voltage imbalance that make difficult to control the line voltage is also severe problem. In order to overcome these problems, fast voltage control devices, such as Dynamic Voltage Regulator (DVR), STATic Synchronous COMpensator (STATCOM), and so on, are studied, however they have problem of expensive cost. From this background, Hybrid Voltage Regulator (HVR) which is composed of a small capacity converter and tap changing circuit by thyristor switches is proposed and fundamental control evaluation is presented in past paper. This paper proposes the control algorithm of HVR to suppress the voltage imbalance and to maintain the line voltage within a proper range. The proposed method is also evaluated by the simulation of a long line distribution model.