We have proposed a generation alternation model for co-evolutionaryoptimization of strategies in one-to-one competitive games. In themodel, however, the populations of strategies are often trapped intolocal optima. To remedy the drawback, we propose an extended version of the model, which explicitly maintains diversity of the populations.The experimental results show that the proposed model performs betterover the previous one on a benchmark problem.