We discuss the plastic flow of granular media performed under the principal stress axes rotation with the aid of numerical experiments. A series of numerical tests consists of the shear tests and the stress probe tests using a 3-dimensional Granular Element Method. We examine incremental plastic strain response under the principal stress axes rotation in detail after determining parameters for simulations by comparing shear test simulations with experimental results in literature. In particular, on the incremental non-linearity of the plastic strain increment, we discuss the similarity between real experiments and simulations, as well as the mechanism of the nonlinearity.