The effects of thermally stabilized particles in Al–Mg–Si alloy on recrystallization behavior were investigated to obtain fundamental knowledge to control microstructure, texture and mechanical properties of this alloy. In this study, the Al–Mg–Si–Sc–Zr alloy was cast, homogenized and hot rolled. Three types of spherical Al3(Sc, Zr) particles with L12 structure: rod-like incoherent, spherical semi-coherent and spherical incoherent particles were observed in the hot-rolled sample in the Al–Mg–Si–Sc–Zr alloy by using TEM, STEM and EDS. In addition, it was found that all particles have the core-shell structure with the core enriched with Sc and the shell enriched with Zr atoms by 3D-ET and STEM-EDS. It is considered that these particles are formed during casting, homogenized treatment and hot rolling. The results of crystal orientation distribution of annealed sample after cold rolling indicated that the presence of Al3(Sc, Zr) particles may interfere with the recrystallization (the grain growth) until 600°C. From the comparison with the driving force of primary recrystallization and grain growth, and the pinning force of Al3(Sc, Zr) particles, it was suggested that these particles mainly contribute to the suppression of grain growth. The results of in-situ heating SEM/EBSD analysis of cold rolled Al–Mg–Si–Sc–Zr alloy supported the suggestion.