This paper presents an inverse scattering technique for a defect in anisotropic solids. The convolution quadrature time-domain boundary element method (CQBEM) is utilized to obtain scattered ultrasound wave data. The wave forms obtained by CQBEM are adequately treated to implement the shape reconstruction of defects in anisotropic solids. After the anisotropic elastodynamic theory is discussed, formulations for the inverse scattering technique are presented. Numerical examples for a defect in unidirectional carbon fiber-reinforced composite, austenitic steel, and isotropic steel are shown to validate the proposed methods.