This paper reviews some counterexamples in numerical analysis for solving partial differential equations. We point out the danger of having a preconception regarding the fact that a numerical solution is correct. Counterexamples, on the other hand, are interesting research subjects by themselves and could give new insights.