There is a serious conflict between proponents and opponents of the promotion of evidence-based policy (EBP) and practice. The biggest point of contention there is the relationship between evidence and the expertise of teachers. In an article in the 2015 special edition of the Japanese Educational Research Association's journal, the four authors (Imai, Ishii, Matsushita, and Sugita) were all critical of EBP, addressing this point as an issue. However, all of them couch their critique in terms of clarifying the flaws of EBP from the viewpoint of the originality of education, a line of reasoning which seems unlikely to convince EBP supporters. This paper presents the limitations and emerging challenges of EBP through a critical examination of the premises "within" EBP.
The diversity of positions surrounding EBP can be roughly captured on a continuum. At one extreme are the "tough-minded" advocates for EBP. However, there are also softer positions within this camp. At the other extreme are the "tender-minded" advocates, who are skeptical of EBP.
A tough-minded position can be seen in national policies, such as the adoption of EBP in the US and UK. Randomized controlled trials (RCTs) are hailed as the gold standard for proving causal effects, as they can lead to strong evidence that "X caused Y" when certain conditions are met.
The tender-minded position does not see education as a causal process and therefore rejects EBP. In this position, RCTs are supposed to be able to procure the knowledge of “what worked” about the past, which is considered to play a marginal role at best.
Finally, the softer position in the middle gives a new perspective to EBP while borrowing knowledge from recent scientific philosophy. First, the concept of causality is transformed into the concept of the INUS condition. This allows us to theoretically consider the singular causal prediction of "it will work here." While RCTs certainly lead to "it worked there," the conditions that allow the leap from "it worked there" to "it will work here" must be explored. It is the context that matters. In the INUS approach, an argument procedure is taken to first clarify what kind of causal structure and support factors existed when "it worked there," and to try to apply it "here" while making local adjustments.
But according to Cartwright and others, uncertainties will always remain no matter what strategy is taken. At this point, the argument approach has its limitations and inevitably requires local value judgments. In other words, in EBP, from the standpoint of people who live "here," faced with the uncertainties created by local and dynamic contexts, it is necessary to address the questions of what kind of research knowledge and what kind of dialogue should be conducted, and how to grasp the objectivity of the inevitable value judgments.
Exploring a softer approach to EBP, drawing on insights from the philosophy of science, results in a return to the need for professional judgment. This is not, however, because of education, but because EBP itself inevitably comes with value judgments.
View full abstract