Evaluation of Newspaper Stories on Drug Therapy with “Media Doctor” Instrument

Abstract

Objective: The objective of this study was to examine information quality by quantitatively evaluating newspaper stories on drug therapy using the “Media Doctor” instrument.

Methods: A database search was conducted to extract newspaper stories on drug therapy published between July 1, 2017 and December 31, 2017. Two evaluators independently evaluated each story using the “Media Doctor” instrument. Each of the 10 evaluation criteria were rated as “satisfactory” or “not satisfactory.” When the content of the story was not suitable for the evaluation criteria, it was regarded as “not applicable”.

Results: Fifty-nine news stories (Asahi: 13, Mainichi: 8, Nikkei: 8, Sankei: 14, Yomiuri: 16) were included. The median number of evaluation criteria that the two evaluators judged as “satisfactory” was 5. The proportions of stories that the two evaluators judged as satisfactory were “1. availability,” 73%; “2. novelty,” 66%; “3. alternatives,” 39%; “4. disease mongering,” 58%; “5. evidence,” 32%; “6. quantification of benefits,” 31%; “7. harm,” 41%; “8. cost,” 22%; “9. sources of information/conflict of interest,” 12%; and “10. headline,” 66%. Conversely, the proportions of stories judged as “not satisfactory” were “1. availability,” 0%; “2. novelty,” 5%; “3. alternatives,” 12%; “4. disease mongering,” 8%; “5. evidence,” 24%; “6. quantification of benefits,” 29%; “7. harm,” 41%; “8. cost,”44%; “9. sources of information/conflict of interest,” 32%; and “10. headline,” 12%.

Conclusion: These results suggest that the quality of newspaper stories are insufficient as drug information in terms of the validity of its scientific evidence.