Assuming that each patient is examined by two different diagnostic tests, new and standard, we deal with in this paper the problem of comparing the two tests based on categorical scores measured by multiple readers. An exact method is developed based on conditional inference for a comparison parameter. The method is applied to the data for comparing a new test and the standard test that are developed for diagnosing whether a patient is contracted with epidermal cyst or ganglion.
