BPB Reports
Online ISSN : 2434-432X
Report
Comparison of Predictive Performance of Drug Dose Settings Using Renal Function Estimation Equations Based on the Japanese Population: A Preliminary Retrospective Study Using Vancomycin Dosing Data
Shungo Imai, Soyoko Kaburaki, Takayuki Miyai, Hitoshi Kashiwagi, Mitsuru Sugawara, Yoh Takekuma
著者情報
ジャーナル オープンアクセス HTML

2019 年 2 巻 5 号 p. 80-85

詳細
Abstract

The Cockcroft–Gault (C–G) equation is widely used for drug dose settings in Japan. However, several reports have questioned its accuracy. In previous decades, estimation equations of creatinine clearance (CCr), such as the Orita–Horio equation, have been established based on the Japanese population. We previously built the fitted C–G and fitted Orita–Horio equations by fitting the coefficients of the estimation equations to the study population. However, the usefulness of these equations for drug dose settings remains unclear. Our preliminary study verifies the accuracy of these equations by comparing the predictive performance of the initial vancomycin (VCM) trough value between four equations: the conventional C–G (as control), conventional Orita–Horio, fitted C–G, and fitted Orita–Horio equations. Patients receiving VCM intravenously between January 2015 and March 2019 at Hokkaido University Hospital were enrolled. Overall, 308 patients were included. As initial dose setting methods, we selected two therapeutic drug monitoring (TDM) analysis software: SHIONOGI-VCM-TDM ver.2009 (VCM-TDM) and Vancomycin MEEK TDM analysis software Ver2.0 (MEEK). Predictive performances were evaluated by calculating mean prediction error and mean absolute prediction error (MAE). The lowest MAE was obtained with the conventional C–G equation using VCM-TDM, indicating high predictive performance. However, contrasting result was obtained with MEEK, where the highest MAE was obtained using conventional C–G equation. Moreover, no significant differences were observed in MAE between the other three equations, suggesting that accurate dose settings are not always achieved, despite using accurate CCr equations based on the Japanese population.

INTRODUCTION

Accurate evaluation of renal function is important for dose settings of renal excretion-type drugs. The Cockcroft–Gault (C–G) equation for the estimation of creatinine clearance (CCr), established based on the data of 249 Western patients,1) is widely used for determining drug dose settings in Japan.2,3) Using this equation, users can estimate the CCr quickly and easily. However, several reports have questioned the accuracy of using the C–G equation. It has been reported that the C–G equation tends to deviate from the actual values measured in elderly individuals.4–6) In addition, this equation has a risk of overestimating drug doses in obese patients from the use of real body weight.7,8)

Over several decades, equations for estimation of CCr, such as the Orita–Horio equation, were established based on Japanese patient data.9) The Orita–Horio equation has succeeded in improving the predictive accuracy of CCr compared with the conventional C–G equation. In our previous study, we evaluated these equations by comparing measured CCr data.10) Moreover, we successfully developed the fitted C–G and fitted Orita–Horio equations by fitting the coefficients of the estimation equations to the study population, taking into particular consideration elderly patients.10) However, the usefulness of these CCr estimation equations for drug dose settings remains unclear.

Intravenously administered vancomycin (VCM) is one of the renal excretion-type antibiotics and is the first-line therapy for methicillin-resistant Staphylococcus aureus infections.11) As a preliminary study, we selected this antibiotic for validating the accuracy of drug dose settings of four CCr estimation equations: conventional C–G,1) conventional Orita–Horio,9) fitted C–G, and fitted Orita–Horio equations.10) One of the advantages of using VCM for this study is that patients treated with this agent routinely require therapeutic drug monitoring (TDM), meaning that the serum trough value can be obtained easily.11,12) Moreover, approximately 200 patients received VCM within one year at the Hokkaido University Hospital,13) and initial dose settings were also determined by pharmacists based on CCr calculated using the conventional C–G equation.14) At our hospital, we employ the TDM analysis software for determining the initial dose settings of VCM, constructed using pharmacokinetic (PPK) parameters of the Japanese population.14,15) The target trough level of VCM was set to 10–20 mg/L based on several guidelines.11,12,14)

In our previous study, we compared the predictive performance of two TDM analysis software, namely “SHIONOGI-VCM-TDM ver.2009 (VCM-TDM)” and “Vancomycin MEEK TDM analysis software Ver2.0 (MEEK).”16) We determined that VCM-TDM showed a higher predictive performance than MEEK; as a result, VCM-TDM is employed at our hospital.14,16) Thus, it is essential to verify whether the prediction performance changes if the CCr estimation equations that are constructed or fitted based on Japanese patients are inserted into these TDM analysis software.

In this study, our objective was to validate the usefulness of CCr estimation equations that were constructed or fitted based on Japanese parameters for determining dose settings of renal excretion-type drugs. Specifically, we compared the predictive performance of initial VCM trough values among conventional C–G (used as a control), conventional Orita–Horio, fitted C–G, and fitted Orita–Horio equations using two TDM analysis software.

MATERIALS AND METHODS

Patients

All data were obtained retrospectively from the patients’ medical records at Hokkaido University Hospital. Patients who had received VCM intravenously from January 2015 to March 2019 were included in our study if they (1) were aged ≥18 years, (2) had a VCM trough value at the steady state, and (3) had their initial VCM dose settings determined by pharmacists. Patients were excluded if they (1) received VCM therapy <3 days, (2) received initial VCM loading dose, (3) received renal replacement therapy, such as hemodialysis and continuous hemodiafiltration, or (4) had nephrotoxicity before the VCM trough value was measured. The steady state was defined as the duration from the beginning of administration to when the initial TDM was more than 4 half-lives of VCM.17) Half-lives were calculated individually based on the Japanese PPK parameters reported by Yasuhara et al.15) At our hospital, as described above, initial dose settings were performed using the TDM analysis software VCM-TDM.14,15) In addition, nephrotoxicity was assessed if the serum creatinine (Scr) level increased to at least 0.5 mg/dL or 50% or higher from the baseline.11)

Outcomes

The primary endpoint was to assess the predictive performance of the initial VCM trough value of the CCr estimation equations: the conventional C–G (as control), conventional Orita–Horio, fitted C–G, and fitted Orita–Horio equations. The latter three equations were constructed or fitted based on Japanese data.9,10) As initial dose setting methods, we selected two TDM analysis software that incorporate Japanese PPK parameters15,18): “VCM-TDM” and “MEEK.” We evaluated predictive performances by calculating the mean prediction error (ME) and mean absolute prediction error (MAE) as follows19):

As a secondary endpoint, we evaluated ME and MAE by dividing patients into subgroups based on their gender, CCr, and age. CCr was calculated using the conventional C–G equation and classified as CCr ≥ 85 mL/min or < 85 mL/min.16) Age was classified as generation I (20–39 years), generation II (40–64 years), generation III (65–74 years), and generation IV (over 75 years).10)

Renal Function Estimation Equations

Estimation equations of renal function were evaluated as follows: IBW, ABW, TBW, and BMI indicate ideal body weight, adjusted body weight, total body weight, and body mass index, respectively.

For calculating the C–G and fitted C–G equations, body weight was adjusted based on the degree of obesity, defined as “[TBW − IBW] × 100/IBW (%)”.10) If the degree of obesity was between 30% and 100%, IBW was used for CCr calculations. When the degree of obesity was more than 100%, ABW was employed. Equations of IBW and ABW were as follows:

For calculation of the Orita–Horio and fitted Orita–Horio equations, body weight was not adjusted because BMI is already incorporated as a parameter in these equations.

Data Collection

We collected data for age, gender, body weight, BMI, Scr, duration of VCM therapy, duration in the intensive care unit, initial VCM trough value, and days to initial TDM. All data were evaluated at the beginning of VCM administration, except for duration of VCM therapy, initial VCM trough value, and days to initial TDM.

Statistical Analysis

For comparison of MAE and ME among the four groups (i.e., conventional C–G, conventional Orita–Horio, fitted C–G, and fitted Orita–Horio equations), Bonferroni multiple comparison test was performed. P ≤ 0.05 was defined as statistically significant.

All statistical analyses were performed using SPSS statistics 25 (IBM, Tokyo, Japan).

Ethics

This study was performed in accordance with the guidelines for the care for humans. The ethics committee of Hokkaido University Hospital approved our protocol (NO. 019-0038).

RESULTS

Characteristics of patients

Of the 977 initial patients, 308 were included in the study (Fig. 1). Patient characteristics are shown in Table 1. The average CCr estimated by each equation was as follows: conventional C–G, 102.0 ± 46.9 (mean ± standard deviation) mL/min; conventional Orita–Horio, 115.0 ± 44.3 mL/min; fitted C–G, 132.7 ± 57.2 mL/min; and fitted Orita–Horio, 130.9 ± 51.6 mL/min. The distribution of CCr estimated by each equation is shown in the box plot in Fig. 2. The average initial VCM trough value was 11.6 ± 4.93 mg/L.

Fig. 1

Study Inclusion and Exclusion Flowchart

Table 1. Patient Characteristics
Fig. 2

Distribution of CCr Values Calculated Using Each CCr Estimation Equation

Each box plot shows the distribution of creatinine clearance. Each box shows: upper horizontal line of box, 75th percentile; lower horizontal line of box, 25th percentile; horizontal bar within box, median; upper horizontal bar outside box, 90th percentile; lower horizontal bar outside box, 10th percentile. CCr: creatinine clearance, Conv: conventional, C–G: Cockcroft–Gault equation, Orita: Orita–Horio equation.

Comparison of Predictive Performance of Initial VCM Trough Value of Each CCr Estimation Equation

Table 2 shows the predictive performances of each CCr estimation equation using VCM-TDM. As for the ME, the conventional C–G equation was found to be significantly the closest to 0 points in all subgroups, except for generation I patients and patients with CCr ≥ 85 mL/min. This implies that the prediction bias was lower with the conventional C–G equation than with other equations, although they were all constructed or fitted based on Japanese data. In addition, the lowest value of MAE was obtained using the conventional C–G equation except for female patients, generation I and II, and patients with CCr ≥ 85 mL/min and < 85 mL/min, indicating high predictive performance.

Table 2. Predictive Performance of Initial VCM Trough Value of Each CCr Estimation Equation Using TDM Analysis Software VCM-TDM

As shown in Table 3, the opposite results were obtained using the TDM analysis software “MEEK.” The ME and MAE values obtained using the conventional C–G equation were significantly higher than when other equations were used, except in the case of generation I patients, patients with CCr ≥ 85 mL/min and < 85 mL/min. Additionally, there were no significant differences in MAE among the other three equations in all the groups. A positive ME indicates that the predicted trough value is higher than the actual trough value, and therefore, the equation has a risk of underestimating the VCM dose, indicating low predictive accuracy.

Table 3. Predictive Performance of Initial VCM Trough Value of Each CCr Estimation Equation Using TDM Analysis Software MEEK

DISCUSSION

Previous studies indicated that the predictive accuracies of CCr were improved using conventional Orita–Horio, fitted C–G, and fitted Orita–Horio equations that were constructed or fitted based on data obtained from the Japanese population.9,10) However, it is unknown whether these CCr estimation equations are useful for accurately predicting drug dose settings. As a preliminary study, we evaluated the predictive performances of these equations using VCM dosing data.

In the index of predictive performances, ME indicates prediction bias because a positive ME indicates that the predicted trough value is higher than the actual value. MAE measures the average value of the prediction error without considering whether they are under or over that of the actual value; thus, MAE is an indicator of the predictive accuracy.18) As shown in Table 2, the conventional C–G equation produced a higher ME (−1.56) than the other three equations (−5.10 to −3.65) in all patients using the VCM-TDM software. Thus, an ME value is closest to 0 point in the conventional C–G equation indicating that the prediction bias is the smallest. In contrast, using the MEEK software, the same trend was established. However, the values were positive; the conventional C–G equation (5.90) produced a higher ME than the other equations (2.78–3.54) (Table 3). Thus, the prediction bias is the largest in the conventional C–G equation. These results are considered to be caused by the differences in estimated CCr values and PPK parameters between the two TDM analysis programs. The average CCr of each equation ranged from 102.0 to 132.7 mL/min (Table 1). The lowest CCr was obtained in the conventional C–G equation. In addition, fitted C–G and fitted Orita–Horio equations estimated a higher average CCr than the conventional equations.9) In contrast, previous research showed that lower ME values (negative values) were obtained using VCM-TDM compared with MEEK (positive values); consequently, VCM-TDM has a risk of overdosing when determining settings and MEEK has a possibility of underestimation.16) Considering this, our results can be explained as follows: VCM-TDM tends to overdose,16) and therefore, the ME becomes close to 0 points if using the conventional C–G equation that has a lower calculated CCr value than the other equations. Thus, a high predictive accuracy (i.e., a low MAE) was obtained (Table 2). On the other hand, MEEK tends to underdose,16) and therefore, the ME moves away from 0 points when using the conventional C–G equation. Hence, a low predictive accuracy (i.e., a high MAE) was obtained. Similar trends were observed in generations II–IV and patients with CCr < 85 mL/min (Table 3).

In contrast, on using MEEK for generation I patients and patients with CCr ≥ 85 mL/min, there were no significant differences in MAE and ME between each of the CCr equations (Table 3). In patients with CCr ≥ 85 mL/min (calculated using conventional C–G equation), the CCr is fixed at 85 mL/min uniformly in the MEEK program. This function is set because the VCM clearance was not correlated in patients with CCr ≥ 85 mL/min in the parameters of the MEEK program.18) In generation I, only one patient had a CCr < 85 mL/min estimated using the conventional C–G and Orita–Horio equations, but all other patients had a CCr ≥ 85 mL/min (data not shown). Therefore, MAE and ME gave similar results between each equation. These results were similar to those obtained in previous research, which showed that MEEK has a risk of underdosing, especially in young patients.16)

In summary, the optimal combination of software and equations for the estimation of CCr for the initial dose setting of VCM were considered as follows. For VCM-TDM, when classified by age, the conventional C–G equation achieved the best predictive performance (i.e., the smallest MAE) except for generation I and II (Table 2). Therefore, the conventional C–G equation should be used except for these two generations. Although there is no significant difference, the conventional C–G equation may be better for generation I, whereas the conventional Orita–Horio equation may be better for generation II. In contrast, in the MEEK, the conventional C–G equation achieved the worst predictive performance (i.e., the highest MAE) except for generation I (Table 3). Thus, we recommend using the other three equations. For example, based on the smallest MAE, generation II: fitted Orita–Horio, generation III: fitted C–G, and generation IV: conventional Orita–Horio equations may be recommended (although there are no significant differences between three equations). In addition, as explained above, MEEK should not be employed for generation I because of the risk of underdosing.

In a previous study of the fitted C–G and fitted Orita–Horio equations, the predictive accuracy of the CCr was reported to be improved especially in the elderly; however, young individuals aged under 40 years could not be evaluated due to the lack of patients.9) However, differences in MAE and ME were not observed between each generation in this study (Table 2, 3). The reason for this is that the predictive performances of the equations are strongly influenced by PPK parameters built in the TDM analysis software as mentioned above.

Consequently, we suggest that accurate dose settings are not always achieved, even if accurate CCr equations based on the Japanese population are used. One of the reasons for this is that equations for renal function estimation (i.e., conventional C–G equation) used for PPK parameters are different from equations for drug dose settings. Thus, in order to utilize the new equations for renal function estimation for determining drug dose settings, it is necessary to conduct new PPK analysis, or at the very least, retrospectively verify the findings of previous studies.

Our study has several limitations. This study was conducted at a single center, and therefore, it is unclear if the same results can be obtained at other institutions. In addition, as this is a preliminary study using VCM dosing data, it is necessary to validate these results with other renal excretion-type drugs. Importantly, this study could not evaluate measured CCr, and therefore, it is unclear whether the calculated CCr values are truly accurate.

Notwithstanding, evidence in this study does indicate that an accurate renal function assessment does not always contribute to accurate drug dose settings, especially initial dose settings of VCM using TDM analysis software. We expect that these results will be useful to perform appropriate drug dose adjustments.

Conflict of interests

The authors declare no conflict of interests.

REFERENCES
 
© 2019 The Pharmaceutical Society of Japan

BPB Reports applies the Creative Commons Attribution (CCBY) license to works we published. The license was developed to facilitate open access - namely, free immediate access to, and unrestricted reuse of, original works to all types. Under this license, authors agree to make articles legally available for reuse, without permissions of fees, for virtually any purpose. Anyone may copy, distribute, or reuse these articles, as long as the author and original source are properly cited.
https://creativecommons.org/licenses/by/4.0/
feedback
Top