|
|
||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Economics |



* Internal Medicine, University of Virginia Health System, Charlottesville, Virginia;
Renal, Electrolyte, and Hypertension Division, University of Pennsylvania, Philadelphia, Pennsylvania;
Global Clinical Affairs, Baxter Healthcare, Renal Division, McGaw Park, Illinois;
Center for Clinical Epidemiology and Biostatistics, Renal, Electrolyte, and Hypertension Division, University of Pennsylvania, Philadelphia, Pennsylvania
Correspondence: Dr. Harold I. Feldman, University of Pennsylvania, School of Medicine; 923 Blockley Hall, 423 Guardian Drive, Philadelphia, PA 19104-6201. Phone: 215-898 0901; Fax: 215-898-0643; E-mail: hfeldman{at}mail.med.upenn.edu
| Abstract |
|---|
|
|
|---|
Design, setting, participants, & measurements: A Markov model was designed to evaluate the cost-effectiveness of reporting eGFR compared with reporting sCr alone in a hypothetical cohort of 60-yr-old individuals undergoing annual blood chemistry testing over 18 yr. Paths and path probabilities were identical between the two arms, except for the sensitivity and specificity of eGFR and sCr to detect CKD.
Results: eGFR reporting was dominant with a cost/effectiveness ratio of $16,751/quality-adjusted life year (QALY) versus $16,779/QALY for sCr reporting. Monte Carlo microsimulations in a hypothetical cohort of 10,000 patients demonstrated that over 18 yr, an average of 13 fewer deaths, 29 fewer ESRD events, and 11,348 more false positive CKD (FP-CKD) cases occurred with eGFR reporting. A sensitivity analysis revealed that decreasing the FP-CKD quality of life by > 2% rendered sCr reporting more cost-effective than eGFR reporting. If FP-CKD reduced quality of life by 5%, the incremental cost-effectiveness ratio for sCr reporting versus eGFR reporting would be $4367/QALY.
Conclusion: A decision analysis suggests that reporting eGFR may be beneficial, but this limited benefit was reversed with virtually any reduction in quality of life caused by incorrect diagnosis of CKD.
| Introduction |
|---|
|
|
|---|
Although examining serum creatinine alone is an insensitive method of detecting CKD (5,6), equations have been developed that use serum creatinine in addition to clinical and demographic data to estimate the GFR. The most extensively studied of these equations is the Modification of Diet in Renal Disease (MDRD) equation. Although a more sensitive measure than serum creatinine alone for CKD detection, MDRD underestimates measured GFR (mGFR) in healthy patients (7–11). False positive diagnosis with CKD can engender costs from additional clinical evaluations and, potentially, reduce quality of life.
Interest in identifying patients with unrecognized CKD has led many healthcare center laboratories to report eGFR automatically when a serum creatinine test is requested. As of November 2007, Connecticut, Louisiana, Michigan, New Jersey, Pennsylvania, and Tennessee have mandated eGFR reporting (12,13). Despite this important change in practice, few studies have investigated the impact of routine reporting of eGFR (14).
The aim of this study was to assess whether routine reporting of eGFR is cost-effective compared with reporting serum creatinine alone. We hypothesized that reporting eGFR with serum creatinine would increase detection of true CKD, but also lead to the false identification of healthy individuals as CKD patients, thereby limiting the cost-effectiveness of the strategy of universal reporting of eGFR. We also hypothesized that the cost-effectiveness of routine reporting of eGFR would be strongly influenced by any decrement in health-related quality of life resulting from a false positive diagnosis of CKD.
| Materials and Methods |
|---|
|
|
|---|
Six health states were included in the model: (1) no kidney disease or early stages of kidney disease, which included all patients with GFR
60 ml/min/1.73 m2 in the "true negative" state (TN-CKD); (2) CKD in the "true positive" state (TP-CKD); (3) CKD in the "false negative" state (FN-CKD); (4) no kidney disease or early stages of disease in the "false positive" state (FP-CKD), among patients with a GFR
60 ml/min/1.73 m2 and an incorrect diagnosis; (5) ESRD, which included all patients with eGFR < 15 ml/min per 1.73 m2 and did not distinguish among transplant recipients, hemodialysis patients, and peritoneal dialysis patients; and (6) death. Figure 1 shows these health states and possible transitions between states.
|
Patients were distributed initially between TN-CKD, TP-CKD, FN-CKD, and FP-CKD on the basis of CKD prevalence and test characteristics (see Transition Probabilities) and were then able to move through the model as follows (see Figure 1):
(1) Patients in the TN-CKD state could not move directly to ESRD. We assumed that patients with such rapid progression would be a minimal fraction of the total ESRD population and would be detected regardless of eGFR reporting practices. (2) TP-CKD and FN-CKD patients could not return to the TN-CKD or FP-CKD states. Thus, acute kidney injury was not considered in our model because we assumed a nephrologist would follow the great majority of these patients regardless of eGFR reporting practices. (3) Patients could not return to TN-CKD, TP-CKD, FN-CKD, or FP-CKD after entering ESRD. (4) TP-CKD patients could not transition to FN-CKD. (5) Death was the only absorbing state.
On the basis of the sensitivity and specificity characteristics of eGFR and serum creatinine, some patients in each cycle moved from TN-CKD to FP-CKD. We assumed that the majority of actual patients falsely diagnosed with CKD would have further evaluation of their renal function with an outpatient evaluation, after which they would be correctly recognized as having no kidney disease. All FP-CKD patients incurred the one-time costs of diagnostic workup and returned to the TN-CKD state after one cycle. In summary, the model treats eGFR < 60 ml/min/m2 or an elevated serum creatinine as possible evidence of CKD; these patients are then assumed to undergo additional confirmatory evaluation by a nephrologist.
Transition Probabilities
Movement between states was dependent on incidence and prevalence of CKD, sensitivity and specificity of serum creatinine or eGFR to detect CKD, the probability of progressing from CKD to ESRD with and without optimal renal management, mortality without CKD, mortality for CKD patients with and without optimal renal management, and mortality with ESRD. Optimal renal management in this study included BP control and the use of angiotensin-converting enzyme inhibitors (18,20-22). Values and data sources are listed in Table 1.
|
Mortality, Morbidity and Effects of Therapy
Age-specific mortality in U.S. patients without CKD was estimated from United States Life Tables (23). We estimated annual mortality in CKD patients from published studies (3,18–21). Stage-specific mortality was published in Go et al. (3), so for CKD patients in our study, a weighted average was calculated to represent mortality in stages 3 to 4
The effect of therapy on mortality was represented by a factor (CKD mortality coefficient) by which annual CKD mortality was multiplied (< 1 = protective, 1 = no effect, > 1 = harmful). We found conflicting data regarding the effect of appropriate medical treatment on mortality in CKD patients (18,20,21). Given these data, we used 1 as the CKD mortality coefficient, meaning therapy had no effect on mortality, but we examined lower values in a sensitivity analysis.
The effect of therapy on CKD progression to ESRD was represented by a CKD progression coefficient by which annual probability of progressing from CKD to ESRD was multiplied (20,21). Age-specific mortality in ESRD was estimated from United States Renal Data System (USRDS) Annual Data Report (ADR) data (24).
Sensitivity and Specificity of Serum Creatinine Versus eGFR
We searched for published studies that estimated the sensitivity and specificity of eGFR and/or serum creatinine in the general population with reference to mGFR (such as evaluated by iothalamate clearance) and that defined CKD as a GFR < 60 ml/min/1.73 m2. Currently available studies, however, used a variety of eGFR, serum creatinine, and mGFR thresholds to define the testing characteristics of eGFR and serum creatinine. In addition, some of the studies were not performed exclusively in the general population.
On the basis of studies that examined the four-variable MDRD equation, we selected a mean eGFR sensitivity of 0.924 and specificity of 0.835 as base-case values for our model (25,26). These values were used in conjunction with other variables to transition patients into the four health states of TN-CKD, FN-CKD, TP-CKD, and FP-CKD.
We selected a mean sensitivity of 0.559 and specificity of 0.950 of serum creatinine for our base-case model using data from studies that compared serum creatinine alone to mGFR (27–29). These studies used cut-offs for abnormal serum creatinine that ranged from 1.06 to 1.36 mg/dl and mGFR thresholds to define CKD that ranged from 60 to 72 ml/min and ml/min/1.73 m2.
Utilities
Values for health utilities are presented in Table 2. A maximum utility of 1 was allocated to patients in the state of TN-CKD, and a minimum utility of 0 was reserved for death; CKD was assigned an intermediate value based on a study of CKD patients (30). We assigned identical QALYs to the states of FN-CKD and TP-CKD. The health state of FP-CKD was given a base case utility of 1. For ESRD, we used a mean QALY value based on 62 quality-of-life estimates in different ESRD populations (31). Health utilities were discounted at an annual rate of 3%.
|
|
Annual health costs in TN-CKD=(Annual health costs of controls from Smith/Annual health costs of CKD patients stage 3 to 4 from Smith) x (Annual health costs in CKD patients from ADR)
No data were found that distinguished between health costs in recognized versus unrecognized CKD; therefore, the states of TP-CKD and FN-CKD were assigned identical costs.
Annual health costs for ESRD were estimated for patients over age 65 on the basis of costs and point prevalence counts of ESRD documented in the ADR by age category (24).
All individuals who transitioned to the states of TP-CKD or FP-CKD were assigned the one-time cost of an outpatient nephrology evaluation. We conferred with a group of academic nephrologists at our institution to define a set of tests that would likely be performed for newly diagnosed CKD. This consisted of a new patient visit, a repeat patient visit, a renal metabolic panel, complete blood count, urinalysis, urine protein, urine creatinine, and a limited retroperitoneal ultrasound (33). The state of FP-CKD was assigned annual health costs equaling those of TN-CKD plus the additional cost of the one-time evaluation.
A one-time cost was assigned when patients transitioned to death representing the average incremental costs of care during the final year of life (34). All costs were discounted at an annual rate of 3% and adjusted to 2005 dollars.
Statistical Analyses
A Markov model was created using Pro Suite 2008 (TreeAge; Williamstown, MA). The initial distribution of the population was based on the prevalence of CKD stages 3 to 4 (1). Thereafter, the incidence of CKD determined transitions from TN-CKD/FP-CKD to CKD. When multiple studies offered different values for estimates in the model, we performed sensitivity analyses over the range of published values (Tables 1 to 3). CKD prevalence at age 60 was varied by 50%; estimated incidence of CKD was varied from the estimated incidence at age 50 to age 65+. Testing costs were varied by 50% above and below the base case value. All other costs were varied by 25%.
Ten Monte Carlo microsimulations of 10,000 hypothetical patients were performed using the base-case values to estimate the absolute number of transitions between health states. In addition, a Monte Carlo probabilistic sensitivity analysis (second order uncertainty analysis) using 1000 trials was performed. This probabilistic sensitivity analysis incorporated normal distributions for all variables except QALY of FP-CKD, CKD mortality coefficient, QALY adjustment for ESRD, and specificity of serum creatinine, for which custom distributions based on normal distribution, but that did not extend to values greater than 1, were used.
| Results |
|---|
|
|
|---|
|
The average of 10 Monte Carlo microsimulations of 10,000 patients over 18 yr revealed that 13 fewer deaths and 29 fewer transitions to ESRD occurred with eGFR reporting. Notably, eGFR reporting generated 11,348 more FP-CKD cases compared with serum creatinine alone and resulted in 2072 fewer patient-years spent with undetected CKD (FN-CKD) (Table 5).
|
|
|
One-way sensitivity analyses demonstrated that the cost-effectiveness of serum creatinine reporting became superior to eGFR reporting over plausible ranges of two variables: 1) annual probability of progressing from CKD to ESRD, and 2) sensitivity of serum creatinine to detect CKD (Figures 3b and 3c). At the lower bound of annual probability of progressing from CKD to ESRD, reporting serum creatinine was found to be more cost-effective than reporting eGFR with an ICER of $20,289 per QALY gained by eGFR reporting. At the upper bound of sensitivity of serum creatinine, reporting serum creatinine was more cost-effective than reporting eGFR with an ICER of $433,324 per QALY gained by eGFR reporting (Table 4).
Sensitivity analysis also showed that if the cost of patient work-up for a positive test was $652/person or more, reporting serum creatinine became the more cost-effective strategy. This cost was, however, outside of our predefined plausible range.
The distribution of cost-effectiveness ratios from a Monte Carlo probabilistic sensitivity analysis of 1000 trials revealed no clearly preferable strategy (Figure 4). eGFR reporting generated a mean cost-effectiveness of 17,796 $/QALY (±1267 $/QALY). Serum creatinine reporting generated mean cost-effectiveness of 17,809 $/QALY (±1273 $/QALY).
|
| Discussion |
|---|
|
|
|---|
eGFR reporting was the most effective and cost-effective strategy when analyzed using the separate outcomes of absolute life years, QALYs, and cost/QALY. The superiority of the eGFR reporting strategy results from the fact that eGFR identified more cases of CKD, and treatment of CKD led to fewer cases of ESRD. The limited magnitude of the effect seen with eGFR reporting is likely a result of the limited effects of therapy on CKD progression and mortality.
The value assigned to the false-positive diagnosis of CKD had a strong effect on the model outcomes. In one-way sensitivity analyses, eGFR reporting became less effective than serum creatinine when the QALY for FP-CKD was decreased by greater than 1%. Our Monte Carlo microsimulations also demonstrated the tradeoff between increased sensitivity and decreased specificity with eGFR reporting. In a hypothetical population of 10,000 individuals followed over 18 yr, there were, on average, 13 fewer deaths and 29 fewer cases of ESRD, but 11,348 more false positive diagnoses of CKD with eGFR reporting compared with serum creatinine alone. Furthermore, our Monte Carlo probabilistic sensitivity analysis, which considers jointly the uncertainties in our decision model, failed to indicate a clearly preferable strategy.
The range of possible harmful outcomes from false positive diagnosis of CKD includes health-related, economic, and psychologic consequences. Possible negative health consequences include unnecessary renal biopsies and medications such as angiotensin-converting enzyme inhibitors with their associated costs and potential adverse effects, which we did not include in our analysis. The economic burden of a false positive diagnosis with CKD also merits consideration. In this study, the financial burden of a positive test for CKD was incurred whether or not a patient had true disease and was, therefore, a greater source of increased cost in the eGFR reporting strategy as a result of the high number of FP-CKD patients. This diagnostic evaluation was limited to two visits with a nephrologist and limited tests that were estimated to cost $266. However, the cost of the clinical evaluation of a positive test for CKD was based on opinion and could be an underestimate (35). In addition, we did not include a one-time cost of software installation to allow eGFR reporting, because many institutions have already made this investment (12). Lastly, patients with a false positive diagnosis could suffer adverse outcomes such as anxiety, employment discrimination, and denial of health or life insurance (36–38).
Other factors besides the quality of life of FP-CKD patients proved influential in our model. Serum creatinine reporting was more cost-effective than eGFR reporting within the boundaries of two variables: the annual probability of progressing from CKD to ESRD, and the sensitivity of serum creatinine in identifying patients with CKD (Figure 3, b and c). Varying the annual probability of progressing from CKD to ESRD did not result in a large difference in cost-effectiveness between the two strategies, and both strategies became less cost-effective as the probability of progression to ESRD increased (Figure 3b).
As the sensitivity of serum creatinine was increased to 0.75 and higher, however, this strategy became substantially more cost-effective than eGFR reporting (Figure 3c). The influence of this variable on cost-effectiveness is highlighted because the sensitivity of serum creatinine for diagnosis of CKD in clinical practice is uncertain. In contrast to eGFR, which defines CKD using widely published numerical guidelines, (17) the value at which a serum creatinine is considered abnormal varies between physicians. For instance, a study by Mendelssohn showed that family physicians in Ontario generally did not refer patients with serum creatinine levels in the range of 1.4 to 1.7 mg/dl to a nephrologist (39), whereas the studies that we cited defined abnormal serum creatinine as those values higher than 1.06 to 1.36 mg/dl (27,28,29).
Our study has several limitations. Although published data were used to specify our model, precise estimates for some important variables were not available. For instance, limited data exist regarding health costs in CKD patients. The annual health costs of CKD were estimated using one retrospective study that did not distinguish between patients diagnosed with CKD and those who were undiagnosed (32). Thus, both TP-CKD and FN-CKD groups were assumed to have similar costs of care. The undiagnosed group may, in reality, have more unintended hospital admissions than the diagnosed group. However, the diagnosed group likely has more outpatient visits and medication prescriptions. Therefore, it is unclear whether one CKD group would have greater costs than the other, but a difference in costs could influence the outcomes of our model.
Our model examines the effects of eGFR reporting among the elderly, although the true prevalence of CKD in this population is not known. This uncertainty arises, in part, because declines in renal function among the elderly may represent "normal" senescence rather than a pathologic disease process. As a result, there has been substantial debate about the appropriate epidemiologic approach to measuring CKD in an elderly population (40,41). For instance, the estimate of CKD prevalence that we used for our hypothetical population of 60-yr-old individuals was taken from a study that relied on the MDRD equation to measure CKD in the general population (1). The MDRD equation, however, may lack precision in older individuals (9,42,43). We addressed this uncertainty about the prevalence of CKD by varying the estimate by ± 50% in our sensitivity analysis around the base-case value.
An additional limitation is that the quality of life of CKD patients was assumed to be the same in our model whether or not CKD was diagnosed. As discussed above with respect to patients falsely diagnosed with CKD, a "true positive" diagnosis of CKD could similarly lead to anxiety, employment discrimination, and denial of insurance. However, in patients with true disease, identification might also allow for treatments that improve quality of life, such as correction of anemia.
Conclusions
Automatic reporting of eGFR was the dominant strategy providing more QALYs with fewer costs, but this benefit was modest and was reversed with virtually any reduction in quality of life caused by the incorrect diagnosis of CKD. eGFR reporting also resulted in a far higher number of patients falsely diagnosed with CKD. Despite the widespread enthusiasm and increasing adoption of routine eGFR reporting, our study shows that clinicians and policy-makers should carefully examine the consequences of this practice. Additional studies are needed to quantify the impact of false diagnosis of CKD on quality of life, the probability of progressing from CKD to ESRD, and the sensitivity with which serum creatinine and eGFR reporting alone identifies patients with CKD. Until these data become available, the superiority of eGFR reporting compared with serum creatinine alone remains uncertain.
Conflict of interest and financial support.
| Disclosures |
|---|
|
|
|---|
The study was exempt from the Institutional Review Board's approval because human subjects and personal data were not used in the study.
| Acknowledgments |
|---|
| Footnotes |
|---|
Access to UpToDate on-line is available for additional clinical information at http://www.cjasn.org/
Received August 17, 2008. Accepted October 30, 2008.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
P. P. Reese and H. I. Feldman More Evidence that Cystatin C Predicts Mortality Better than Creatinine J. Am. Soc. Nephrol., October 1, 2009; 20(10): 2088 - 2090. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |