Feature

Analytic Considerations for Repeated Measures of eGFR in Cohort Studies of CKD

Haochang Shou, Jesse Y. Hsu, Dawei Xie, Wei Yang, Jason Roy, Amanda H. Anderson, J. Richard Landis, Harold I. Feldman, Afshin Parsa and Christopher Jepson; on behalf of the Chronic Renal Insufficiency Cohort (CRIC) Study Investigators
CJASN August 2017, 12 (8) 1357-1365; DOI: https://doi.org/10.2215/CJN.11311116

Abstract

Repeated measures of various biomarkers provide opportunities for us to enhance understanding of many important clinical aspects of CKD, including patterns of disease progression, rates of kidney function decline under different risk factors, and the degree of heterogeneity in disease manifestations across patients. However, because of unique features, such as correlations across visits and time dependency, these data must be appropriately handled using longitudinal data analysis methods. We provide a general overview of the characteristics of data collected in cohort studies and compare appropriate statistical methods for the analysis of longitudinal exposures and outcomes. We use examples from the Chronic Renal Insufficiency Cohort Study to illustrate these methods. More specifically, we model longitudinal kidney outcomes over annual clinical visits and assess the association with both baseline and longitudinal risk factors.

Introduction

The term repeated measures refers to data observed repeatedly within the same subject, and they are being increasingly collected in many research studies. Aside from being used to evaluate the reproducibility and variability of a novel biomarker (1,2), repeated measures are often generated in the context of longitudinal studies, in which one or more biomarkers are observed over time. For chronic diseases, such as CKD, patterns of biomarker trajectories are crucial for understanding of disease prognosis.

In many studies, the repetitions are predetermined by the study protocol, whereby measures are administered prospectively at specific intervals during scheduled clinical visits or telephone interviews (3,4). In other scenarios, the repeated data (e.g., measures of vital signs, such as BP, heart rate, and respiratory rate) become available at variable time points when certain events (e.g., hospitalization) occur. Repeated measures could also be obtained retrospectively as natural history data through available databases, such as Medicare (5).

Depending on the scientific questions, the longitudinal measures may serve as the outcomes of interest, the exposures, or a combination of both. Examples of these scenarios in kidney disease research include comparisons of the burden of coronary artery calcification for patients at different stages of CKD and ESRD, treating the longitudinal coronary artery calcification measures as the outcome of interest (6); evaluations of the associations of longitudinal measures of GFR with subsequent adverse events, such as ESRD and death, as outcomes (7,8); and an investigation of the causal relationship between BP and kidney function, in which both measures were updated over time (9).

In this paper, we will focus primarily on the appropriate statistical methods for analyzing longitudinal data as outcomes. In particular, we will discuss extensively regression methods that can estimate the rate of change of the longitudinal data in association with certain risk factors (10,11). The terms repeated measures and longitudinal data are used interchangeably.

Motivating Example

The Chronic Renal Insufficiency Cohort (CRIC) Study is a prospective, longitudinal study of patients with CKD, in which repeated measures of serum creatinine and cystatin C, along with several other laboratory measures, were collected from each participant during annual clinical visits (3,7,12). eGFR, calculated on the basis of the CRIC Study eGFR equation that incorporates both serum creatinine and cystatin C (13), is an important measure of kidney function (12). Describing the rate of change and patterns of eGFR decline as well as identifying risk factors that affect CKD progression are of particular interest in CKD research (10,14,15).

Our motivating example involves the effect of functional kidney risk variants in the gene coding for APOL1 on the rate of eGFR decline among the CRIC Study participants. Two haplotypes (G1 and G2) in APOL1 have been positively selected and are common in populations of recent African continental descent, but they are very rare or absent in most other populations, where exposure to Trypanosomes was not common. These APOL1 variants associated with kidney diseases are believed to account for much of the nonsocioeconomic-based related disparity in rates of CKD progression between patients with African ancestry and white patients.

DNA samples from the 1411 African ancestry participants enrolled in the CRIC Study between June of 2003 and August of 2008 were genotyped for APOL1 risk variants (16). Given the near absence of these APOL1 risk variants in whites, the exposure variable was defined in conjunction with race into three categories: APOL1 high-risk genotype (African ancestry participants with two copies of the risk variants), APOL1 low-risk genotype (African ancestry participants with zero or one copy of these variants), and white participants (reference group).

The investigators were interested in assessing whether rates of eGFR decline differ among the three exposure groups. The longitudinal outcome in this example was the annual eGFR measures for each participant for up to 7 years after enrollment. Other covariates included demographics (e.g., age, sex, and clinical site), socioeconomic variables (e.g., income and education level), and traditional clinical risk factors (e.g., systolic BP and body mass index) and were mostly observed at baseline (16).

Data Preparation and Visualization

For longitudinal studies of moderate size, the dataset is often prepared in either of the two ways: wide format (one row of data per participant) or long format (multiple rows of data per participant; one per visit) (17) (details are in Supplemental Appendix 1). The long format is generally more preferred for advanced statistical modeling, because it can handle subjects with different numbers of clinical visits or irregular time points of measurement; it is also easier for dynamically updating the dataset with future follow-up visits.

Exploratory analysis using graphs can help researchers to frame the hypothesis and select appropriate statistical models. Some commonly used visualization tools for longitudinal data include spaghetti plot, heat map, and lasagna plot (18) (Figures 1 and 2). These plots show several features of the eGFR trajectories. First, patients with APOL1 high risk seem to have a faster decline compared with others. Second, such as in most cohort studies, subjects have varying numbers of visits. Third, the baseline eGFR values differ across subjects.

Figure 1.
Figure 1.

Spaghetti plot of eGFR over time for 15 random Chronic Renal Insufficiency Cohort (CRIC) Study participants. The figure shows an example of the spaghetti plot of repeated eGFR values for 15 randomly selected CRIC Study participants, five from each of the three APOL1 risk categories. The spaghetti plot connects the longitudinal eGFR values within a single subject by lines over time but might result in overplotting with too many subjects on one plot.

Figure 2.
Figure 2.

Heat map (left panel) and lasagna plot (right panel) plot on the basis of the same 15 subjects. Each row of the heat map represents eGFR values from one subject, and the color indicates the level of eGFR values. The lasagna plot is a heat map sorted by color gradients to reflect the overall eGFR distributions in the population at each visit.

In the era of big data, many multivariable measures, such as imaging scans, proteomics assessments, and electronic health records (6,19,20), are collected at multiple visits for large cohorts of participants. It might no longer be feasible to include all of the measures in one data frame. Utilization of high-performance computing and central databases, such as the National Institute of Diabetes and Digestive and Kidney Diseases Repository (21,22), that crosslink various measures to a unique subject-visit identity is crucial to handle complex and heterogeneous data. In addition, advanced statistical tools, including dynamic visualization interface and hierarchical clustering visualization using graph structures (23,24), need to be leveraged to CKD research involving big data (25–28).

Time Dependency and Correlated Observations

Longitudinal data have unique and crucial characteristics. First, they are typically accompanied by a time variable that indicates when each measurement occurred, and they define a natural ordering of the repeated measures within each subject. Second, the repeated measures within the same subject are potentially correlated. For example, within each subject, the eGFR values of subsequent visits might depend on those at earlier visits. Such intrinsic clusters defined by subjects result in dependency (correlation) among repeated observations, which violates the assumption of independent observations on which many simple analytic methods are based. Hence, using traditional linear regression and ignoring data correlations might lead to inaccurate estimates and erroneous inferences about the associations of risk factors with kidney function decline (29).

Special statistical methodologies for repeated measures allow observations to be correlated and can quantify the magnitude of this correlation. In addition, some of these approaches are designed to predict the individual trajectory of the outcome measures over time and can handle datasets with missing values. Such methods often make assumptions about the structure of correlations between the repeated measures. Typical choices of correlation structures include independence, exchangeable, autoregressive, m dependent, and unstructured (30,31) (Supplemental Appendix 2).

Statistical Approaches for Repeated Measures as the Outcome

In our motivating example, the goal of the analysis was to investigate the rate of kidney function decline and its association with related risk factors. Intuitively, a two-stage approach has been used (10,32,33) in the literature. Take eGFR as an example. First, an individual’s eGFR slope is separately estimated for each subject by regressing the subject’s repeated eGFR values on the time variable. Second, the eGFR slopes from all of the subjects are treated as the outcome variable and fitted into a linear regression. Such a method is limited, in that the estimates are highly sensitive to random variations (noise), especially for subjects with short follow-up and small numbers of observations. It is also not able to evaluate the cross-sectional associations between baseline eGFR and risk factors or adaptable to time-varying covariates (34).

To simultaneously model the effects of risk factors on both the baseline observations and their rate of change and to appropriately account for the correlations among the repeated measures, two types of flexible regression methods are recommended for the analysis of longitudinal data: generalized estimating equations (GEEs) and mixed effects modeling (17,29,34). We introduce these methods in the following sections.

Population-Average Model

A population-average model, such as the GEE approach (17,35), captures the average trajectories across the overall study population and estimates the marginal associations between the repeated outcome measures and the risk factors. A GEE model consists of two parts: the mean response model and the error term. In our motivating example, we can fit a linear GEE model as expressed in model 1 below. For simplicity, no additional covariates are included in this model, except for the major risk factor: APOL1 risk group (0, white; 1, African ancestry APOL1 low risk; and 2, African ancestry APOL1 high risk):Embedded Image(1)

The mean response model Embedded Image takes the repeated measures (e.g., eGFR at jth visit for subject i) as the outcome and describes the overall mean relationship between repeated eGFR values and the exposure variables. We present a rigorous formulation and detailed interpretation of model 1 in Supplemental Appendix 3, but we point out that the coefficient estimated in front of the time variable (year) represents the average eGFR slope for the reference group (whites) and that the coefficient for the interaction of year with APOL1 estimates the difference in eGFR slopes between the other two APOL1 risk groups compared with the reference. In addition, the associations between baseline eGFR and covariates are represented via coefficients in front of the nontime-varying variables in a similar fashion as a cross-sectional linear regression.

The error term accounts for the within-subject correlation. GEE initiates the model estimation by specifying a particular correlation structure among the repeated observations referred to as the working correlation, which is not necessarily accurate for the real data. The working correlation is typically chosen from one of the aforementioned common structures: independence, exchangeable, autoregressive, m dependent, and unstructured (Supplemental Appendix 2). For example, exchangeable structure assumes that the correlation between outcomes is equal, regardless of how far apart they are in time. Autoregressive is often used in longitudinal analysis and refers to when the correlation decreases as the time difference between observations increases. The unstructured correlation structure is the most flexible, with no prespecified patterns. GEE is robust in that an erroneously specified working correlation structure will have little effect on the risk association estimation as long as the mean response model is correct. However, choosing a working correlation that closely approximates the truth is still desirable, because it results in smaller standard errors in the final estimates (30,31,36).

With the data from the motivating example, we fit model 1 assuming an exchangeable working correlation structure and present the estimated coefficients in Table 1. The results show that eGFR, on average, decreases 0.50 ml/min per 1.73 m2 per year for whites. The eGFR decline among the APOL1 high-risk group is 0.94 ml/min per 1.73 m2 per year faster than among whites (P<0.001). The APOL1 low-risk group also has a faster decline than in whites, but their difference is milder (0.38 ml/min per 1.73 m2 more per year).

View this table:
Table 1.

Interpretation of coefficients from a generalized estimating equation model assessing associations of APOL1 genotype with eGFR measured repeated over time

Subject-Specific Model

In addition to the overall mean effects of APOL1 on the eGFR trajectory, different subjects could start with various eGFR values at baseline and also progress differently. In a GEE model, the subject heterogeneity is absorbed into the error term, and its magnitude is thus not quantified. Mixed effects modeling, which has been more commonly used than GEE in the nephrology literature (11), estimates both the individual variations in baseline outcome variables and their rates of change that deviate away from the population-average trajectory. This is achieved by adding random effects (random intercept and/or random slope) to the population-average model (referred to as fixed effects), as illustrated in Figure 3, by two hypothetical subjects.

Figure 3.
Figure 3.

Schematic illustrations of linear mixed effects models with random intercepts (left panel) and both random intercepts and random slopes (right panel). The blue and red dots represent observed eGFR values for the two hypothetical subjects i and i′. The blue and red curves represent the mixed effects model fit on the basis of the data. The black lines represent the population trend estimated by generalized estimating equation (GEE). With the random intercept model, the two subjects have different baseline eGFR values but the same rate of decline. In the random intercept model, their rates of decline also differ. The deviations of intercepts and slopes are quantified using random effects parameters.

In our example, the subject-specific random intercept characterizes the difference between an individual’s baseline eGFR and the population average, and a random slope in front of a time variable describes the deviation of individual slope from the population average. Thus, a simple mixed effects model that is analogous to model 1 is as follows:Embedded Image(2)The fixed effects coefficients share the same interpretations as in the GEE model 1. It is the subject-specific random effects that quantify heterogeneity across individuals.

Although they both estimate individual eGFR slopes, the mixed effects model is different from the aforementioned two-stage approach in that it manages to use information from all of the subjects by assuming a common distribution (typically, a normal distribution with mean of zero) for the random effects, and hence, it avoids the problem of estimating too many parameters with too few observations. The random effects also take care of the correlation among repeated observations within subject. Additional working correlation structures can be further imposed onto the error term, making it adaptable to complex correlation structures. A linear model with only a random intercept and independent error term would induce an exchangeable correlation structure.

Tables 2–3 show the estimates for fixed effects coefficients and the estimated subject-specific random effects in model 2. On average, eGFR decreases 0.74 ml/min per 1.73 m2 per year for white participants. The eGFR decline among the APOL1 high-risk group is significantly faster by 1.50 ml/min per 1.73 m2 per year than among whites (P<0.001).

View this table:
Table 2.

Interpretation of the fixed effects coefficients from a linear mixed effects model assessing associations of APOL1 genotype with eGFR measured repeated over time

View this table:
Table 3.

Predicted individual deviation (random intercept and slope) in model 2 for five subjects in the white group

Another advantage of the mixed effects model is that it is flexible enough to account for multiple layers of clustering. In particular, many cohort studies, including the CRIC Study, recruit participants from multiple clinical sites. In addition to the within-subject correlation among repeated measures, data correlation could also occur across subjects who come from the same geographic location or social community. It is often necessary to adjust for site effects during the analysis by either (1) including site as a discrete covariate, such as in the work by Parsa et al. (16), when the sample size per site is sufficiently large or (2) adding a site-specific random effect in the mixed effects model to quantify the intra- versus intersite variability.

Model Diagnosis

Model selection is often conducted to choose a set of variables that is most relevant to the outcome or select the best working correlation structure. Unlike GEE, the correlation structure of the mixed effects model must be specified in advance, and the results may be affected by misspecification. For mixed effects models, the one that has smaller Aikake Information Criterion (AIC) and Bayesian Information Criterion (BIC) generally fits the data better. A likelihood ratio test (37) could also be used to compare two models with and without a certain variable. For GEE, one can instead choose the best model that minimizes either the quasilikelihood under the independence model criterion (QIC) (Table 4) (38), or the QICu defined as QIC+2p that penalizes the model when too many variables are included. Comparing the empirical correlation on the basis of the observed data with the model-based estimates assuming that the working correlation is true or conducting sensitivity analyses to examine how the choice of working correlation structures affects the analytic results are both crucial ways for appropriate model selection in GEE.

View this table:
Table 4.

Comparison of different working correlation structures using quasilikelihood information criterion

Non-Normal Outcomes

For longitudinal outcomes that are not normally distributed, such as hospitalizations (discrete counts) and occurrence of AKI (binary), GEE and mixed effects models can both handle such data, analogous to the way in which the linear regression is extended to generalized linear models (e.g., logistic or Poisson regression [37]). The extension to non-normal outcomes for mixed effects models is called generalized linear mixed models (29).

Nonlinear Trends

Another assumption often made for kidney function decline is that the rate of change remains constant over time (that is, the disease progresses linearly). This assumption is convenient but is not always realistic, because eGFR decline could accelerate or stabilize at different stages of CKD (39,40). Several statistical methods have been developed to accommodate the potential for nonlinear trajectories. The first approach is to conduct a data transformation on the outcome variable (e.g., log, square root [41–43]). Log transformation is commonly used if the original outcome data decline exponentially or have a skewed distribution. The limitation of this approach is that the estimated rate of kidney function decline on the basis of the transformed data often lacks a straightforward clinical interpretation (11).

Alternatively, functional data analysis techniques are a set of flexible methods to characterize the underlying smooth trajectories on the basis of the observed longitudinal measurements. For example, we can model the eGFR values as a polynomial (e.g., quadratic or cubic) function of time in the regression model. In our motivating example, models 1 and 2 can also include new variables Embedded Image or Embedded Image in addition to the linear term Embedded Image, and the statistical significance of the higher-order polynomial terms can then be tested to determine whether a nonlinear eGFR trajectory is truly present. More broadly, smoothing splines (e.g., B spline) are used to accommodate the curvilinear trends, such as piecewise linear or polynomial (44,45). The two-slope model used for log serum creatinine in the Chronic Kidney Disease Epidemiology Collaboration equation is a special case of the piecewise-linear spline with one change point (knot) where the eGFR slope is believed to alter (46,47). Principal component analysis–type approaches (48), however, identify the patterns of the trajectories that explain most of the variations across subjects in a data-driven fashion. Some efforts have been devoted to identify subgroups of patients who show distinct patterns in the repeated measures using latent class analysis, such as group-based trajectory modeling (49–51). These methods are powerful, but they often require more observations or longer follow-up to generate reliable model estimates of the nonlinear trajectories and are computationally more expensive than the traditional models.

Missing Data and Joint Modeling for Informative Dropout

Missing data are almost inevitable in a longitudinal study for various reasons, such as participants’ dropout (52), data mishandling, or quality screening (53,54). Both GEE and mixed effects model allow for imbalanced designs, in which the outcome data are not available at the same set of time points for all subjects. However, it is necessary to note that GEE makes more restricted assumptions in missing mechanism than mixed effects model (55) (Supplemental Appendix 4). Under missing at random, a weighted GEE has been developed (56) that corrects biased estimates produced by the standard GEE. An alternative approach is to fill in the incomplete observations using multiple imputations (57) followed by the standard GEE (58,59). Such methods are preferred, especially when the outcome data are not normally distributed (58–60). Note that imputation using last observation carried forward is not recommended for longitudinal data, because it is known to produce highly biased estimates (61,62).

Informative censoring (52) or missing not at random (55) often occurs in longitudinal studies when some patients drop out of the study due to events that are related to CKD progression, such as initiation of dialysis, kidney transplantation, or death (63). In these scenarios, an individual with worse kidney function condition (or a particularly low eGFR) is more likely to drop out of the study and have their eGFR value unobserved. Appropriate methods that take the cause of missingness into account include conditional regression or pattern mixture analysis (64,65) and selection model (66) as well as the joint modeling of survival outcome (e.g., ESRD) and longitudinal data, where a Cox regression model for time to dropout and a mixed effects model for the longitudinal observations are specified separately and linked together (67–70).

Summary

This paper focused mainly on appropriate statistical methodologies for longitudinal data, where the repeated measures are treated as the outcome variable, and they are summarized in Table 5, with the comprehensive comparison between the two regression methods, GEE and mixed effects model. The corresponding statistical softwares for these models are listed in the Supplemental Appendix 5. We are aware that there remain many limitations in the discussion. For example, topics, such as how to handle periods of dialysis or AKI episodes, that affect eGFR values were not covered, because it is difficult to capture AKI due to the infrequency of eGFR measures in most longitudinal cohorts (71). Accordingly, our immediate goal is to promote further discussions and emphasize a few key considerations involved in carefully choosing analytic methods primarily for outcomes on the basis of repeated measures as most appropriate to each specific study design, question, and measure.

View this table:
Table 5.

Comparisons of the different aspects of the generalized estimating equation model and the mixed effects model for repeated measures

Disclosures

None.

Acknowledgments

Funding for the CRIC Study was obtained under a cooperative agreement from National Institute of Diabetes and Digestive and Kidney Diseases (U01DK060990, U01DK060984, U01DK061022, U01DK061021, U01DK061028, U01DK060980, U01DK060963, and U01DK060902). In addition, this work was supported in part by: the Perelman School of Medicine at the University of Pennsylvania Clinical and Translational Science Award National Institutes of Health (NIH) / National Center for Advancing Translational Sciences (NCATS) UL1TR000003, Johns Hopkins University UL1TR-000424, University of Maryland GCRC M01 RR-16500, Clinical and Translational Science Collaborative of Cleveland, UL1TR000439 from the NCATS component of NIH and NIH roadmap for Medical Research, Michigan Institute for Clinical and Health Research UL1TR000433, University of Illinois at Chicago CTSA UL1RR029879, Tulane COBRE for Clinical and Translational Research in Cardiometabolic Diseases P20 GM109036, Kaiser Permanente NIH/National Center for Research Resources UCSF-CTSI UL1 RR-024131.

CRIC Study Investigators also include Lawrence J. Appel (Welch Center for Prevention, Epidemiology and Clinical Research, Johns Hopkins University, Baltimore, Maryland), Jiang He (Departments of Medicine and Epidemiology, Tulane University, New Orleans, Louisiana), James P. Lash (Section of Nephrology, Department of Medicine, University of Illinois at Chicago, Chicago, IL), Akinlolu Ojo (Department of Medicine, University of Michigan, Ann Arbor, Michigan), and Raymond R. Townsend (Department of Medicine and Center for Clinical Epidemiology and Biostatistics, University of Pennsylvania, Philadelphia, Pennsylvania).

Footnotes

References

  1. ↵
    1. Rodriguez RA,
    2. Cronin V,
    3. Ramsay T,
    4. Zimmerman D,
    5. Ruzicka M,
    6. Burns KD
    : Reproducibility of carotid-femoral pulse wave velocity in end-stage renal disease patients: Methodological considerations. Can J Kidney Health Dis 3: 20, 2016
    OpenUrl
  2. ↵
    1. Koufaki P,
    2. Naish PF,
    3. Mercer TH
    : Reproducibility of exercise tolerance in patients with end-stage renal disease. Arch Phys Med Rehabil 82: 1421–1424, 2001
    OpenUrlCrossRefPubMed
  3. ↵
    1. Feldman HI,
    2. Appel LJ,
    3. Chertow GM,
    4. Cifelli D,
    5. Cizman B,
    6. Daugirdas J,
    7. Fink JC,
    8. Franklin-Becker ED,
    9. Go AS,
    10. Hamm LL,
    11. He J,
    12. Hostetter T,
    13. Hsu CY,
    14. Jamerson K,
    15. Joffe M,
    16. Kusek JW,
    17. Landis JR,
    18. Lash JP,
    19. Miller ER,
    20. Mohler 3rd ER.,
    21. Muntner P,
    22. Ojo AO,
    23. Rahman M,
    24. Townsend RR,
    25. Wright JT
    ; Chronic Renal Insufficiency Cohort (CRIC) Study Investigators: The Chronic Renal Insufficiency Cohort (CRIC) Study: Design and methods. J Am Soc Nephrol 14[Suppl 2]: S148–S153, 2003
    OpenUrlAbstract/FREE Full Text
  4. ↵
    ARIC investigators: The Atherosclerosis Risk in Communities (ARIC) Study: Design and objectives. The ARIC investigators. Am J Epidemiol 129: 687–702, 1989
    OpenUrlCrossRefPubMed
  5. ↵
    1. Wanner C,
    2. Oliveira JP,
    3. Ortiz A,
    4. Mauer M,
    5. Germain DP,
    6. Linthorst GE,
    7. Serra AL,
    8. Maródi L,
    9. Mignani R,
    10. Cianciaruso B,
    11. Vujkovac B,
    12. Lemay R,
    13. Beitner-Johnson D,
    14. Waldek S,
    15. Warnock DG
    : Prognostic indicators of renal disease progression in adults with Fabry disease: Natural history data from the Fabry Registry. Clin J Am Soc Nephrol 5: 2220–2228, 2010
    OpenUrlAbstract/FREE Full Text
  6. ↵
    1. Bansal N,
    2. Keane M,
    3. Delafontaine P,
    4. Dries D,
    5. Foster E,
    6. Gadegbeku CA,
    7. Go AS,
    8. Hamm LL,
    9. Kusek JW,
    10. Ojo AO,
    11. Rahman M,
    12. Tao K,
    13. Wright JT,
    14. Xie D,
    15. Hsu CY
    ; CRIC Study Investigators: A longitudinal study of left ventricular function and structure from CKD to ESRD: The CRIC study. Clin J Am Soc Nephrol 8: 355–362, 2013
    OpenUrlAbstract/FREE Full Text
  7. ↵
    1. Ku E,
    2. Xie D,
    3. Shlipak M,
    4. Hyre Anderson A,
    5. Chen J,
    6. Go AS,
    7. He J,
    8. Horwitz EJ,
    9. Rahman M,
    10. Ricardo AC,
    11. Sondheimer JH,
    12. Townsend RR,
    13. Hsu CY
    ; CRIC Study Investigators: Change in measured GFR versus eGFR and CKD outcomes. J Am Soc Nephrol 27: 2196–2204, 2016
    OpenUrlAbstract/FREE Full Text
  8. ↵
    1. Tseng CL,
    2. Lafrance JP,
    3. Lu SE,
    4. Soroka O,
    5. Miller DR,
    6. Maney M,
    7. Pogach LM
    : Variability in estimated glomerular filtration rate values is a risk factor in chronic kidney disease progression among patients with diabetes. BMC Nephrol 16: 34, 2015
    OpenUrlCrossRefPubMed
  9. ↵
    1. Anderson AH,
    2. Yang W,
    3. Townsend RR,
    4. Pan Q,
    5. Chertow GM,
    6. Kusek JW,
    7. Charleston J,
    8. He J,
    9. Kallem R,
    10. Lash JP,
    11. Miller 3rd ER.,
    12. Rahman M,
    13. Steigerwalt S,
    14. Weir M,
    15. Wright Jr. JT.,
    16. Feldman HI
    ; Chronic Renal Insufficiency Cohort Study Investigators: Time-updated systolic blood pressure and the progression of chronic kidney disease: A cohort study. Ann Intern Med 162: 258–265, 2015
    OpenUrlCrossRefPubMed
  10. ↵
    1. Rosansky SJ
    : Renal function trajectory is more important than chronic kidney disease stage for managing patients with chronic kidney disease. Am J Nephrol 36: 1–10, 2012
    OpenUrlCrossRefPubMed
  11. ↵
    1. Boucquemont J,
    2. Heinze G,
    3. Jager KJ,
    4. Oberbauer R,
    5. Leffondre K
    : Regression methods for investigating risk factors of chronic kidney disease outcomes: The state of the art. BMC Nephrol 15: 45, 2014
    OpenUrlCrossRefPubMed
  12. ↵
    1. Yang W,
    2. Xie D,
    3. Anderson AH,
    4. Joffe MM,
    5. Greene T,
    6. Teal V,
    7. Hsu CY,
    8. Fink JC,
    9. He J,
    10. Lash JP,
    11. Ojo A,
    12. Rahman M,
    13. Nessel L,
    14. Kusek JW,
    15. Feldman HI
    ; CRIC Study Investigators: Association of kidney disease outcomes with risk factors for CKD: Findings from the Chronic Renal Insufficiency Cohort (CRIC) study. Am J Kidney Dis 63: 236–243, 2014
    OpenUrlCrossRefPubMed
  13. ↵
    1. Anderson AH,
    2. Yang W,
    3. Hsu CY,
    4. Joffe MM,
    5. Leonard MB,
    6. Xie D,
    7. Chen J,
    8. Greene T,
    9. Jaar BG,
    10. Kao P,
    11. Kusek JW,
    12. Landis JR,
    13. Lash JP,
    14. Townsend RR,
    15. Weir MR,
    16. Feldman HI,
    17. Investigators CS
    ; CRIC Study Investigators: Estimating GFR among participants in the Chronic Renal Insufficiency Cohort (CRIC) Study. Am J Kidney Dis 60: 250–261, 2012
    OpenUrlCrossRefPubMed
  14. ↵
    1. Amdur RL,
    2. Feldman HI,
    3. Gupta J,
    4. Yang W,
    5. Kanetsky P,
    6. Shlipak M,
    7. Rahman M,
    8. Lash JP,
    9. Townsend RR,
    10. Ojo A,
    11. Roy-Chaudhury A,
    12. Go AS,
    13. Joffe M,
    14. He J,
    15. Balakrishnan VS,
    16. Kimmel PL,
    17. Kusek JW,
    18. Raj DS
    ; CRIC Study Investigators: Inflammation and progression of CKD: The CRIC Study. Clin J Am Soc Nephrol 11: 1546–1556, 2016
    OpenUrlAbstract/FREE Full Text
  15. ↵
    1. Fischer MJ,
    2. Hsu JY,
    3. Lora CM,
    4. Ricardo AC,
    5. Anderson AH,
    6. Bazzano L,
    7. Cuevas MM,
    8. Hsu CY,
    9. Kusek JW,
    10. Renteria A,
    11. Ojo AO,
    12. Raj DS,
    13. Rosas SE,
    14. Pan Q,
    15. Yaffe K,
    16. Go AS,
    17. Lash JP
    ; Chronic Renal Insufficiency Cohort (CRIC) Study Investigators: CKD progression and mortality among hispanics and non-hispanics. J Am Soc Nephrol 27: 3488–3497, 2016
    OpenUrlAbstract/FREE Full Text
  16. ↵
    1. Parsa A,
    2. Kao WH,
    3. Xie D,
    4. Astor BC,
    5. Li M,
    6. Hsu CY,
    7. Feldman HI,
    8. Parekh RS,
    9. Kusek JW,
    10. Greene TH,
    11. Fink JC,
    12. Anderson AH,
    13. Choi MJ,
    14. Wright Jr. JT.,
    15. Lash JP,
    16. Freedman BI,
    17. Ojo A,
    18. Winkler CA,
    19. Raj DS,
    20. Kopp JB,
    21. He J,
    22. Jensvold NG,
    23. Tao K,
    24. Lipkowitz MS,
    25. Appel LJ
    ; AASK Study Investigators; CRIC Study Investigators: APOL1 risk variants, race, and progression of chronic kidney disease. N Engl J Med 369: 2183–2196, 2013
    OpenUrlCrossRefPubMed
  17. ↵
    1. Zeger SL,
    2. Liang KY
    : An overview of methods for the analysis of longitudinal data. Stat Med 11: 1825–1839, 1992
    OpenUrlCrossRefPubMed
  18. ↵
    1. Swihart BJ,
    2. Caffo B,
    3. James BD,
    4. Strand M,
    5. Schwartz BS,
    6. Punjabi NM
    : Lasagna plots: A saucy alternative to spaghetti plots. Epidemiology 21: 621–625, 2010
    OpenUrlCrossRefPubMed
  19. ↵
    1. Mihai S,
    2. Codrici E,
    3. Popescu ID,
    4. Enciu AM,
    5. Rusu E,
    6. Zilisteanu D,
    7. Albulescu R,
    8. Anton G,
    9. Tanase C
    : Proteomic biomarkers panel: New insights in chronic kidney disease. Dis Markers 2016: 3185232, 2016
    OpenUrl
  20. ↵
    1. Sulemane S,
    2. Panoulas VF,
    3. Nihoyannopoulos P
    : Echocardiographic assessment in patients with chronic kidney disease: Current update. Echocardiography 34: 594–602, 2017
    OpenUrl
  21. ↵
    1. Cuticchia AJ,
    2. Cooley PC,
    3. Hall RD,
    4. Qin Y
    : NIDDK data repository: A central collection of clinical trial data. BMC Med Inform Decis Mak 6: 19, 2006
    OpenUrlCrossRefPubMed
  22. ↵
    1. Turner CF,
    2. Pan H,
    3. Silk GW,
    4. Ardini MA,
    5. Bakalov V,
    6. Bryant S,
    7. Cantor S,
    8. Chang KY,
    9. DeLatte M,
    10. Eggers P,
    11. Ganapathi L,
    12. Lakshmikanthan S,
    13. Levy J,
    14. Li S,
    15. Pratt J,
    16. Pugh N,
    17. Qin Y,
    18. Rasooly R,
    19. Ray H,
    20. Richardson JE,
    21. Riley AF,
    22. Rogers SM,
    23. Scheper C,
    24. Tan S,
    25. White S,
    26. Cooley PC
    : The NIDDK Central Repository at 8 years–ambition, revision, use and impact. Database (Oxford) 2011: bar043, 2011
    OpenUrlPubMed
  23. ↵
    1. Huang CW,
    2. Lu R,
    3. Iqbal U,
    4. Lin SH,
    5. Nguyen PA,
    6. Yang HC,
    7. Wang CF,
    8. Li J,
    9. Ma KL,
    10. Li YC,
    11. Jian WS
    : A richly interactive exploratory data analysis and visualization tool using electronic medical records. BMC Med Inform Decis Mak 15: 92, 2015
    OpenUrl
  24. ↵
    Riehmann P, Hanfler M, Froehlich B: Interactive Saankey diagrams, information visualization. Presented at the IEEE Symposium on Information Visualization, Minneapolis, MN, October 23–25, 2005
  25. ↵
    1. Dinov ID,
    2. Heavner B,
    3. Tang M,
    4. Glusman G,
    5. Chard K,
    6. Darcy M,
    7. Madduri R,
    8. Pa J,
    9. Spino C,
    10. Kesselman C,
    11. Foster I,
    12. Deutsch EW,
    13. Price ND,
    14. Van Horn JD,
    15. Ames J,
    16. Clark K,
    17. Hood L,
    18. Hampstead BM,
    19. Dauer W,
    20. Toga AW
    : Predictive big data analytics: A study of Parkinson’s disease using large, complex, heterogeneous, incongruent, multi-source and incomplete observations. PLoS One 11: e0157077, 2016
    OpenUrl
    1. Zhang Y,
    2. Padman R
    : Data-driven clinical and cost pathways for chronic care delivery. Am J Manag Care 22: 816–820, 2016
    OpenUrl
    1. Zhang Y,
    2. Padman R,
    3. Patel N
    : Paving the COWpath: Learning and visualizing clinical pathways from electronic health record data. J Biomed Inform 58: 186–197, 2015
    OpenUrl
  28. ↵
    1. Holzinger A
    : Machine Learning for Health Informatics: State-of-the-Art and Future Challenges, New York, Springer, 2016
  29. ↵
    1. Fitzmaurice G,
    2. Laird N,
    3. Ware J
    : Applied Longitudinal Analysis, Hoboken, NJ, John Wiley & Sons, 2012
  30. ↵
    1. Diggle PJ,
    2. Heagerty P,
    3. Liang K-Y,
    4. Zeger SL
    : Analysis of Longitudinal Data, New York, Oxford University Press, 2002
  31. ↵
    1. Lipsitz SR,
    2. Fitzmaurice GM,
    3. Orav EJ,
    4. Laird NM
    : Performance of generalized estimating equations in practical situations. Biometrics 50: 270–278, 1994
    OpenUrlCrossRefPubMed
  32. ↵
    1. Barbour SJ,
    2. Er L,
    3. Djurdjev O,
    4. Karim M,
    5. Levin A
    : Differences in progression of CKD and mortality amongst caucasian, oriental Asian and South Asian CKD patients. Nephrol Dial Transplant 25: 3663–3672, 2010
    OpenUrlCrossRefPubMed
  33. ↵
    1. Levin A,
    2. Djurdjev O,
    3. Beaulieu M,
    4. Er L
    : Variability and risk factors for kidney disease progression and death following attainment of stage 4 CKD in a referred cohort. Am J Kidney Dis 52: 661–671, 2008
    OpenUrlCrossRefPubMed
  34. ↵
    1. Burton P,
    2. Gurrin L,
    3. Sly P
    : Extending the simple linear regression model to account for correlated responses: An introduction to generalized estimating equations and multi-level mixed modelling. Stat Med 17: 1261–1291, 1998
    OpenUrlCrossRefPubMed
  35. ↵
    1. Zeger SL,
    2. Liang KY
    : Longitudinal data analysis for discrete and continuous outcomes. Biometrics 42: 121–130, 1986
    OpenUrlCrossRefPubMed
  36. ↵
    1. Carlin JB,
    2. Wolfe R,
    3. Brown CH,
    4. Gelman A
    : A case study on the choice, interpretation and checking of multilevel models for longitudinal binary outcomes. Biostatistics 2: 397–416, 2001
    OpenUrlCrossRefPubMed
  37. ↵
    1. McCullagh P,
    2. Nelder JA
    : Generalized Linear Models, London, Chapman & Hall, 1989
  38. ↵
    1. Pan W
    : Akaike’s information criterion in generalized estimating equations. Biometrics 57: 120–125, 2001
    OpenUrlCrossRefPubMed
  39. ↵
    1. Li L,
    2. Astor BC,
    3. Lewis J,
    4. Hu B,
    5. Appel LJ,
    6. Lipkowitz MS,
    7. Toto RD,
    8. Wang X,
    9. Wright Jr. JT.,
    10. Greene TH
    : Longitudinal progression trajectory of GFR among patients with CKD. Am J Kidney Dis 59: 504–512, 2012
    OpenUrlCrossRefPubMed
  40. ↵
    1. Norris KC,
    2. Greene T,
    3. Kopple J,
    4. Lea J,
    5. Lewis J,
    6. Lipkowitz M,
    7. Miller P,
    8. Richardson A,
    9. Rostand S,
    10. Wang X,
    11. Appel LJ
    : Baseline predictors of renal disease progression in the African American Study of hypertension and kidney disease. J Am Soc Nephrol 17: 2928–2936, 2006
    OpenUrlAbstract/FREE Full Text
  41. ↵
    1. Reed B,
    2. Helal I,
    3. McFann K,
    4. Wang W,
    5. Yan XD,
    6. Schrier RW
    : The impact of type II diabetes mellitus in patients with autosomal dominant polycystic kidney disease. Nephrol Dial Transplant 27: 2862–2865, 2012
    OpenUrlCrossRefPubMed
    1. Palmas W,
    2. Pickering T,
    3. Eimicke JP,
    4. Moran A,
    5. Teresi J,
    6. Schwartz JE,
    7. Field L,
    8. Weinstock RS,
    9. Shea S
    : Value of ambulatory arterial stiffness index and 24-h pulse pressure to predict progression of albuminuria in elderly people with diabetes mellitus. Am J Hypertens 20: 493–500, 2007
    OpenUrlCrossRefPubMed
  43. ↵
    1. Gardner LI,
    2. Holmberg SD,
    3. Williamson JM,
    4. Szczech LA,
    5. Carpenter CC,
    6. Rompalo AM,
    7. Schuman P,
    8. Klein RS
    ; HIV Epidemiology Research Study Group: Development of proteinuria or elevated serum creatinine and mortality in HIV-infected women. J Acquir Immune Defic Syndr 32: 203–209, 2003
    OpenUrlCrossRefPubMed
  44. ↵
    1. Mills KT,
    2. Chen J,
    3. Yang W,
    4. Appel LJ,
    5. Kusek JW,
    6. Alper A,
    7. Delafontaine P,
    8. Keane MG,
    9. Mohler E,
    10. Ojo A,
    11. Rahman M,
    12. Ricardo AC,
    13. Soliman EZ,
    14. Steigerwalt S,
    15. Townsend R,
    16. He J
    ; Chronic Renal Insufficiency Cohort (CRIC) Study Investigators: Sodium excretion and the risk of cardiovascular disease in patients with chronic kidney disease. JAMA 315: 2200–2210, 2016
    OpenUrlCrossRefPubMed
  45. ↵
    1. Lemley KV,
    2. Boothroyd DB,
    3. Blouch KL,
    4. Nelson RG,
    5. Jones LI,
    6. Olshen RA,
    7. Myers BD
    : Modeling GFR trajectories in diabetic nephropathy. Am J Physiol Renal Physiol 289: F863–F870, 2005
    OpenUrlCrossRefPubMed
  46. ↵
    1. Fan L,
    2. Tighiouart H,
    3. Levey AS,
    4. Beck GJ,
    5. Sarnak MJ
    : Urinary sodium excretion and kidney failure in nondiabetic chronic kidney disease. Kidney Int 86: 582–588, 2014
    OpenUrlCrossRefPubMed
  47. ↵
    1. Levey AS,
    2. Stevens LA,
    3. Schmid CH,
    4. Zhang YL,
    5. Castro 3rd AF.,
    6. Feldman HI,
    7. Kusek JW,
    8. Eggers P,
    9. Van Lente F,
    10. Greene T,
    11. Coresh J
    ; CKD-EPI (Chronic Kidney Disease Epidemiology Collaboration): A new equation to estimate glomerular filtration rate. Ann Intern Med 150: 604–612, 2009
    OpenUrlCrossRefPubMed
  48. ↵
    1. Brunner-La Rocca HP,
    2. Knackstedt C,
    3. Eurlings L,
    4. Rolny V,
    5. Krause F,
    6. Pfisterer ME,
    7. Tobler D,
    8. Rickenbacher P,
    9. Maeder MT
    ; TIME‐CHF investigators: Impact of worsening renal function related to medication in heart failure. Eur J Heart Fail 17: 159–168, 2015
    OpenUrl
  49. ↵
    1. Filipozzi P,
    2. Ayav C,
    3. Ngueyon Sime W,
    4. Laurain E,
    5. Kessler M,
    6. Brunaud L,
    7. Frimat L
    : Trajectories of CKD-MBD biochemical parameters over a 2-year period following diagnosis of secondary hyperparathyroidism: A pharmacoepidemiological study. BMJ Open 7: e011482, 2017
    OpenUrlAbstract/FREE Full Text
    1. Nagin DS,
    2. Odgers CL
    : Group-based trajectory modeling in clinical research. Annu Rev Clin Psychol 6: 109–138, 2010
    OpenUrlCrossRefPubMed
  51. ↵
    1. Franklin JM,
    2. Shrank WH,
    3. Pakes J,
    4. Sanfélix-Gimeno G,
    5. Matlin OS,
    6. Brennan TA,
    7. Choudhry NK
    : Group-based trajectory models: A new approach to classifying and predicting long-term medication adherence. Med Care 51: 789–796, 2013
    OpenUrlCrossRefPubMed
  52. ↵
    1. Schluchter MD,
    2. Greene T,
    3. Beck GJ
    : Analysis of change in the presence of informative censoring: Application to a longitudinal clinical trial of progressive renal disease. Stat Med 20: 989–1007, 2001
    OpenUrlCrossRefPubMed
  53. ↵
    1. O’Kelly M,
    2. Ratitch B
    : Clinical Trials with Missing Data: A Guide for Practitioners, Chichester, United Kingdom, John Wiley & Sons, 2014
  54. ↵
    1. Mallinckrodt C
    : Preventing and Treating Missing Data in Longitudinal Clinical Trials: A Practical Guide, Cambridge, United Kingdom, Cambridge University Press, 2013
  55. ↵
    1. Rubin DB
    : Inference and missing data. Biometrika 63: 581–592, 1976
    OpenUrlCrossRef
  56. ↵
    1. Preisser JS,
    2. Lohman KK,
    3. Rathouz PJ
    : Performance of weighted estimating equations for longitudinal binary data with drop-outs missing at random. Stat Med 21: 3035–3054, 2002
    OpenUrlCrossRefPubMed
  57. ↵
    1. Rubin DB
    : Multiple Imputation for Nonresponse in Surveys, New York, Wiley, 1987
  58. ↵
    1. Aloisio KM,
    2. Swanson SA,
    3. Micali N,
    4. Field A,
    5. Horton NJ
    : Analysis of partially observed clustered data using generalized estimating equations and multiple imputation. Stata J 14: 863–883, 2014
    OpenUrlPubMed
  59. ↵
    1. Birhanu T,
    2. Molenberghs G,
    3. Sotto C,
    4. Kenward MG
    : Doubly robust and multiple-imputation-based generalized estimating equations. J Biopharm Stat 21: 202–225, 2011
    OpenUrlCrossRefPubMed
  60. ↵
    1. DeSouza CM,
    2. Legedza AT,
    3. Sankoh AJ
    : An overview of practical approaches for handling missing data in clinical trials. J Biopharm Stat 19: 1055–1073, 2009
    OpenUrlCrossRefPubMed
  61. ↵
    1. Lachin JM
    : Fallacies of last observation carried forward analyses. Clin Trials 13: 161–168, 2016
    OpenUrlCrossRefPubMed
  62. ↵
    1. Shepherd J,
    2. Breazna A,
    3. Deedwania PC,
    4. LaRosa JC,
    5. Wenger NK,
    6. Messig M,
    7. Wilson DJ
    ; Treating to New Targets Steering Committee and Investigators: Relation between change in renal function and cardiovascular outcomes in atorvastatin-treated patients (from the Treating to New Targets [TNT] Study). Am J Cardiol 117: 1199–1205, 2016
    OpenUrl
  63. ↵
    1. Misra M,
    2. Vonesh E,
    3. Churchill DN,
    4. Moore HL,
    5. Van Stone JC,
    6. Nolph KD
    : Preservation of glomerular filtration rate on dialysis when adjusted for patient dropout. Kidney Int 57: 691–696, 2000
    OpenUrlCrossRefPubMed
  64. ↵
    1. Liu C,
    2. Ratcliffe SJ,
    3. Guo W
    : A random pattern mixture model for ordinal outcomes with informative dropouts. Stat Med 34: 2391–2402, 2015
    OpenUrl
  65. ↵
    1. Michiels B,
    2. Molenberghs G,
    3. Bijnens L,
    4. Vangeneugden T,
    5. Thijs H
    : Selection models and pattern-mixture models to analyse longitudinal quality of life data subject to drop-out. Stat Med 21: 1023–1041, 2002
    OpenUrlCrossRefPubMed
  66. ↵
    1. Ten H,
    2. Reboussin BA,
    3. Miller ME,
    4. Kunselman A
    : Mixed effects logistic regression models for multiple longitudinal binary functional limitation responses with informative drop-out and confounding by baseline outcomes. Biometrics 58: 137–144, 2002
    OpenUrlCrossRefPubMed
  67. ↵
    1. Song X,
    2. Davidian M,
    3. Tsiatis AA
    : A semiparametric likelihood approach to joint modeling of longitudinal and time-to-event data. Biometrics 58: 742–753, 2002
    OpenUrlCrossRefPubMed
    1. Tsiatis AA,
    2. Davidian M
    : Joint modeling of longitudinal and time-to-event data: An overview. Stat Sin 14: 809–834, 2004
    OpenUrl
    1. Fitzmaurice G,
    2. Molenberghs G,
    3. Lipsitz SR
    : Regression models for longitudinal binary responses with informative drop-outs. J R Stat Soc Series B Stat Methodol 57: 691–704, 1995
    OpenUrl
  70. ↵
    1. Vonesh EF,
    2. Greene T,
    3. Schluchter MD
    : Shared parameter models for the joint analysis of longitudinal data and event times. Stat Med 25: 143–163, 2006
    OpenUrlCrossRefPubMed
  71. ↵
    1. Perkins RM,
    2. Bucaloiu ID,
    3. Kirchner HL,
    4. Ashouian N,
    5. Hartle JE,
    6. Yahya T
    : GFR decline and mortality risk among patients with chronic kidney disease. Clin J Am Soc Nephrol 6: 1879–1886, 2011
    OpenUrlAbstract/FREE Full Text
Back to top

In this issue

View Selected Citations (0)
Print
Download PDF
Email Article
Citation Tools
Request Permissions
Analytic Considerations for Repeated Measures of eGFR in Cohort Studies of CKD
Haochang Shou, Jesse Y. Hsu, Dawei Xie, Wei Yang, Jason Roy, Amanda H. Anderson, J. Richard Landis, Harold I. Feldman, Afshin Parsa, Christopher Jepson
CJASN Aug 2017, 12 (8) 1357-1365; DOI: 10.2215/CJN.11311116
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo

Jump to section

Keywords