Pooling and Predictor selection function for backward or forward selection of Logistic regression models across multiply imputed data.
Pooling and Predictor selection function for backward or forward selection of Logistic regression models across multiply imputed data.
psfmi_lr Pooling and backward or forward selection of Logistic regression models across multiply imputed data using selection methods RR, D1, D2, D3, D4 and MPR.
data: Data frame with stacked multiple imputed datasets. The original dataset that contains missing values must be excluded from the dataset. The imputed datasets must be distinguished by an imputation variable, specified under impvar, and starting by 1.
formula: A formula object to specify the model as normally used by glm. See under "Details" and "Examples" how these can be specified. If a formula object is used set predictors, cat.predictors, spline.predictors or int.predictors at the default value of NULL.
nimp: A numerical scalar. Number of imputed datasets. Default is 5.
impvar: A character vector. Name of the variable that distinguishes the imputed datasets.
Outcome: Character vector containing the name of the outcome variable.
predictors: Character vector with the names of the predictor variables. At least one predictor variable has to be defined. Give predictors unique names and do not use predictor name combinations with numbers as, age2, gender10, etc.
cat.predictors: A single string or a vector of strings to define the categorical variables. Default is NULL categorical predictors.
spline.predictors: A single string or a vector of strings to define the (restricted cubic) spline variables. Default is NULL spline predictors. See details.
int.predictors: A single string or a vector of strings with the names of the variables that form an interaction pair, separated by a “:” symbol.
keep.predictors: A single string or a vector of strings including the variables that are forced in the model during predictor selection. All type of variables are allowed.
nknots: A numerical vector that defines the number of knots for each spline predictor separately.
p.crit: A numerical scalar. P-value selection criterium. A value of 1 provides the pooled model without selection.
method: A character vector to indicate the pooling method for p-values to pool the total model or used during predictor selection. This can be "RR", D1", "D2", "D3", "D4", or "MPR". See details for more information. Default is "RR".
direction: The direction of predictor selection, "BW" means backward selection and "FW" means forward selection.
Returns
An object of class pmods (multiply imputed models) from which the following objects can be extracted:
data imputed datasets
RR_model pooled model at each selection step
RR_model_final final selected pooled model
multiparm pooled p-values at each step according to pooling method
multiparm_final pooled p-values at final step according to pooling method
multiparm_out (only when direction = "FW") pooled p-values of removed predictors
formula_step formula object at each step
formula_final formula object at final step
formula_initial formula object at final step
predictors_in predictors included at each selection step
predictors_out predictors excluded at each step
impvar name of variable used to distinguish imputed datasets
nimp number of imputed datasets
Outcome name of the outcome variable
method selection method
p.crit p-value selection criterium
call function call
model_type type of regression model used
direction direction of predictor selection
predictors_final names of predictors in final selection step
predictors_initial names of predictors in start model
keep.predictors names of predictors that were forced in the model
Details
The basic pooling procedure to derive pooled coefficients, standard errors, 95 confidence intervals and p-values is Rubin's Rules (RR). However, RR is only possible when the model included continuous or dichotomous variables. Specific procedures are available when the model also included categorical (> 2 categories) or restricted cubic spline variables. These pooling methods are: “D1” is pooling of the total covariance matrix, ”D2” is pooling of Chi-square values, “D3” and "D4" is pooling Likelihood ratio statistics (method of Meng and Rubin) and “MPR” is pooling of median p-values (MPR rule). Spline regression coefficients are defined by using the rcs function for restricted cubic splines of the rms package. A minimum number of 3 knots as defined under knots is required.
A typical formula object has the form Outcome ~ terms. Categorical variables has to be defined as Outcome ~ factor(variable), restricted cubic spline variables as Outcome ~ rcs(variable, 3). Interaction terms can be defined as Outcome ~ variable1*variable2 or Outcome ~ variable1 + variable2 + variable1:variable2. All variables in the terms part have to be separated by a "+". If a formula object is used set predictors, cat.predictors, spline.predictors or int.predictors at the default value of NULL.
Eekhout I, van de Wiel MA, Heymans MW. Methods for significance testing of categorical covariates in logistic regression models after multiple imputation: power and applicability analysis. BMC Med Res Methodol. 2017;17(1):129.
Enders CK (2010). Applied missing data analysis. New York: The Guilford Press.
Meng X-L, Rubin DB. Performing likelihood ratio tests with multiply-imputed data sets. Biometrika.1992;79:103-11.
van de Wiel MA, Berkhof J, van Wieringen WN. Testing the prediction error difference between 2 predictors. Biostatistics. 2009;10:550-60.
Marshall A, Altman DG, Holder RL, Royston P. Combining estimates of interest in prognostic modelling studies after multiple imputation: current practice and guidelines. BMC Med Res Methodol. 2009;9:57.
Van Buuren S. (2018). Flexible Imputation of Missing Data. 2nd Edition. Chapman & Hall/CRC Interdisciplinary Statistics. Boca Raton.
EW. Steyerberg (2019). Clinical Prediction MOdels. A Practical Approach to Development, Validation, and Updating (2nd edition). Springer Nature Switzerland AG.