Tom Munk posted on Monday, December 13, 2004 - 1:39 pm
I recently used MPlus and AMOS to replicate a published article using NELS data. I was able to recreate the author's values, but only by ignoring the complex nature of the sample and the categorical nature of the data. When I tried to solve the problem, I was unable to account for these issues at the same time as accounting for the large amount of missing data. Can MPLUS (or any other package) appropriately handle all three of these important issues in one study?
bmuthen posted on Monday, December 13, 2004 - 2:31 pm
The current version of Mplus can handle categorical outcomes, missing data, and complex survey data. Complex survey data can be handled by Type=complex to correct SEs or by Type = twolevel to do multilevel modeling.
Tom Munk posted on Thursday, December 16, 2004 - 4:04 pm
According to the heading for this discussion section: "Missing data are not allowed in mixture, multilevel, and complex sample models or for categorical outcome variables."
In my replication of the NELS study, I agreed. I was unable to successfully use CATEGORICAL, type=MISSING, and WEIGHT in a single MPLUS run. In fact, I was unable to use type=MISSING in combination with either WEIGHT or CATEGORICAL.
I'm a little confused. I don't see what you are quoting "Missing data are not allowed in mixture, multilevel, and complex sample models or for categorical outcome variables." In Version 3 of Mplus, you should be able to combine CATEGORICAL, MISSING, and WEIGHT in a single Mplus run with COMPLEX or TWOLEVEL. Please send an example showing that you cannot to firstname.lastname@example.org.
The missing data section of the Mplus discussion page says that "In Mplus, missing data are allowed in cases where all outcome variables are continuous and normally distributed and a general model is being estimated. Missing data are not allowed in mixture, multilevel, and complex sample models or for categorical outcome variables." However, later discussion now alludes to the fact that missing data can be handled in some way for complex and or categorical outcome data. I am assuming that estimation of the model is still maximum likelihood. What is the exact missing data methodology being used in this case? Can it be used in any model that we can specify in Mplus?
I'm afraid that the introductions on Mplus Discussion have not been updated. Thank you for bringing this to our attention.
Following is a description from the Mplus User's Guide of the current Mplus missing data capabilities:
"Mplus has several options for the estimation of models with missing data. Mplus provides maximum likelihood (ML) estimation under MCAR (missing completely at random) and MAR (missing at random; Little & Rubin, 2002) for continuous, censored, binary, ordered categorical (ordinal), unordered categorical (nominal), counts, or combinations of these variable types. MAR means that missingness can be a function of observed covariates and observed outcomes. For censored and categorical outcomes using the weighted least squares estimators, missingness is allowed to be a function of the observed covariates but not the observed outcomes. Non-ignorable missing data modeling is possible using maximum likelihood where categorical outcomes represent indicators of missingness and where missingness may be influenced by continuous and categorical latent variables (Muthén et al., 2003).
Multiple data sets generated using multiple imputation (Schafer, 1997) can be analyzed using a special feature of Mplus. Parameter estimates are averaged over the set of analyses, and standard errors are computed using the average of the standard errors over the set of analyses and the between analysis parameter estimate variation.
In all models, missingness is not allowed for the observed covariates because they are not part of the model. The outcomes are modeled conditional on the covariates and the covariates have no distributional assumption. Covariate missingness can be modeled if the covariates are explicitly brought into the model and given a distributional assumption. With missing data, the standard errors for the parameter estimates are computed using the observed rather than the expected information matrix (Kenward & Molenberghs, 1998). Bootstrap standard errors and confidence intervals are also available with missing data."
Anonymous posted on Sunday, February 20, 2005 - 7:49 pm
I am reading through Mplus Web Note #7 and have a question about a statement made in the note.
In Version 2 of the note, Asparouhov and Muthen note (pg. 6): "...indeed there is no sample statistics based solution of [missing data with continuous and categorical outcomes under complete MAR assumption] even for single level model[s]...".
In Version 3 of the note, the authors state (pg. 8): "...there is no closed form solution to this estimation problem [using an ML estimator] even for the estimation of the mean of an observed variable...".
Would you provide a clarification of this point ? Do you mean that EM-based imputation of the sufficient statistics is not possible (in princple) for multilevel models ? A citation or two would also be especially helpful (since I thought, via Little and Rubin, most MAR missing data problems could be addressed via EM-based techniques).
Anonymous posted on Wednesday, March 02, 2005 - 2:44 pm
The EM algorithm can be used for multilevel models and just as in single level models the EM algorithm doesn't lead to a closed form solution but it leads to an iterative procedure. By closed form solution we mean explicit estimation formula as opposed to iterative algorithms such as the EM.
Anonymous posted on Tuesday, May 10, 2005 - 5:02 am
How can I employ MPLUS to perform EFA in the case of incomplete data not missing data? All variables in my case are categoricals.
bmuthen posted on Tuesday, May 10, 2005 - 11:56 am
What do you mean by "incomplete data not missing data"? That sounds like a contradiction.
Anonymous posted on Tuesday, May 10, 2005 - 12:30 pm
Dear bmuthen, You are correct. There is a contradiction in the words. What I want to mean " unbalanced data". That means, we may not have responses for some of variables.
bmuthen posted on Tuesday, May 10, 2005 - 11:28 pm
If you have missing data on some variables for some individuals, you simply add "missing" to your type= statement in the Analysis command (and declare the symbol for missing values in the Variable command).
If you have missing data on some variables for all individuals, you may simply delete those variables.
hi, i have several categorical (binary) covariates with some missings in a complex twolevel analysis. if i bring them into the model mentioning their variances I assume normality. do you think this is a reasonable approach to handle binary missingness? and if i do so, all the missing categorical covariates are treated as dependent and no longer contribute to the missingness-function, if i am correctly interpreting the user guide, right? thanks for any help
Does this model take into account the nested structure when imputing data? If not, how can I specify a saturated model that does this? I have no variables at level 2, but I think that values on certain variables will be similar within clusters.
You need to do a Twolevel analysis to account for the nested structure of the data when imputing. See the UG for examples. An saturated H1 model may be hard to work with for the imputations, and a simpler H0 model may have to be used. See the UG example 11.7.
Daniel Lee posted on Thursday, June 20, 2013 - 2:04 am
I'm trying to use multiple imputation for a model with only categorical variables. While running the diagnostic analysis the potential scale reduction value never drops below 1.05 despite showing over 10,000 iterations. In the model I'm estimating all covariances. Should I be looking beyond 10,000 iterations?
I don't think that value is bad. Compare the estimates with 10,000 versus 20,000 iterations to see if the estimates are close.
Robert Buch posted on Monday, September 16, 2013 - 8:38 am
I am doing a SEM on longitudinal data where I have missing data. Specifically, whereas participation on each measurement occasion varied from 248 (Questionnaire data Time 1) to 117 (physical test data Time 3), the sample of individuals who participated in all three measurement occasions (both questionnaire and physical test data) consisted of 84 cadets.
When doing a SEM in Mplus, it reports that "Number of obeservations" is 125.
Does this mean that my N = 125?
What would you reccomend that I report in my research paper under the SEM results? N = 248, or N = 125, or N = 84?
I would think the sample size showing in the output would be 248. It should be the number of observations that do not have missing at all occasions. Cases can be deleted that have missing on observed exogenous variables. Please send the files and your license number to email@example.com if this does not help.
I did a simple pilot study to compare the results of FIML and multiple imputation (MI). Specifically, the same information was used for FIML and IM without auxiliary and sampling weights and cluster. Three latent constructs with 13 items (4 point likert-scale )were included based on PISA12 sample (14131). For estimator, I used ML. 5 imputed data were used in MI. First, I compared the results of FIML CFA and MI CFA. I found the FIML CFA was almost equivalent to MI CFA, in which I treated the Likert items as continuous. However, there are substantial differences in ESEM with target rotation (targeting cross-loading to 0) when comparing FIML ESEM and IM ESEM. For example, In FIML, Y1 with Y2 was .637(.008) whereas the corresponding coefficient was .209(.334) in MI. I also tried to compare FIML with categorical imputation ESEM (treat the items as categorical). There are still huge differences. Why is this so different in ESEM with target rotation?
In addition, I confused that I had moderate Rate of Missing for each coefficients in MI, although covariance coverage indicated no missing data in MI files.