Model Comparison EFA PreviousNext
Mplus Discussion > Exploratory Factor Analysis >
Message/Author
 Thomas A. Schmitt posted on Tuesday, August 04, 2009 - 9:54 am
Hello,

Is there a method for comparing models in the EFA framework? The fit statistics are very useful but it's difficult to say which model actually is the "best" fitting model. Is EFA in the CFA framework the method of choice for EFA model comparison? Also, is it possible with the WLSMV estimator? Thank you!

Tom
 Linda K. Muthen posted on Tuesday, August 04, 2009 - 11:40 am
I think the EFA models are nested so a chi-square difference test could be used.
 Thomas A. Schmitt posted on Wednesday, August 05, 2009 - 11:06 am
Is it possible then to use the DIFFTEST option subcommand in EFA to compare models when using the WLSMV estimator?
 Tihomir Asparouhov posted on Wednesday, August 05, 2009 - 1:46 pm
No, but you can use the WLSM or WLS estimators with EFA.

Alternatively, you can use DIFFTEST and WLSMV within ESEM, that is, setup the EFA model directly:
f1-f5 by y1-y20 (*1); for example or see Example 1 in http://statmodel.com/download/examples1.pdf

Note, however, that testing m-1 factors against m factors is susceptible to overfactoring and inflated Type I error, see Hayashi, K., Bentler, P. M., & Yuan, K. (2007). On the likelihood ratio test for the number of factors in exploratory factor analysis. Structural Equation Modeling, 14, 505526.
 Thomas A. Schmitt posted on Thursday, August 06, 2009 - 7:05 am
So you can use DIFFTEST with WLSM or you can use the chi-square difference test? How does WLSM perform compared to WLSMV?
 Thomas A. Schmitt posted on Thursday, August 06, 2009 - 7:29 am
Okay, so you can not use chi-square for difference testing, so I'm assuming you can use DIFFTEST with WLSM? How would the code work with EFA in that you have to specify two factor structures?
 Linda K. Muthen posted on Thursday, August 06, 2009 - 7:31 am
The DIFFTEST option is used only with WLSMV. With WLSM a scaling correction factor is given that is used when hand calculating the chi-square difference test. WLSM and WLSMV perform pretty much the same.
 Thomas A. Schmitt posted on Thursday, August 06, 2009 - 7:51 am
Thanks Linda. I did run the DIFFTEST in EFA with WLSMV and it did work. But I assume the output file is meaningless?
 Metin Ozdemir posted on Monday, February 08, 2010 - 5:15 am
Hi,
Which relative fit indexes do you recommend for EFA with MPlus? My model gives a low CFI (.88), but good RMSEA (.06) and SRMR (.03), and the factor structures make theoretical sense. Can I rely on RMSEA and SRMR in such a case?

Thanks,
 Linda K. Muthen posted on Monday, February 08, 2010 - 8:17 am
I would also look at chi-square. The low CFI may be because of low correlations.
 Wim Van den Broeck posted on Wednesday, March 03, 2010 - 6:08 am
I have an EFA model with categorical items. The estimator is WLSM. How can I compare the models ( e.g. a model with 5 factors vs. a model with 6 factors)? There is a warning about comparing the chi-squares. Should I use the formula's in the technical appendix on difference testing, however, there is only mentioned ML, MLM or MLR as estimators?
 Linda K. Muthen posted on Wednesday, March 03, 2010 - 8:15 am
The test for WLSM is the same as for MLR and MLM as shown on the website under How To.
Back to top
Add Your Message Here
Post:
Username: Posting Information:
This is a private posting area. Only registered users and moderators may post messages here.
Password:
Options: Enable HTML code in message
Automatically activate URLs in message
Action: