Polychoric correlations and ULS PreviousNext
Mplus Discussion > Confirmatory Factor Analysis >
 Leanne Magee posted on Wednesday, October 06, 2004 - 1:31 pm
I am attempting to conduct confirmatory factor analyses using AMOS software on a data set collected from a 5-point scale in which there is neither univariate nor multivariate normality. Realizing AMOS is not sufficient for these analyses, we considered MPLus. However, my sample size is too small for weighted least squares (WLS) categorical methods in MPlus, and the methods for continuous data are inappropriate because of the level of measurement of the item responses. We have considered fitting the model using polychoric correlations and unweighted least squares (ULS) in MPlus, because ULS might do better with a small sample than the otherwise preferable WLS methods. What would you suggest we do?
 Linda K. Muthen posted on Thursday, October 07, 2004 - 4:44 am
I don't know how small your sample is but the WLSMV estimator has been shown to work well in small samples for some models. You can request the following reference from burnett@gseis.ucla.edu:

Muthén, B., du Toit, S.H.C. & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Accepted for publication in Psychometrika. (#75)
 Leanne Magee posted on Thursday, October 07, 2004 - 10:00 am
Thank you for your prompt response. As it turns out, I am conducting the CFA in three samples - one has 110 participants, another 55, and the third 31. I have requested the article by contacting the given email address, but wanted to know if you had any opinion regarding the actual sizes of my sample before I am able to read the article. Thank you!
 Linda K. Muthen posted on Tuesday, October 12, 2004 - 4:36 pm
With these very small samples, ULS is most likely the best approach.
 craig neumann posted on Friday, May 04, 2007 - 11:38 am
When using ordinal items in CFA models (samples >=250), it seems that a best practice would be to use the raw items and the WLSMV estimation procedure. However, I have seen some investigators use a polychoric correlation matrix as the data input and the ML estimation procedure. While I assume the two methods should produce very similar results, shouldn't the former approach produce more precise model resuts? Any references on this topic would be appreciated.
 Linda K. Muthen posted on Friday, May 04, 2007 - 2:53 pm
If you use maximum likelihood with a polychoric correlation matrix, you will obtain consistent parameter estimates but standard errors and chi-square will not be correct. It is often the case that polychoric correlatino matrices are not positive defininite.
 craig neumann posted on Friday, May 04, 2007 - 5:12 pm
Thank you Linda. And so, you'd recommend using raw items as input with WLSMV as a better approach than ML?
 Linda K. Muthen posted on Friday, May 04, 2007 - 5:19 pm
Yes. Or maximum likelihood with raw data. Mplus has both estimators for categorical outcomes.
 Tracy Witte posted on Tuesday, May 27, 2008 - 8:17 am
I am conducting an EFA with 10 categorical indicators (some binary, some with 5 categories) on a sample of 1,085. The first model I ran involved using the ULS estimator, and I obtained a 2-factor solution that seemed quite interpretable and made sense in terms of previous work. After doing some more reading, I discovered that WLSMV was considered to be a better estimator. When I ran the analysis using WLSMV, I obtained a different solution, and one that is less interpretable/useful. I still obtained a 2-factor solution, it's just that I have more items double loading on both factors, and overall, a less clear picture about how the items hang together. Am I justified in using ULS? Why would the solutions be so different from one another?
 Linda K. Muthen posted on Tuesday, May 27, 2008 - 9:03 am
I don't think the two analyses should be that different. Please send the two outputs and your license number to support@statmodel.com.
Back to top
Add Your Message Here
Username: Posting Information:
This is a private posting area. Only registered users and moderators may post messages here.
Options: Enable HTML code in message
Automatically activate URLs in message