I am doing a multigroup analysis with 47 groups, one latent variable and three indicators, incorporating a meanstructure.
I want to test measurement invariance according to Steenkamp/Baumgartner 1998 (“Assessing Measurement Invariance in Cross-National Consumer Research”). They recommend to start with an omnibus test of the equality of the Covariance matrices and mean vectors, both jointly and seperately.
I am wondering how to perform the tests. I tried to find a reference concerning this topic but I couldn’t find any detailed despription of the procedure. Could you please tell me how I can do these tests in MPlus.
Thank you for your help.
bmuthen posted on Tuesday, August 03, 2004 - 3:08 pm
For equality across groups of the covariance matrix you say in the Model command:
After conducting the test of equivalence of covariance matrices several further questions arose:
1. What is the theory behind the test statistic? E.g. how is the test statistic calculated? Is it based on the Box test (Box 1950)? Is estimation by ML correct?
2. Steenkamp/Baumgartner 1998 mention problems in the calculation of the baseline model when meanstructures are incorporated. They recommend not using incremental fit indices for testing the hypothesis of equal means and covariances across groups. Does this limitation also hold for the calculation of the TLI/CFI in MPlus? Can I use the TLI/CFI in evaluating model fit in an analysis with a meanstructure?
3. How can I test configural invariance? Is it correct to allow for all parameters to vary across groups? How do I achieve identification in this case?
Thank you in advance for your helpful comments.
bmuthen posted on Sunday, August 08, 2004 - 5:44 pm
1. The test statistic is the standard likelihood-ratio chi-square obtained as 2 times the logL difference, not the Box test.
2. I am not familiar with the S-B critique. It seems to me that TLI/CFI would be fine also in this case.
3. Configural invariance is where the pattern of fixed, zero loadings is the same across groups. For each group you use the single-group rules for identification.
Anonymous posted on Monday, February 28, 2005 - 8:25 pm
I am testing invariance of first-order factor loadings with a second-order factor model (NK=1, NE=3, NI=12) between two gender groups (n1=306, n2=122) using DWLS with polychoric correlation matrices. LISREL gives a warning: PSI is not positive definite. I would like to know any factors that can lead to this problem and what can I do about it?
This message means that either you have a negative residual variance, a correlation greater than one, or some linear dependency among a set of your variables. You most likely need to change your model.
Regarding the first post above about testing invariance of covariance matrices:
If one runs syntax like that suggested above, is the chi-square produced the actual test statistic or do you have to construct another syntax file in which the covariance pattern is allowed to vary across groups (i.e. something like what you do for a chi-square difftest)?
And if you only need that chi-square, does significance indicate that there are differences in the covariance matrices across the groups included?
If you want to test the equality of covariance matrices across groups, you need two chi-square statistics to do a difference test -- one from the model without equalities and one from the model with equalities.
Like the posting above, I am also interested in an omnibus test of equality of the covariance matrix. I have a model with 3 latent variables and 8 indicators, which means I have 35 covariance elements, right? I wrote the syntax to constrain all 35 elements- is this correct? I feel like I am constraining too much. Thanks!
In that case, you would have 36 variances and covariances. You would need to run the analysis with them unconstrained across groups and then constrained across groups and do a chi-square difference test. For this test, the factors would not be part of the model.
Thanks for your reply. yes, I miscounted- 36 is correct. I ran it with a constrained covariance matrix across groups and got a chi sq of 108, df=36. When I ran it unconstrained, the chi sq value was 0, df=0. This chi sq diff is of course significant. Is it normal to have a chi sq of 0 in an analysis like this?
I am interpreting this as meaning that the covariance matrices differ by group.
Hi, New to Mplus, new to CFA. I am attempting to do a multigroup CFA. I have ten items, loading on 1 factor, and two groups (male and female). I believe I need to do an 'omnibus test of the equality of matrices of polychoric correltations and of the threshold structure of the items' across gender, to test whether there is any difference between the genders.
I am not sure how to include this in my model code? And how do I get a test statistic that will indicate whether or not there are differences?
Hello, I believe I successfully ran a model testing a constrained and unconstrained covariance matrix to test differences in patterns between variables across waves. I concluded that the differences are minimal and would like to report the constrained model in my correlations table. It looks like the MODEL RESULTS show the constrained estimates, but the STANDARDIZED MODEL RESULTS go back to the unconstrained estimates. Is it possible to get the standardized constrained estimates to report in my correlations table? Thank you!
Sorry, I just realized that this thread is in the CFA folder - I should add that I did not do a CFA, this was just for my basic correlations among the variables in my study. There are a 4 waves of data, so this was an effort to see if I could simplify my results section a little.