Difference Testing using Chi-square
Message/Author
 Sung Joon Jang posted on Thursday, October 20, 2011 - 12:01 pm
Please let me know whether I'm using the formulas correctly, found in "Difference Testing Using Chi-Square," http://www.statmodel.com/chidiff.shtml).

cd = (d0 * c0 - d1*c1)/(d0 - d1)
= (951 x 5.750 - 950 x 5.722)/(951 - 950)
TRd = (T0*c0 - T1*c1)/cd
= (2728.083 x 5.750 - 2717.094 x 5.722)/cd

COMPARISON MODEL
Loglikelihood
H0 Value -154318.940
H0 Scaling Correction Factor 5.722
for MLR
H1 Value -151645.790
H1 Scaling Correction Factor 2.887
for MLR
...
Chi-Square Test of Model Fit
Value 2717.094*
Degrees of Freedom 950
P-Value 0.0000
Scaling Correction Factor 1.968
for MLR
NESTED MODEL:
Loglikelihood
H0 Value -154323.099
H0 Scaling Correction Factor 5.750
for MLR
H1 Value -151645.790
H1 Scaling Correction Factor 2.887
for MLR
...
Chi-Square Test of Model Fit
Value 2728.083*
Degrees of Freedom 951
P-Value 0.0000
Scaling Correction Factor 1.963
for MLR
 Bengt O. Muthen posted on Friday, October 21, 2011 - 9:56 am
Yes, you are doing this correctly.
 Sung Joon Jang posted on Friday, October 21, 2011 - 11:13 am
Thanks for your confirmation. Let me ask a follow-up question. TRd was found to be 4.304958... Since the material says, "For MLM and MLR the products T0*c0 and T1*c1 are the same as the corresponding ML chi-square values," am I supposed to use 3.841 as critical value to determine whether the calculated S-B scaled chi-square difference is significant at the level of .05 or not? That is, is the difference (4.304958...) significant since TRd > 3.841?
 Sung Joon Jang posted on Friday, October 21, 2011 - 11:26 am
I forgot asking another question. The equality constraint was imposed on a single parameter (which measures the effect of child maltreatment on violent offenses) for two ethnic groups, whites and Asian Americans. In the comparison model, the coefficient was found to be .031 (SE = .027) for whites, whereas it was .654 (SE = 1.430). As you can see, both coefficients are not significant, although the S-B scaled chi-square difference is larger than 3.841. As I supposed to say the coefficient is significantly different between whites and Asian Americans even though the coefficient was found to be not significant in each ethnic group?
 Bengt O. Muthen posted on Friday, October 21, 2011 - 4:26 pm
1st post: Right.

2nd post: Each coefficient being significantly different from zero or not is not the same as testing that they are the same. Typically, if you use the independent-sample z test of equality using your SEs, you get the same thing as the chi2.
 Lisa M. Yarnell posted on Thursday, March 14, 2013 - 8:22 pm
Hi Linda and Bengt,

Step 1 on the Mplus website (http://www.statmodel.com/chidiff.shtml) for Difference Testing Using the Loglikelihood is:
1. Estimate the nested and comparison models using MLR. The printout gives loglikelihood values L0 and L1 for the H0 and H1 models, respectively, as well as scaling correction factors c0 and c1 for the H0 and H1 models, respectively.

Does this refer to H0 and H1 values given for the SAME model (i.e., in the same output file); or for DIFFERENT models (estimated in separate runs, with separate output files)?

I ask because while I have seen BOTH H0 and H1 values in some output files, I only see H0 for in a model I estimated using a NBI dependent variable, as seen below. There is no H1 value offered. Can I still utilize the steps on the website to compare the fit of this model with that of another nested model, using the H0 values only (the ones provided for each distinct model--because I did not get H0 and H1 values together in one output file). Thanks.

MODEL FIT INFORMATION
Number of Free Parameters 14
Loglikelihood
H0 Value -1189.806
H0 Scaling Correction Factor for MLR 1.1902
 Linda K. Muthen posted on Friday, March 15, 2013 - 9:04 am
To do difference testing you need to run two analyses. The first is the least restrictive model. It is referred to as H1 in the writeup. The nested model is referred to as H0 in the write up. In both cases, the H0 values are taken from the output to use in the computations.
 EFried posted on Tuesday, April 02, 2013 - 1:55 pm
When comparing 2 models using the MLR estimator, each model provides 3 scaling correction factors and 2 loglikelihoods. I don't find it specified which one to use for model comparison (http://www.statmodel.com/chidiff.shtml).

Thank you
 Linda K. Muthen posted on Tuesday, April 02, 2013 - 2:01 pm
The one for the H0 model -- what is posted above.
 ri ri  posted on Friday, August 29, 2014 - 3:21 am
I would like to compare two Mediation models:

model 1: x-m-y1-y2-y3
x-m-y1-y4
model 2: x-m-y1-y4
x-m-y2-y3

y3 and y4 are binary. Both models seem to work in Terms of Mediation. SO I Need to prove one model is better than the other.

Can I follow the instruction of doing the chi square test for WLSMV? I did not find any description regarding H0 and H1 models, scale correction info in Output.
 Bengt O. Muthen posted on Friday, August 29, 2014 - 4:40 pm
Looks like the only difference is that model 2 has a direct effect from m to y2.
 ri ri  posted on Saturday, August 30, 2014 - 4:08 pm
Yes, as far as I know one Needs to do a chi square difference test to compare the two models. In regular way, one just uses the chi square values. But since I have categorical data, I shall do it differently I suppose? I used the difftest command, but could not find the scale correction to calculate the difference with the formula provided at the Website.
 Bengt O. Muthen posted on Saturday, August 30, 2014 - 4:44 pm
With only one parameter difference you can just look at the z-test for that parameter in the model that is less restrictive.

In the general case you use DIFFTEST, first running the less restrictive model and then the more restrictive model. You don't need the scaling correction factors or the computations on the website. DIFFTEST does it for you.
 ri ri  posted on Tuesday, September 02, 2014 - 12:16 am
I tried the DIFFTEST to compare the contrained and uncontrained model, it worked wonderfully!

Just I have another methodological question. In the user guide multiple Group Analysis, you wrote an example, Fixing the mean of the variables in Group 2 to Zero. If I compare constrained and unconstrained models, is it necessary to fix the mean to Zero? I also saw some People Center the means of the continous variables in order to minimize multicollinearity. If I compare two path models (such as the above mentioned model comparion), I wonder if mean centering is needed?

Thank you very much!
 Linda K. Muthen posted on Tuesday, September 02, 2014 - 9:52 am
To compare means across groups, use the model with means zero in all groups versus the model with means zero in one group and free in the others. Centering is not needed.
 Ari J Elliot posted on Wednesday, January 07, 2015 - 7:44 pm
Hello Drs. Muthen,

Regarding chi square difference testing with MLR, please confirm that the H0 scaling correction factor that should be used in the calculation is the one listed under Loglikelihood, NOT the one listed under the MLR chi-square test of model fit.

Thus in the following output for the nested model, I would use 1.5862 as the scaling correction factor.

Loglikelihood

H0 Value -15770.576
H0 Scaling Correction Factor 1.5862
for MLR
H1 Value -15733.949
H1 Scaling Correction Factor 1.5549
for MLR
.............................
.....Chi-Square Test of Model Fit

Value 50.133*
Degrees of Freedom 5
P-Value 0.0000
Scaling Correction Factor 1.4612
for MLR

Thank you!
 Linda K. Muthen posted on Thursday, January 08, 2015 - 11:10 am
If you use chi-square for the difference testing, you should use the scaling correction factor under chi-square. If you use the loglikelihood for the difference testing, you should use the scaling correction factor under loglikelihood.
 Ari J Elliot posted on Thursday, January 08, 2015 - 11:37 am
Ok thanks. To further clarify, the instructions on the webpage for difference testing using chi-square state: "Be sure to use the correction factor given in the output for the H0 model."

Under the chi square I only see one scaling correction factor, whereas for loglikelihood there are correction factors provided for both H0 and H1. Given that correction factors for both the nested and comparison models are used in the calculation I'm not sure to what the reference to the H0 model in the instructions refers.
 Linda K. Muthen posted on Friday, January 09, 2015 - 6:11 am
You should use the H0 scaling correction factors. If only one is specified, it is the H0. Don't use the one for the baseline model. If you have further questions, send the output and your license number to support@statmodel.com and we can tell you which number to use.
 Cheng posted on Sunday, April 05, 2015 - 6:37 pm
Dear Muthen,
I have a SEM model with these relationships
(1) one latent and its three observed variables
(2) Five observed variables that involved in path relationships with the latent in (1)
(3) A correlation in two of the observed variables in (2).
I use MLR estimator and would like to know the chi-square p-value. I follow the instruction given in your website on difference testing on chi-square, to compute the scaled difference in chi-square. My question is for the H0 (restricted model), which relationships in (1)to(3) I need to constrain? Should I just constrain the path relationships in (2) which is my main interest? Our goal in this test is to get a non significant p-value right? like the ML estimator's chi-square result for model fit test?
 Bengt O. Muthen posted on Monday, April 06, 2015 - 5:10 pm
These are choices the researcher has to make. You may want to discuss it on SEMNET.
 Cheng posted on Monday, April 06, 2015 - 5:51 pm
Thank you.
 Noa Cohen posted on Tuesday, June 23, 2015 - 5:26 am
I am trying to calculate the values for a chi square difference test with ML. However, the output does not include the scaling correction factor. What can I do?
Thank you.
 Linda K. Muthen posted on Tuesday, June 23, 2015 - 6:36 am
With ML you don't need a scaling correction factor.
 Noa Cohen posted on Tuesday, June 23, 2015 - 8:31 am
Thank you. Other than that I should use the instructions that are stated on the website? because they do not specify ML.
 Linda K. Muthen posted on Tuesday, June 23, 2015 - 8:42 am
See pages 486-487 of the user's guide.
 John Schwabe posted on Friday, September 11, 2015 - 3:42 am
Dear M-Plus-Team,

is there any information how the Satorra-Bentler scaled chi-square difference test is influenced by high N´s (e.g. n > 30 000)? Is it influenced at all?
I am investigating measurement invariance with large subpopulation-samples and complex survey data (students nested in teachers) and therefore I use the SB-chi-square to test nested models.

 Tihomir Asparouhov posted on Friday, September 11, 2015 - 9:23 am
The performance improves with larger sample sizes, See Table 3, under MLR

 Cheng posted on Tuesday, March 29, 2016 - 6:41 pm
Dear Linda,
In ESEM invariance test for 2 groups, when I compare the metric (loading) invariance model with the configural (baseline) model, by using MLR estimator, can I still calculate the chi-square difference in Mplus using MLR? I have a problem to determine the constraint/more restrictive model for my configural and metric invariance ESEM models. The same thing for other invariance test (scalar, error variance). Can you give some advises. Thanks.
 Linda K. Muthen posted on Wednesday, March 30, 2016 - 1:09 pm
 Jiangang Xia posted on Thursday, November 02, 2017 - 9:41 am
Dear Linda,
I am confused by the instructions from the website and your previous responses to some above questions regarding the "Difference Testing Using Chi-square".

For example, for the very first question in above, you said "Yes, you are doing this correctly." However, in the question, the "H0 Scaling Correction Factor for MLR" (5.722 and 5.750) under "Logliklihood" was used, not the "Scaling Correction Factor for MLR" (1.968 and 1.963)under "Chi-Square Test of Model Fit".

In another question in above that was posted by Ari J Elliot posted on January 07, 2015, you responded that "If you use chi-square for the difference testing, you should use the scaling correction factor under chi-square."

So I am not sure which "scaling correction factor" should we use for the "Difference Testing Using Chi-square".

In order to avoid the confusion, here I want to use the output from the first question. If I want to compare the two models using chi-square, should I use

H0 Scaling Correction Factor 5.722
for MLR ?

or should I use

Scaling Correction Factor 1.968
for MLR ?

A related question: when should we use chi-square and when should we use Loglikelihood?

Thank you!
 Tihomir Asparouhov posted on Thursday, November 02, 2017 - 1:23 pm
The "Scaling Correction Factor for MLR" should be used with the "Difference Testing Using Chi-square".

There should be no confusion about this since that correction factor is printed just below the chi-square value.

In every case you can use chi-square or the log-likelihood. Both should give you exactly the same result (subject to round off error).
 Derek Boy posted on Saturday, January 20, 2018 - 9:44 am
Dear Dr. Muthen
In order to compare the two models as below, I have tried to do the deviance test using loglikelihood. However, I could not figure out the numbers of parameters (i.e., p0 and p1) which are required by the formula for computing the scaling correction (cd) = (p0*c0 - p1*c1)/(p0 - p1), where p0 is the number of parameters in the nested model and p1 is the number of parameters in the comparison model.
Best regards.
-------------------------------
MODEL A
Number of Free Parameters 17
Loglikelihood
H0 Value -215.987
H0 Scaling Correction Factor 0.4637
for MLR
H1 Value -215.987
H1 Scaling Correction Factor 0.4637
for MLR
… … …
Chi-Square Test of Model Fit
Value 0.000*
Degrees of Freedom 0
P-Value 0.0000
Scaling Correction Factor 1.0000
for MLR
-------------------------------
MODEL B
Number of Free Parameters 19
Loglikelihood
H0 Value -214.709
H0 Scaling Correction Factor 0.4195
for MLR
H1 Value -214.715
H1 Scaling Correction Factor 0.4195
for MLR
… … …
Chi-Square Test of Model Fit
Value 0.000*
Degrees of Freedom 0
P-Value 1.0000
Scaling Correction Factor 1.0000
-------------------------------
 Bengt O. Muthen posted on Saturday, January 20, 2018 - 4:42 pm
You have zero degrees of freedom for both models so neither model is testable and no model comparison can be done.
 Derek Boy posted on Saturday, January 20, 2018 - 6:37 pm
Dear Dr. Muthen
So, my two models are saturated and having zero degrees of freedom.
Many many thanks for your pointing it out to me.
But, may I also ask whether fitting a saturated model is a bad thing to do?
Should I do something to make it unsaturated?
What is that something you would suggest me to do?
With best regards.
 Bengt O. Muthen posted on Sunday, January 21, 2018 - 5:22 pm
 Chong Man Chow posted on Monday, April 16, 2018 - 1:47 pm
Dear Drs Muthen

I intended to compare two nested model with the Satorra-Bentler scaled chi-square difference test (both models used MLR as the estimator) and based on the formula, the computed SB-chi-square is a negative number. I wonder if this is possible and how should I resolve this issue?

Chong.
 Chong Man Chow posted on Monday, April 16, 2018 - 1:52 pm
Drs. Muthen

Please ignore my question above; I have figured out the problem.

Thanks,
Chong.
 Sam Crawley posted on Sunday, June 17, 2018 - 7:10 pm
Hi all,

I am comparing models in a TWOLEVEL MIXTURE (MLR) analysis to test if particular covariates should be included in the model. I am using the Loglikelihood to calculate the TRd value, as per the website (the Chi-square values do not appear in my output for some reason).

I can do the calculation, however, how do I calculate the degrees of freedom in order to obtain the critical value of the TRd value?

 Bengt O. Muthen posted on Monday, June 18, 2018 - 9:42 am
The df is obtained as the difference in the number of parameters. That is also discussed on that website page.
 Jana Rose Uppendahl posted on Wednesday, July 18, 2018 - 5:17 am
Dear all,

I comuted two CFAs, testing a three-fator model and a three-factor model with a general factor using Mplus editior 7.3. Now I'd like to do a DIFF test to see which model is better. However, my outputs do not give me a correction factor. How do I get the correction factor?

Thanks for any help!
 Bengt O. Muthen posted on Wednesday, July 18, 2018 - 8:16 am
You get them with Estimator = MLR.
 Jana Rose Uppendahl posted on Wednesday, July 18, 2018 - 8:26 am
My output uses WLSMV as estimator. These are the two models I'd like to do a DIFF test with.

Do I have to run the models in a different analysis to get MLR and be able to do a DIFF test?

Title: CFA 1
Data: FILE is File1
Variable: NAMES ARE S1 S2 S3 S4 S5 S6 S7 S8 S9 S10;
USEVARIABLES ARE S1 S2 S3 S4 S5 S7 S8 S9 S10;
CATEGORICAL ARE S1 S2 S3 S4 S5 S7 S8 S9 S10;
MODEL: F1 BY S1* S2;
F2 BY S3* S4 S5;
F3 BY S7* S8 S9 S10;[F1-F3@0];F1-F3@1;
OUTPUT: SAMPSTAT tech1 MODINDICES;
Plot: TYPE = PLOT2;

Title: CFA 2
Data: FILE is File1
Variable: NAMES ARE S1 S2 S3 S4 S5 S6 S7 S8 S9 S10;
USEVARIABLES ARE S1 S2 S3 S4 S5 S7 S8 S9 S10;
CATEGORICAL ARE S1 S2 S3 S4 S5 S7 S8 S9 S10;
MODEL: F1 BY S1* S2;
F2 BY S3* S4 S5;
F3 BY S7* S8 S9 S10;[F1-F3@0];F1-F3@1;
Y BY F1 F2 F3;
OUTPUT: SAMPSTAT tech1 MODINDICES;
Plot: TYPE = PLOT2;
 Bengt O. Muthen posted on Wednesday, July 18, 2018 - 12:49 pm
There are 2 different things here.

DIFFTEST is for WLSMV and for this testing you don't need to use a scaling correction factor - see the UG for how to do DIFFTEST.

For chi-square difference testing with MLR you use scaling correction factors to get the test as we describe on our website (see left column).
 Jana Rose Uppendahl posted on Wednesday, July 18, 2018 - 2:53 pm
Thank you Bengt!

Thus, I am doing a DIFFtest. However, when running it I get the error message THE CHI-SQUARE DIFFERENCE TEST COULD NOT BE COMPUTED BECAUSE THE H0 MODEL
IS NOT NESTED IN THE H1 MODEL.

Title: CFA
Data: FILE is Dr.E.dat.inp;
Variable: NAMES ARE S1 S2 S3 S4 S5 S6 S7 S8 S9 S10;
USEVARIABLES ARE S1 S2 S3 S4 S5 S7 S8 S9 S10;
CATEGORICAL ARE S1 S2 S3 S4 S5 S7 S8 S9 S10;
MODEL: F1 BY S1* S2;
F2 BY S3* S4 S5;
F3 BY S7* S8 S9 S10;;Y BY F1 F2 F3;[F1-Y@0];F1-Y@1;
OUTPUT: SAMPSTAT tech1 MODINDICES;
SAVEDATA: DIFFTEST IS dtest.dat;

Title: CFA
Data: FILE is Dr.E.dat.inp;
Variable: NAMES ARE S1 S2 S3 S4 S5 S6 S7 S8 S9 S10;
USEVARIABLES ARE S1 S2 S3 S4 S5 S7 S8 S9 S10;
CATEGORICAL ARE S1 S2 S3 S4 S5 S7 S8 S9 S10;
ANALYSIS: DIFFTEST=dtest.dat
MODEL: F1 BY S1* S2;
F2 BY S3* S4 S5;
F3 BY S7* S8 S9 S10;[F1-F3@0];F1-F3@1;
OUTPUT: SAMPSTAT tech1 MODINDICES;

Why do I get the error message?

 Bengt O. Muthen posted on Wednesday, July 18, 2018 - 3:05 pm
A quick look says that the only difference between the models is that you put a second-order factor behind the 3 first-order factors. If that's the case, the models are the same because 3 indicators of 1 factor is a just-identified model - you are not restricting the covariance matrix for the first-order factors. You need 4 or more first-order factors for that.

If I am right, it will tell you that the 2 models are equivalent.
 Jana Rose Uppendahl posted on Thursday, July 19, 2018 - 1:13 am
Hi Bengt,

Thank you! The link says models are eqivalent. Is there thus, no way in mplus to check if the hierachical model is better than the 3factor model?

Do i perhaps need to change something in the covariance matrix?
 Bengt O. Muthen posted on Thursday, July 19, 2018 - 6:11 am
Q1: There is no way in Mplus or any software. The 2 models are the same when you have only 3 first-order factors. "The same" means that they produce the exact same covariances among the observed variables. The models have the same number of parameters and when you have estimated one, you can transform its parameter values to the parameter values of the other.

Q2: There is no change that you can make - just accept the fact that this can't be tested - you can present the second-order factor model but you can't say that it fits better or worse.
 Sangeeta Mani posted on Sunday, July 22, 2018 - 5:51 pm
Hello!

I am comparing two Path Analysis models using the chi-square difference testing (Satorra-Bentler scaled chi-square difference test) - I got the formula for it from this website: https://www.statmodel.com/chidiff.shtml - the first set of tests listed on the page.

The nested model has 8 degrees of freedom, whereas the comparison model is saturated and has 0 degrees of freedom and a chi square value of 0.

Is it okay to carry out the chi-square difference testing between the two models, given that one of the models is saturated?

If it is indeed okay, I wonder if there is a citation you are aware of that I could cite to justify doing this (I am getting pushback on this from others).

Thank you so much for your help!!
 Bengt O. Muthen posted on Monday, July 23, 2018 - 10:35 am
When one of the models is the saturated one, Mplus automatically provides this test in the regular Model Fit section of the output.
 Md Zabir Hasan posted on Saturday, September 01, 2018 - 8:33 am
Hello,

I am trying to perform DIFFTEST between two CFA models with all categorical indicators.

Model 1: Unconstrained model
f1 BY x1 x2 x3;
f2 BY x4 x5 x6;
f3 BY x7 x8 x9;
f4 BY x10 x11 x12;

Model 2: Restricted Model
f1 BY x1 x2 x3;
f2 BY x4 x5 x6;
f3 BY x7 x8 x9 x10 x11 x12;

In Model 1 the correlation between f3 and f4 was 0.75 thus I wanted to test if a three-factor model has a good fit. I have run the DIFFTEST in Mplus.

My question: While the DIFFTEST is executed in Mplus, if my assumptions are correct and if Model 2 is nested within Model 1 to perform the comparison.
 Bengt O. Muthen posted on Saturday, September 01, 2018 - 10:16 am
Check if the two models are nested using the new NESTED option introduced in Mplus version 8.1. Read about it here (see Papers, SEM or Recent Papers):

Asparouhov, T. & Muthén, B. (2018). Nesting and equivalence testing in Mplus. Technical Report. Version 2. August 13, 2018. (Download scripts).
 Jana Rose Uppendahl posted on Thursday, November 08, 2018 - 2:35 am
Hello,
I am doing a Factor Analyisis and my goal is to test whether a hierachical model with a general factor or just a three-factor model fits my data best.

When performing the hierachical model the input reading terminates normally, however, my factor loadings and the std errors leave me with questions. Why are the loadings and errors so high? Is there a problem in my code?

Code:
Data: FILE is Dr_E.inp;
Variable: NAMES ARE EP1 EP2 EP3 EP4 EP5 EP6 EP7 EP8 EP9 EP10;
USEVARIABLES ARE EP1 EP2 EP3 EP4 EP5 EP7 EP8 EP9 EP10;
CATEGORICAL ARE EP1 EP2 EP3 EP4 EP5 EP7 EP8 EP9 EP10;
MODEL: F1 BY EP1* EP2;
F2 BY EP3* EP4 EP5;
F3 BY EP7* EP8 EP9 EP10;[F1-F3@0];F1-F3@1; Y BY F1* F2 F3;[Y@0];Y@1;
OUTPUT: SAMPSTAT tech1 MODINDICES;
PLOT: TYPE=PLOT2;
Output:
Y BY
F1 1.059 0.170 6.218 0.000
F2 5.140 7.062 0.728 0.467
F3 2.544 0.931 2.732 0.006
Means
Y 0.000 0.000 999.000 999.000
Intercepts
F1 0.000 0.000 999.000 999.000
F2 0.000 0.000 999.000 999.000
F3 0.000 0.000 999.000 999.000
 Bengt O. Muthen posted on Friday, November 09, 2018 - 1:15 pm
To make the model identified, you need to add

f1-f3 with y@0;
 Jana Rose Uppendahl posted on Wednesday, November 14, 2018 - 2:17 am
Dear Bengt, thank you!

I have added this code line. The factor loadings and errors are still the same. Am I do something incorrectly?

Data: FILE is Dr_E.inp;
Variable: NAMES ARE EP1 EP2 EP3 EP4 EP5 EP6 EP7 EP8 EP9 EP10;
USEVARIABLES ARE EP1 EP2 EP3 EP4 EP5 EP7 EP8 EP9 EP10;
CATEGORICAL ARE EP1 EP2 EP3 EP4 EP5 EP7 EP8 EP9 EP10;
MODEL: F1 BY EP1* EP2;
F2 BY EP3* EP4 EP5;
F3 BY EP7* EP8 EP9 EP10;[F1-F3@0];F1-F3@1; Y BY F1* F2 F3;[Y@0];Y@1; F1-F3 with Y@0;
OUTPUT: SAMPSTAT tech1 MODINDICES;

Y BY
F1 1.059 0.170 6.218 0.000
F2 5.140 7.062 0.728 0.467
F3 2.544 0.931 2.732 0.006
 Bengt O. Muthen posted on Wednesday, November 14, 2018 - 4:43 pm
 Dinah Spitzley posted on Thursday, June 27, 2019 - 1:18 am
Hello,

I need to compare nested models. I am using ML and I got the following loglikelihood statistics for the two models I want to compare. As I understood correctly for ML I don't need the scalling correction factors:

Model 1: -6369.028 (67)
Model 2: -6368.841 69

Loglikelihood ratio: .374
Difference in Degree of Freedom: 2

How do I now know if the difference is significant or not?

Thank you very much for the help.
Best regards
Dinah
 Bengt O. Muthen posted on Thursday, June 27, 2019 - 5:05 pm
With df=2, the 5% critical value for Chi-square is 5.991, so the difference is not significant at the 5% level. You know that 0.374 is small for df=2 because the expected value is 2 (the df).
 mdehne posted on Wednesday, May 20, 2020 - 3:06 am
Hi Linda, Bengt, or Tihomir

I have got two questions:

1) Am I correct that the computation of the chi square difference test for MLR (http://www.statmodel.com/chidiff.shtml) does not ensure the positiveness as proposed by Satorra and Bentler (2010) and is thus based on the original paper (Satorra, 2000; Satorra & Bentler, 2001)?

If I am correct: 2) Is there any computational opportunity to use Satorra & Bentler's (2010) alternative?

Kind regards,
Matt
 Bengt O. Muthen posted on Wednesday, May 20, 2020 - 4:56 pm
This is described in Web Note 12.