I am pursuing publication in a journal that now requires reporting of effect sizes. I conducted a study with general growth mixture modeling. With the multinomial logistic regressions applicable both to the covariates and the distal outcome, how would you approach this issue of effect size?
bmuthen posted on Thursday, November 13, 2003 - 8:36 am
I don't know that there are common, established effect size measures for binary outcomes such as distals, but here is how I would reason. Assuming that you have say a binary covariate that influences a binary distal outcome, you can consider the log odds change in the distal as a function of changing covariate status. See the 2002 Biostatistics paper by Muthen et al on the home page of Mplus.
Anonymous posted on Tuesday, September 20, 2005 - 12:06 pm
Suppose a Mixture Model generates k-classes for a continuous outcome. Then based on known statistics (e.g., -2*L, BIC, AIC, Entropy, and Lo-Mendell–Rubin Adjusted LRT Test) i decide that k-classes are acceptable. How can i estimate an effect size for the number of classes found. I found some artciles that suggest using 1-Wilks'lambda (Tatsuoka, 1988) and then use Cohen's (1988) approach. Then the effect size would [(1-WilksL full model)-(1-WilksL reduced)]/(1-WilksL full model). Is there any other way to estimate the effect size. Do you have any comments regarding this way of estimating effects sizes?
BMuthen posted on Wednesday, September 21, 2005 - 3:28 pm
I am not sure what you mean by effect size for the number of classes found. I am not familiar with the article you mention as it relates to mixture modeling. Are these articles related to k-means clustering.
I used KNOWNCLASS to specify three treatment groups. And found a two-class solution.
I estimated the difference (at months 6 and 12) in means between two treatment groups within the same class and used the delta method to calculate the std error of the difference.
I now need to report the difference in terms of an effect size. Hence I need the standard deviation of my outcome at months 6 and 12 within latent class. Is this value: Var(I) + t^2*Var(S) + 2t*Cov(I,S) + Residual Variance at month t? Where I and S are latent intercepts and slopes indexed by class.
I have a mixture model with complex survey data. I would like to determine the effect size for a mean difference across classes. Could you recommend a method to calculate the effect size for the mean difference in y? (see below). Thank you!
I am running a LCA with 2 classes and want to compare class differences on both binary and continuous distal outcomes. I've used the AUXILIARY option with the DCATEGORICAL and BCH options for these outcomes.
Are there specific effect size statistics that can be used to accompany the significance tests reported? Would it be similar to Cohen's d for t-tests and phi for chi-square tests?
I'd like to follow-up to Katherine Cotter's question. If the LCA has more than 2 classes, would one use the total sample SD or pooled SD for the two groups to be compared? Also, as the SDs are sample characteristics, should one rely on the sample mean differences as opposed to estimated mean differences?