Hi, Recently I read an article about an interesting approach for measurement of change in pretest-posttest design. It is called linear logostic model of change (LLMC) and according to the article it is an extension of a Rasch model to measure both individual and group changes on a logit scale (Dimitrov, D. M., McGee, S.M.& Howard, B.C. (2002) Changes in students' science ability produced by multimedia learning environments: Application of the linear logistic model for change. School Science and Mathematics, 102(1), pp. 15-23).
Is there an application within Mplus by which we can approach this model? Would you recommend any reading that might help me to understand LLMC and its application?
Looking at the article, it seems that is a Rasch model applied to two time points and two groups (tx/ctrl). This can be done in Mplus.
A Rasch model is specified for a set of binary outcomes by holding the factor loadings equal across the factor indicators and fixing the factor variance at 1 (the factor mean is zero). Analysis of two groups and two time points can be done in line with Topic 2 of our courses (longitudinal factor analysis), using a multiple-group approach (tx and ctrls) holding the thresholds and loadings equal across time and group and letting the factor mean and variance be free at the second time point. Ability change due to treatment can then be evaluated.
I am not aware of papers/readings that show the details, but perhaps you can contact the authors - I think the first author uses Mplus.
Note that it is not necessary to use a Rasch model, but a 2-parameter logistic or probit model is also possible.
I would like to analyze a two time point-two group data the way you are suggesting in the post above (Bengt O. Muthén posted on Sunday, March 14, 2010 - 6:08 pm).
The problem I have is that from pretest to posttest we changed the scale from a 0 to 2 scale to a 0 to 4 scale. Would you standardize the items prior to the analysis? Do you have any suggestions on how to deal with changed measurement scheme? Thank you, Anna-Mari
What does the numeric value of the discrimination parameter tell us in terms of the basic logistic model? Although I intuitively understand that it is analagous to a factor loading (slope) and is a measure of how well the item discriminates those low vs. high on the trait, I have seen differing remarks on its range (some saying 0 - 1 others 0 to + infinity).
For example, lets say alpha (discrimination) = 3.05. Does this then mean that for a 1-unit increase in the latent trait theta that the probability of the individual being coded as present for a binary behavior (or endorsing a binary item) increases by approximately 3x (i.e., 3x more likely)?
The discrimination coefficient is in the metric of the loading, is in the metric of a slope in a regular logistic regression, which is the same as the IRT model except the IV is latent. Therefore, the range is minus infinity to plus infinity. Your one-unit explanation is correct. Following the lead of logistic regression you can also exponentiate the discrimination and interpret in odds ratio terms. See logistic regression books and see IRT books such as Reckase's.
The 0-1 range may come from the classical test theory (not IRT) concept of item discrimination which was the correlation between an item and the total test score.
To correct my own example above, exponetiating a discrimination coefficient (logit) of 3.05 would give ~21.12; thus a 1-unit increase in theta would be associated with a 21x greater likelihood of endorsing the '1' option of the binary item.
A quick follow-up to the exponentiation approach to odds. Since there is no analog to odds coefficients in probit, is it necessary to transform back into a logit metric before exponentiating to get the odds? I ask as I have run models using both limited and full-information estimators.
Post 2: Transforming to logit from probit is only approximate - I wouldn't do the odds interpretation with probit (so not with WLSMV). Note also that the odds interpretation doesn't seem prevalent in the IRT literature.