Yadong Ji posted on Thursday, September 06, 2018 - 12:55 pm
In the same sample, I measured a same construct by two instruments that were both published before. These two instruments, 12-item and 15-item, were both reported reliable. I ran EFA for both and the results showed that both instruments were one-factor structure.
My interest, for this particular study, is to decide which instrument is better. Other than the model indices, one of the reviewer wanted to see whether these two measurements were different. S/he appealed to know "whether there is a mean difference of the two measures using latent scores". Is there a way to do such test, as this is a cross-sectional one group data?
It can't really be done precisely unless some items in the two sets are the same.
All you can do is perhaps to analyze all 27 items together and see how high the factor correlation(s) is (are). If they are very high you can argue that they measure similar constructs. In analyses separately for the 2 items sets, you can then see which factor determinacy's is the highest.
Yadong Ji posted on Thursday, September 06, 2018 - 4:35 pm
Thank you so much! I really appreciate your reply!