Qi posted on Wednesday, October 08, 2008 - 4:06 pm
I want to use MacKinnon & Lockwood (2001) proposed asymmetric distribution of products method to test the significance of the mediation effect, do I just specify "bootstrap=1000;" under analysis, and then specify "CINTERVAL (BCBOOTSTRAP);" in output? There are several options for CINTERVAL, I am not sure about which one I should use, BOOTSTRAP or BCbootstrap? I shouldn't use the default symmetric, should I? And when interpreting the output, I just check whether 0 is in the 95% CI in " CONFIDENCE INTERVALS OF STANDARDIZED TOTAL, TOTAL INDIRECT, SPECIFIC INDIRECT, AND DIRECT EFFECTS for STDYX Standardization", right? Thanks for your guidance!
BCBOOTSTRAP is what MacKinnon and Lockwood do. This does not require the BOOTSTRAP option unless you want to use bootstrapped standard errors with the bootstrapped confidence interval.
Qi posted on Wednesday, October 08, 2008 - 8:01 pm
thanks for your prompt reply. Did you mean that I don't need to specify "bootstrap=1000" under analysis? I tried with only "CINTERVAL (BCBOOTSTRAP)" in the output command, however, I got the following warning and didn't get any CI for indirect effect, am I missing sth? Thanks again!
*** WARNING in OUTPUT command BOOTSTRAP and BCBOOTSTRAP confidence intervals require the specification of BOOTSTRAP in the ANALYSIS command. Request for CINTERVAL is ignored.
Qi posted on Wednesday, October 08, 2008 - 8:09 pm
I am sorry, I guess misunderstood your previous instruction. I think you were talking about the difference between CI(BCBOOTSTRAP) and CI(BOOTSTRAP).
What's the difference between CI(BCBOOTSTRAP) and CI(BOOTSTRAP)? Is CI(BCBOOTSRRAP) not using bootstrapped SE with bootstrapped CI? What's the purpose of each option? Thanks!
You are correct. You do need the BOOTSTRAP option of the ANALYSIS command for both CINTERVAL (BOOTSTRAP) and CINTERVAL (BCBOOTSTRAP). Both of these options are described in the MacKinnon and Lockwood paper. CINTERVAL (BOOTSTRAP) uses 2.5% and 97.5% percentiles of the sample distribution while CINTERVAL (BCBOOTSTRAP) these percentiles values are estimated from the sample distribution. The bias-corrected confidence intervals are more accurate.
Brianna H posted on Sunday, August 18, 2013 - 4:39 pm
The Mplus v.6 manual on p.647 indicates that "with frequentist estimation, only SYMMETRIC confidence intervals are available for standardized parameter estimates." I am using BCBOOTSTRAP to obtain bias-correct bootstrap confidence intervals. Does this mean I have to use the unstandardized output? I.e. I cannot use the confidence intervals of standardized indirect effects, if those are available only for SYMMTERIC?
Also, in the CINTERVAL output, the fourth column labeled Estimate contains the parameter estimates. If the standardized estimate of an indirect effect is 0.255, is it correct to say that 25.5% of the variance in DV is explained by the indirect effect of the IV on the DV? Thank you.
Hello, I'm trying to calculate indirect effects in my model. There are two mediators (m1-m2), linking independent variables(IV, x1-x4) and dependent variables (DV, y1-y2). My model is specified as below. Since the dependent variables are nested within a group, I used multi-level modeling to allow for the group-level random effect.
Q1. It says that bootstrapping is not allowed for multi-level modeling. How should I test indirect effects? can i just skip bootstrapping? (Mplus tested indirect effects although i didn't type bootstrapping)
Q2. I want to test main effects from IV to DV in this model. The thing is that from IV to DV, there are direct paths, as well as indirect paths. Can I sum both direct paths and indirect paths and test total effects (not just sum of two indirect paths)?
Thank you very much!
data: file is data.txt; variable: names are lid y1-y2 x1-x4 m1-m2; cluster is lid; within= x1-x4 m1-m2; analysis: type=twolevel; model: %within% m1 on x1-x4; m2 on x1-x4; y1 on m1-m2; y2 on m1-m2; y1 on x1-x4; y2 on x1-x4; model indirect: y1 ind m1 x1; y2 ind m2 x2;
I also tried another model drawing on the Mplus syntax for testing indirect effects in a multi-level model as recommended by Preacher, Zyphur, Zhang (2010) & Preacher, Zhang, Zyphur (2011),
data: file is data.txt; variable: names are lid y1-y2 x1-x4 m1-m2 c1-c5; usevariables are lid y1 x1 m1; cluster is lid; within= x1 m1; analysis: type=twolevel; model: %within% m1 on x1(a); y1 on m1(b); model constraint: new(indm); indm=a*b; output: tech1 tech8 cinterval;
Q1. Do you think this modeling is correct?
Q2. in the model results, there is New/Additional Parameters INDM Estimate S.E. Est./S.E. P-value 0.055 0.022 2.457 0.014
can i refer to estimate and p-value to judge significance of indirect effect? (I can't understand which part of tech1 and tech8 output I should look for...)
Please don't post in more than one window - this is our rule.
Answers to your first message:
Q1 Indirect effect estimation and testing can be done without doing bootstrapping. In my experience it is the exception rather than the rule that you need bootstrapping - you may need it with very small samples or when considering ratio estimates.
Answers to your second message:
Q1. Yes and this should give the same results as in your Model Indirect run.
Q2. Yes, the p-value says that INDM is significant on the 5% level. You don't need to look at tech1 or tech8. You may want to listen to our Topic 1 teachings on mediational modeling.
regarding bootstraping in MLM with Mplus: One question above was: "It says that bootstrapping is not allowed for multi-level modeling. How should I test indirect effects? can i just skip bootstrapping? (Mplus tested indirect effects although i didn't type bootstrapping)".
I wonder why it is not allowed? I could find any reasons... And if you have any literatur recomendation where I can read about the topic Mediation in MLM and bootstrap? Thank you very much, Julia
I am running a multilevel mediational path analysis and have 1 IV (dichotomous), 2 mediators (ordinal), 2 DVs (continuous). I am using the REPSE=Bootstrap to obtain the bootstrapped confidence intervals for the mediated effect because CINTERVAL (BOOTSTRAP) is not available for TYPE=COMPLEX. However, when I use REPSE=Bootstrap I do not get fit statistics and I also notice that the regression coefficients change a bit from when bootstrap is not included in the syntax. Therefore, it appears that the bootstrapping is applied to the whole model. I would just like to use the bootstrapped confidence intervals to indicate the significance of the mediated effect. Do you suggest running the model without bootstrap in the syntax to obtain fit statistics and path coefficients for the model and then running the model again with bootstrap in the syntax to test the significance of the mediated effect? OR do you recommend choosing between obtaining fit statistics or bootstrap confidence intervals and using the results from one analysis only. I very much appreciate any advice you have for me!
i calculated a simple mediation with Bootstrap. The estimate of total indirect effect is .095 p=.112, but the confidence interval lower 2.5% is .006 and upper 2.5% is .233. How does this fit? I cannot decide whether there exist a mediation!
Could you send the output to Support so we can see exactly what you refer to. And the license number.
DavidBoyda posted on Monday, January 23, 2017 - 12:04 pm
yes no problem.
Skyler Hawk posted on Friday, February 17, 2017 - 12:31 am
Hello, Is there a resource I can use to determine the number of bootstrapped resamples I should be using to test my indirect effects? I'm examining two simultaneous mediators. The choice of how many resamples seems to be rather arbitrary, I haven't been able to find clear guidelines. Thanks for your advice!
I am testing a multilevel mediation (2-2-1) in a 3-level model:
%within% Y; Y ON wave;
%BETWEEN id% Y; M ON X(a); Y ON X(c); Y ON M(b);
%BETWEEN class% Y;
MODEL CONSTRAINT: new (direct, indirect, total); indirect = a*b; direct = c; total = c+a*b;
Should I compare this model fit with a model where the path A "M ON X" is constrained to zero to show a relative model fit improvement in terms if -2LL (deviance)? Or with a model where path A is not specified at all?