95% Bootstrap Confidence Interval
Message/Author
 Estee posted on Wednesday, October 16, 2013 - 6:22 am
Hi,

I tested a mediation model. The indirect effect was bootstrapped. The 95% confidence limit was [.000, .038]. According to literature, an indirect effect is considered sig. if the CI does not include/cross zero. Is the .000 showed in the results really equal to zero or it may be for example.0001 ? so, how to confirm whether the 95% confidence limit [.000, .038] is sig or not?

Thanks very much.
 Linda K. Muthen posted on Wednesday, October 16, 2013 - 3:57 pm
I would count that as non significant even if the value was .0001. With so many tests being performed, I would be conservative.
 Joao Garcez posted on Friday, March 13, 2015 - 10:27 am
Hi,

I was wondering something similar. I have a non-significant indirect effect (b = -.019, p>.05) with the following bc bootstrap 95% CI: ( -.047 - .002 ).

Is a value of .002 considered to be equal to zero?

Also, when values in the lower and upper bound have opposite signs like the one above, does it mean something? The path above is negative with a positive value in the CI. Does it mean is non-significant?

Thank you very much.
 Bengt O. Muthen posted on Friday, March 13, 2015 - 12:22 pm
If the CI covers zero, the coefficient is deemed insignificant. Your lower limit is negative and your upper limit positive, so your coefficient is non-significant.
 Joao Garcez posted on Tuesday, March 17, 2015 - 2:34 am
Thank you for the clarification.

Best,
JA
 Rosie Essery posted on Thursday, April 07, 2016 - 8:42 am
Hi there,

I too have a similar query - I have a non-significant indirect effect (B = 0.153, p = .104), but then the 95% BCa CI is [0.032 , 0.417].

I'm a but confused as to whether this is a significant mediation or not - the CI would suggest yes, but the p value no?

Would appreciate any advice - many thanks!

RE
 Linda K. Muthen posted on Thursday, April 07, 2016 - 8:52 am
If the confidence interval and p-value do not agree, you must not have a symmetric confidence interval.
 Rosie Essery posted on Thursday, April 07, 2016 - 9:26 am
Thank you for the very quick response!

I would agree that the confidence interval is asymmetric - looking at my data, the point estimate doesn't sit in the centre of the BCa confidence interval.

Does this mean that it is not meaningful to interpret this in the normal way, i.e. 0 not being between the lower and upper bounds of the confidence interval as a sign of significant mediation?

RE
 Bengt O. Muthen posted on Thursday, April 07, 2016 - 10:02 am
The non-symmetric CI is interpreted the same way: If 0 is not within the interval then the effect is significant.
 Kristin Hildenbrand posted on Thursday, May 25, 2017 - 2:02 am
Hello,

Related to the above: I run a single-level mediation model as specified below.The indirect effect (a1d1b2) based on z-test does not become sign (p = .112), but the 95% CI does not include 0 (.008-.394). If I run the respective process model in SPSS, the CI does also not include 0, showing significance. Bootstrapping is a more powerful test, but any idea how I should report these findings? My n is 146 and the CIs asymmetric.

Many thanks, Kristin

USEVARIABLES = WFBS Health ALQ FSSB sexI1 ageI1 child;
ANALYSIS:
TYPE = GENERAL;
ESTIMATOR = ML;
BOOTSTRAP = 5000;
MODEL:
Health ON FSSB (b1);
Health ON WFBS (b2);
Health ON ALQ (cdash); ! direct effect of X on Y
FSSB ON ALQ (a1);
WFBS ON ALQ (a2);
WFBS ON FSSB (d1);
Health on sexI1 ageI1 child;
MODEL CONSTRAINT:

NEW(a1b1 a2b2 a1d1b2 TOTALIND TOTAL);
a1b1 = a1*b1;
a2b2 = a2*b2;
a1d1b2 = a1*d1*b2;
TOTALIND = a1*b1 + a2*b2 + a1*d1*b2;
TOTAL = a1*b1 + a2*b2 + a1*d1*b2 + dash;
OUTPUT:
STAND CINT(bcbootstrap);
 Bengt O. Muthen posted on Thursday, May 25, 2017 - 6:36 pm
Perhaps you made a typo when you said (.008-.394) because this includes zero. In any case, a good approach is to use bootstrapping and the non-symmetric CI you get from that.
 Kristin Hildenbrand posted on Thursday, June 01, 2017 - 5:20 am
Thank you for this Bengt and sorry for the delay in responding. Yes, I meant (.008,.394) and just used the "-" to indicate the boundaries of the CI (I am aware that this is not normally done so, so sorry). Would you mind advising me on the best way to do bootstrapping in multi-level analysis as I think MPlus does not (yet) offer this feature and hint me towards a relevant paper/article etc. where I can read up on this? I heard various approaches but unsure which to pursue.
 Bengt O. Muthen posted on Thursday, June 01, 2017 - 6:54 pm
multilevel bootstrap is not available in Mplus. You can use twolevel Bayes and get the same kinds of non-symmetric CIs.
 Kristin Hildenbrand posted on Friday, June 02, 2017 - 2:57 am
Great, thanks!