Deck 29: Limitations of Significance Testing

Question 1

Just because a difference is statistically significant does not mean that it is a large difference.

Answer 1

True

Question 2

Which of the following is not included in the three-step process of evaluating a difference?

A) Evaluate if a statistically significant difference has practical significance
B) Use a significance to test to determine if a difference is statistically significant
C) If there is no significance, one should not assert that the experimental treatment is superior to the control condition and assess for possible practical implications
D) Assume that statistically significant difference always has practical significance

Answer 2

D

Question 3

the fundamental limitations of significance testing are: (1) It fails to indicate the size of a difference, and (2) it does not assess the practical significance of a difference.

Answer 3

True

Question 4

all statistically significant differences are inherently large and therefore of practical importance.

Question 5

Which of the following is NOT true?

A) Small difference can be statistically significant
B) Large difference is always practically significant
C) Large difference can be practically significant
D) Small difference can be practically significant