Deck 9: Significantly Significant: What It Means for You and Me

Question 1

Probably no concept in the beginning statistics causes students more confusion than ______.

A)probability
B)significance
C)meaningfulness
D)statistics

Answer 1

B

Question 2

What is the error that cannot be controlled called?

A)Type I error
B)chance
C)Type II error
D)probability

Answer 2

B

Question 3

The _______ is tested, and the results are generalized to the _______.

A)sample; larger population
B)sample; smaller population
C)population; smaller sample
D)population; larger sample

Answer 3

A

Question 4

Which of the following is a statement of equality?

A)research hypothesis
B)directional hypothesis
C)nondirectional hypothesis
D)null hypothesis

Question 5

Which of the following occurs when you accept the null hypothesis when it is really false?

A)Type I error
B)correct decision
C)Type II error
D)power

Question 6

There is always the possibility of error in statistics because the _______ is not directly tested.

A)population
B)sample
C)significance
D)probability

Question 7

Which of the following occurs when you reject the null hypothesis when it is really true?

A)Type I error
B)correct decision
C)Type II error
D)power

Question 8

The degree of risk you are willing to take that you will reject the null hypothesis when it is actually true is called _______.

A)significance level
B)a Type II error
C)a Type II error
D)power

Question 9

What is the definition of the degree of risk you are willing to take that you will reject a null hypothesis when it is actually true?

A)Type I error
B)chance
C)Type II error
D)statistical significance

Question 10

Which of the following occurs when you accept the null hypothesis when it is really true?

A)Type I error
B)correct decision
C)Type II error
D)power

Question 11

The most commonly used significance level people are willing to take in testing the null hypothesis is _______.

A).00
B).10
C).50
D).05

Question 12

If you conclude that your findings yield a 1 in 100 chance that differences were not due to the hypothesized reason, what is the corresponding p value?

A).01
B).05
C).10
D).20

Question 13

When you accept the null hypothesis when the null hypothesis is really false, you are making a ______.

A)Type I error
B)Type II error
C)Type III error
D)Power

Question 14

A Type II error is related to a factor such as _______.

A)a Type III error
B)a Type I error
C)sample size
D)significance

Question 15

If you conclude that your findings yield a 1 in 20 chance that differences were not due to the hypothesized reason, what is the corresponding p value?

A).01
B).05
C).10
D).20

Question 16

Which of the following is the term associated with identifying differences between groups that are not due to chance?

A)probability
B)meaningfulness
C)significance
D)statistics

Question 17

If you conclude that your findings yield a 50 in 1,000 chance that differences were not due to the hypothesized reason, what is the corresponding p value?

A).01
B).05
C).10
D).20

Question 18

Inferential statistics is based on the idea that the ______.

A)sample is the same as population
B)sample is different from population
C)population is smaller than sample
D)sample is representative of the population

Question 19

When you reject the null hypothesis when there is actually no difference between groups or relationships between variables, you are making a _______.

A)Type I error
B)Type II error
C)Type III error
D)error in power

Question 20

The level of chance or risk that you were willing to take is expressed as _______.

A)a significance level
B)power
C)1 − power
D)1 + power

Question 21

The final step in hypothesis testing is to ______.

A)provide a statement of the null hypothesis
B)compute the test statistic value
C)determine the critical value
D)compare the obtained value with the critical value and make a final determination

Question 22

What Greek letter is associated with Type II error?

A)?
B)?
C)?
D) $$\Psi$$

Question 23

A smaller confidence interval would result in ______.

A)a wider range of values in the confidence interval
B)a smaller range of values in the confidence interval
C)the same range of values in the confidence interval
D)a range of values that cannot be determined in the confidence interval

Question 24

If you want to examine the difference between the average scores for students on a pretest/posttest measure, which statistical technique should you select?

A)regression
B)dependent-samples t-test
C)analysis of variance
D)independent-samples t-test

Question 25

The first step in testing a hypothesis is to ______.

A)set the level of risk associated with the null hypothesis
B)provide a statement of the null hypothesis
C)select the appropriate test statistic
D)compute the test statistic value

Question 26

When reporting statistical significance, how is this usually represented?

A)p = .05
B)p > .05
C)p < .05
D)p = .01

Question 27

What Greek letter is associated with Type I error?

A)?
B)?
C)?
D) $$\Psi$$

Question 28

The test statistic value calculated by the statistical procedure selected is known as the _______.

A)critical value
B)significance level
C)obtained value
D)p value

Question 29

If you want to examine the difference between the average scores of two unrelated groups, which of the following statistical techniques should you select?

A)regression
B)dependent-samples t-test
C)analysis of variance
D)independent-samples t-test

Question 30

If the obtained value is greater than the critical value, what should you do?

A)reject the null hypothesis
B)accept the null hypothesis
C)set a high p value
D)increase your sample

Question 31

The statistical value that is compared with the calculated value is called the _______.

A)obtained value
B)test statistic
C)critical value
D)comparison value

Question 32

After you select the appropriate test statistic, you ______.

A)provide a statement of the null hypothesis
B)set the level of significance
C)compute the test statistic value
D)determine the critical value needed for rejection of the null hypothesis

Question 33

Which of the following occurs when you reject the null hypothesis when it is really false?

A)Type I error
B)correct decision
C)Type II error
D)power

Question 34

After you provide a statement of the null hypothesis, you ______.

A)select the appropriate test statistic
B)compute the test statistic value
C)set the significance level
D)compare the obtained value with the critical value

Question 35

Power is equal to ______.

A)the value of the Type II error subtracted from 1
B)the value of the Type I error subtracted from 1
C)one subtracted from the value of the Type II error
D)one subtracted from the value of the Type I error

Question 36

In order to determine whether or not you will reject the null hypothesis, the test statistic value must be compared against the _______.

A)critical value
B)significance level
C)obtained value
D)p value

Question 37

If you want to examine the difference between the average scores of three unrelated groups, which of the following statistical techniques should you select?

A)regression
B)dependent samples t-test
C)analysis of variance
D)independent samples t-test

Question 38

After you compare the obtained value with the critical value, you ______.

A)provide a statement of the null hypothesis
B)set the level of significance
C)compute the test statistic value
D)reject the null hypothesis if the obtained value is more extreme than the critical value

Question 39

As compared with a 95% confidence interval, a 99% confidence interval would result in ______.

A)a wider range of values in the confidence interval
B)a smaller range of values in the confidence interval
C)the same range of values in the confidence interval
D)a range that cannot be determined in the confidence interval

Question 40

What does 1 − ẞ represent?

A)alpha level
B)Type I error
C)Type II error
D)power

Question 41

Under the normal curve, if the obtained value falls to the left of the critical value, what percentage of the normal curve did it fall under?

A)5%
B)10%
C)95%
D)100%

Question 42

Some statistical tests allow you to make a conclusion that there is a real effect with 100% certainty.

Question 43

What happens when a null hypothesis has been rejected and the null hypothesis is True?

A)a Type II error
B)power
C)a null error
D)a Type I error

Question 44

A(n) _______ difference is due to some systematic influence and not due to chance.

A)significant
B)insignificant
C)null
D)serendipitous

Question 45

When we say p < .05, it suggests that there is less than 5 chance in ______ that any differences found were not due to the hypothesized reason.

A)5
B)20
C)25
D)100

Question 46

p < .05 means that there is less than 1 chance in _______ that any differences found were not due to the hypothesized reason.

A)5
B)20
C)25
D)100

Question 47

If we reject the null hypothesis, it suggests that ______.

A)The obtained value is more extreme than the critical value.
B)The obtained value is smaller than the critical value.
C)The obtained value is the same as the critical value.
D)There is a difference between the obtained value and the critical value.

Question 48

The risk set by the researcher for rejecting a null hypothesis when it is true is called the _______.

A)experimental error
B)error significance
C)significance level
D)error level

Question 49

What happens when a null hypothesis has been accepted and the null hypothesis is really false?

A)a Type II error
B)power
C)a null error
D)a Type I error

Question 50

If a researcher sets the decision rule p value at .05, what is the probability of making a Type I error?

A)1%
B)5%
C)10%
D)20%

Question 51

When we test differences between the mean scores of more than two unconnected groups, which of the following statistical techniques should we select?

A)analysis of variance
B)dependent samples t-test
C)regression
D)independent samples t-test

Question 52

How well a statistical test can detect and reject a null hypothesis when it is false refers to _______.

A)Force
B)Power
C)Strength
D)Fortitude

Question 53

When we test differences between the mean scores of two unconnected groups, which of the following statistical techniques should we select?

A)regression
B)analysis of variance
C)independent-samples t-test
D)dependent-samples t-test

Question 54

How many general steps are there in applying a statistical test to any null hypothesis.

A)5
B)6
C)7
D)8

Question 55

Under the normal curve, if the obtained value falls to the right of the critical value, what percentage of the normal curve does it fall under?

A)5%
B)10%
C)95%
D)100%

Question 56

Statistical significance is also known as the risk of _______.

A)a Type II error
B)power
C)a null error
D)a Type I error

Question 57

The statistical value that is compared with the critical value is called the ______.

A)obtained value
B)test statistic
C)critical value
D)comparison value

Question 58

If the obtained value is less than the critical value, what should you do?

A)reject the null hypothesis
B)accept the null hypothesis
C)set a high p value
D)increase your sample

Question 59

Which of the following techniques is used to generalize findings from your sample to the population?

A)descriptive statistics
B)nonparametric statistics
C)inferential statistics
D)qualitative analysis

Question 60

When making a judgment in statistics, there is always some possibility of error.

Question 61

When conducting a study, researchers should try as much as possible to reduce the likelihood of error by removing all competing reasons for any differences or relationships.

Question 62

Why can you not be 100% sure that the difference between two groups is not due to chance?

Question 63

Descriptive statistics uses a wide variety of statistical tests and analyses in order to test differences between groups or relationships between variables.

Question 64

Define significance level.

Question 65

Why do we use inferential statistics?

Question 66

What is the difference between Type I error and Type II error?

Question 67

A confidence interval is the best estimate of the range of a population value given the sample value.

Question 68

Define power (with regard to hypothesis testing).

Question 69

Why does the researcher never really know the true nature of the null hypothesis?

Question 70

It is possible to have a statistically significant result that is not meaningful.

Question 71

Power is equal to 1 − β.

Question 72

Can something be significant and not meaningful?

Question 73

Imagine the table that illustrates the relationship between the nature of the null hypothesis and your action as a researcher (which includes potential Type I and Type II errors), and apply the four possible outcomes to situations of mandated drug testing in elite athletics.
One: Describe the statistical equivalent to when a famous baseball player's blood test was negative for performance-enhancing drugs when there truly were no performance-enhancing drugs present in his blood.
Two: Describe the statistical equivalent to when a world-class sprinter's blood test was positive for performance-enhancing drugs when there truly were no performance-enhancing drugs present in her blood.
Three: Describe the statistical equivalent to when a famous baseball player's blood test was negative for performance-enhancing drugs when there truly were performance-enhancing drugs present in his blood.
Four: Describe the statistical equivalent to when a world-class sprinter's blood test was positive for performance-enhancing drugs when there truly were performance-enhancing drugs present in her blood.

Question 74

Inferential statistics is defined as "a set of tools that are used to infer the results based on the sample to a population."

Question 75

Why wouldn't a researcher set the confidence level at .0001, since it's better than .05 and even better than .01?

Question 76

When conducting a study, it is possible to control for every possible factor.

Question 77

How would a researcher determine when statistical significance is important?

Question 78

The critical value is the value that results from the use of a statistical test.