Question 1

Smaller sample sizes tend to __________ confidence intervals, whereas larger sample sizes tend to __________ confidence intervals.

Accepted Answer

A)  have no effect on; shrink 
B)  widen; have no effect on 
C)  shrink; widen 
D)  widen; shrink 
A)  have no effect on; shrink 
B)  widen; have no effect on 
C)  shrink; widen 
D)  widen; shrink D

Question 2

Stacy purchases a new product that claims it will help her sleep better at night. However, after using it, Stacy discovers that it has no effect on her sleeping habits. Which of the following statements would best characterize Stacy's decision to buy the product?

Accepted Answer

A)  She made a Type I error. 
B)  She made a Type II error. 
C)  She made a statistical significance error. 
D)  She made the correct decision. 
A)  She made a Type I error. 
B)  She made a Type II error. 
C)  She made a statistical significance error. 
D)  She made the correct decision. A

Question 3

Through statistical power analysis, one can estimate the __________ needed to adequately test a hypothesis.

Accepted Answer

A)  number of participants 
B)  effect size 
C)  significance test 
D)  p value 
A)  number of participants 
B)  effect size 
C)  significance test 
D)  p value A

Question 4

Statistically speaking, the experimental hypothesis is generally referred to as the __________ hypothesis.

Accepted Answer

A)  effective 
B)  null 
C)  working 
D)  alternative 
A)  effective 
B)  null 
C)  working 
D)  alternative

Question 5

Type I error is to __________ as Type II error is to __________.

Accepted Answer

A)  blindness; gullibility 
B)  significance; practicality 
C)  statistical power; effect size 
D)  gullibility; blindness 
A)  blindness; gullibility 
B)  significance; practicality 
C)  statistical power; effect size 
D)  gullibility; blindness

Question 6

The "error of blindness" describes which hypothesis decision outcome?

Accepted Answer

A)  Rejecting the null hypothesis when the null hypothesis should not be rejected. 
B)  Failing to reject the null hypothesis when the null hypothesis should not be rejected. 
C)  Rejecting the null hypothesis when the null hypothesis should be rejected. 
D)  Failing to reject the null hypothesis when the null hypothesis should be rejected. 
A)  Rejecting the null hypothesis when the null hypothesis should not be rejected. 
B)  Failing to reject the null hypothesis when the null hypothesis should not be rejected. 
C)  Rejecting the null hypothesis when the null hypothesis should be rejected. 
D)  Failing to reject the null hypothesis when the null hypothesis should be rejected.

Question 7

The p value is not sufficient for indicating the importance of the outcome of a study. The reason for this is because

Accepted Answer

A)  p values are too small. 
B)  the size of the study affects the p value. 
C)  the magnitude of the test statistic must also be known. 
D)  effect sizes are related to p values. 
A)  p values are too small. 
B)  the size of the study affects the p value. 
C)  the magnitude of the test statistic must also be known. 
D)  effect sizes are related to p values.

Question 8

What is the difference between Type I and Type II errors? Which error do scientists seem to be more concerned with? Why?

Accepted Answer

Type I and Type II errors are both relat

Question 9

What is meant by the power of a statistical significance test?

Accepted Answer

The power of a statistical significance

Question 10

The power of a statistical test is determined by all of the following factors EXCEPT

Accepted Answer

A)  the p value associated with the statistical test. 
B)  the internal validity of the study. 
C)  the sample size used in the study. 
D)  the effect size associated with the statistical test. 
A)  the p value associated with the statistical test. 
B)  the internal validity of the study. 
C)  the sample size used in the study. 
D)  the effect size associated with the statistical test.

Question 11

Accepting the null hypothesis when it should have been rejected is an example of

Accepted Answer

A)  a Type I error. 
B)  alpha. 
C)  statistical power. 
D)  a Type II error. 
A)  a Type I error. 
B)  alpha. 
C)  statistical power. 
D)  a Type II error.

Question 12

How is null hypothesis significance testing (NHST) sometimes misunderstood or misused?

Accepted Answer

Null hypothesis significance testing (NH

Question 13

What role does probability have in significance testing?

Accepted Answer

Probability plays a central role in sign

Question 14

Killeen's prep indicates the probability of replicating the same ___________ of effect of the original study, given the same N and procedures used.

Accepted Answer

A)  size 
B)  outcome 
C)  direction 
D)  power 
A)  size 
B)  outcome 
C)  direction 
D)  power

Question 15

One problem with NHST is that it can be misconstrued as an indicator of

Accepted Answer

A)  statistical significance. 
B)  practical importance. 
C)  theoretical significance. 
D)  statistical differences. 
A)  statistical significance. 
B)  practical importance. 
C)  theoretical significance. 
D)  statistical differences.

Question 16

Which of the following examples for reporting p values reflects the recommendations of many statisticians?

Accepted Answer

A)  p ≤ .05 
B)  p < .05 
C)  .01 < p < .05 
D)  p = .032 
A)  p ≤ .05 
B)  p < .05 
C)  .01 < p < .05 
D)  p = .032

Question 17

Based on her results, Kathy is unable to reject the null hypothesis, but she does feel that the effect size looks promising. What should Kathy do next?

Accepted Answer

A)  recalculate the effect size 
B)  use a less stringent alpha level 
C)  do a statistical power analysis 
D)  reevaluate her hypothesis 
A)  recalculate the effect size 
B)  use a less stringent alpha level 
C)  do a statistical power analysis 
D)  reevaluate her hypothesis

Question 18

The strength of the relationship between X and Y may be operationally defined as

Accepted Answer

A)  the p value. 
B)  power of the study. 
C)  the effect size. 
D)  alpha. 
A)  the p value. 
B)  power of the study. 
C)  the effect size. 
D)  alpha.

Question 19

Power is the probability of not making a(n)

Accepted Answer

A)  Type I error. 
B)  Type II error. 
C)  statistical error. 
D)  experimental error. 
A)  Type I error. 
B)  Type II error. 
C)  statistical error. 
D)  experimental error.

Question 20

Tamara wants to know how many subjects she should use in her study. To answer this question, Tamara should

Accepted Answer

A)  calculate the study's effect size. 
B)  use null hypothesis significance testing. 
C)  conduct a power analysis. 
D)  construct a BESD. 
A)  calculate the study's effect size. 
B)  use null hypothesis significance testing. 
C)  conduct a power analysis. 
D)  construct a BESD.

Smaller sample sizes tend to confidence intervals, whereas larger sample sizes tend to confidence intervals.

Stacy purchases a new product that claims it will help her sleep better at night. However, after using it, Stacy discovers that it has no effect on her sleeping habits. Which of the following statements would best characterize Stacy's decision to buy the product?

Through statistical power analysis, one can estimate the __________ needed to adequately test a hypothesis.

Statistically speaking, the experimental hypothesis is generally referred to as the __________ hypothesis.

Type I error is to as Type II error is to .

The "error of blindness" describes which hypothesis decision outcome?

The p value is not sufficient for indicating the importance of the outcome of a study. The reason for this is because

What is the difference between Type I and Type II errors? Which error do scientists seem to be more concerned with? Why?

What is meant by the power of a statistical significance test?

The power of a statistical test is determined by all of the following factors EXCEPT

Accepting the null hypothesis when it should have been rejected is an example of

How is null hypothesis significance testing (NHST) sometimes misunderstood or misused?

What role does probability have in significance testing?

Killeen's p_rep indicates the probability of replicating the same ___________ of effect of the original study, given the same N and procedures used.

One problem with NHST is that it can be misconstrued as an indicator of

Which of the following examples for reporting p values reflects the recommendations of many statisticians?

Based on her results, Kathy is unable to reject the null hypothesis, but she does feel that the effect size looks promising. What should Kathy do next?

The strength of the relationship between X and Y may be operationally defined as

Power is the probability of not making a(n)

Tamara wants to know how many subjects she should use in her study. To answer this question, Tamara should

Behavioral Research and the Scientific Method

From Hunches to Testable Hypotheses

Ethical Considerations and Guidelines

Carpenter, S 1998 Content Analysis Project for Research Novices Teaching of Psychology

Methods for Looking Within Ourselves

Reliability and Validity in Measurement and Research

Randomized Experiments and Causal Inference

Nonrandomized Research and Causal Reasoning

Survey Research and Subject Recruitment

Summarizing the Data

Correlating Variables

The Comparison of Two Conditions

Comparisons of More Than Two Conditions

The Analysis of Frequency Tables

Filters

Exam 12: Understanding P Values and Effect Size Indicators

Smaller sample sizes tend to __________ confidence intervals, whereas larger sample sizes tend to __________ confidence intervals.

Stacy purchases a new product that claims it will help her sleep better at night. However, after using it, Stacy discovers that it has no effect on her sleeping habits. Which of the following statements would best characterize Stacy's decision to buy the product?

Through statistical power analysis, one can estimate the __________ needed to adequately test a hypothesis.

Statistically speaking, the experimental hypothesis is generally referred to as the __________ hypothesis.

Type I error is to __________ as Type II error is to __________.

The "error of blindness" describes which hypothesis decision outcome?

The p value is not sufficient for indicating the importance of the outcome of a study. The reason for this is because

What is the difference between Type I and Type II errors? Which error do scientists seem to be more concerned with? Why?

What is meant by the power of a statistical significance test?

The power of a statistical test is determined by all of the following factors EXCEPT

Accepting the null hypothesis when it should have been rejected is an example of

How is null hypothesis significance testing (NHST) sometimes misunderstood or misused?

What role does probability have in significance testing?

Killeen's prep indicates the probability of replicating the same ___________ of effect of the original study, given the same N and procedures used.

One problem with NHST is that it can be misconstrued as an indicator of

Which of the following examples for reporting p values reflects the recommendations of many statisticians?

Based on her results, Kathy is unable to reject the null hypothesis, but she does feel that the effect size looks promising. What should Kathy do next?

The strength of the relationship between X and Y may be operationally defined as

Power is the probability of not making a(n)

Tamara wants to know how many subjects she should use in her study. To answer this question, Tamara should

Behavioral Research and the Scientific Method

From Hunches to Testable Hypotheses

Ethical Considerations and Guidelines

Carpenter, S 1998 Content Analysis Project for Research Novices Teaching of Psychology

Methods for Looking Within Ourselves

Reliability and Validity in Measurement and Research

Randomized Experiments and Causal Inference

Nonrandomized Research and Causal Reasoning

Survey Research and Subject Recruitment

Summarizing the Data

Correlating Variables

The Comparison of Two Conditions

Comparisons of More Than Two Conditions

The Analysis of Frequency Tables

Filters

Smaller sample sizes tend to confidence intervals, whereas larger sample sizes tend to confidence intervals.

Type I error is to as Type II error is to .

Killeen's p_rep indicates the probability of replicating the same ___________ of effect of the original study, given the same N and procedures used.