Question 1

A test-retest coefficient can range in value from

Accepted Answer

A)  0 to 100 
B)  0 to 1.00 
C)  1 to 99 
D)  -1.00 to +1.00 
A)  0 to 100 
B)  0 to 1.00 
C)  1 to 99 
D)  -1.00 to +1.00 B

Question 2

All but one of the following techniques were mentioned as methods of reducing observer bias. Which is it?

Accepted Answer

A)  using scientific instruments 
B)  simplifying the observers' task 
C)  making observers blind 
D)  using multiple observers 
A)  using scientific instruments 
B)  simplifying the observers' task 
C)  making observers blind 
D)  using multiple observers D

Question 3

____ manipulations are most easily standardized whereas ___ manipulations are hardest to standardize.

Accepted Answer

A)  instructional; environmental 
B)  environmental; instructional 
C)  instructional; stooges 
D)  stooges; instructional 
A)  instructional; environmental 
B)  environmental; instructional 
C)  instructional; stooges 
D)  stooges; instructional C

Question 4

The extent to which a test measures anything consistently is its

Accepted Answer

A)  normality 
B)  objectivity 
C)  reliability 
D)  validity 
A)  normality 
B)  objectivity 
C)  reliability 
D)  validity

Question 5

If participants' scores on a social intelligence test are consistent from one time of testing to the next, the test is ________. If participants' scores on a social intelligence test are accurate indicators of their social intelligence, the test is ______

Accepted Answer

A)  reliable, valid 
B)  valid, reliable 
C)  reliable, reliable 
D)  valid, valid 
A)  reliable, valid 
B)  valid, reliable 
C)  reliable, reliable 
D)  valid, valid

Question 6

Which of the following would be the most effective strategy for reducing the Hawthorne effect:

Accepted Answer

A)  training observers to be unbiased 
B)  the use of placebos 
C)  standardization 
D)  the use of instruments 
A)  training observers to be unbiased 
B)  the use of placebos 
C)  standardization 
D)  the use of instruments

Question 7

Psychologists believe that manipulation checks

Accepted Answer

A)  should be used even when it seems obvious that the manipulation is manipulating what it should be manipulating 
B)  increase the reliability of a manipulation 
C)  are a good substitute for placebo treatments 
D)  do not need to be used if the manipulation is consistent with theory 
A)  should be used even when it seems obvious that the manipulation is manipulating what it should be manipulating 
B)  increase the reliability of a manipulation 
C)  are a good substitute for placebo treatments 
D)  do not need to be used if the manipulation is consistent with theory

Question 8

Introducing random error into a study

Accepted Answer

A)  reduces reliability 
B)  reduces validity 
C)  biases the results 
D)  both a and b 
A)  reduces reliability 
B)  reduces validity 
C)  biases the results 
D)  both a and b

Question 9

An unreliable measure cannot be a valid measure.

Accepted Answer

A) True 
 B)False

Question 10

If subject bias is your biggest concern, you would use:

Accepted Answer

A)  an instructional manipulation 
B)  an environmental manipulation 
C)  a stooge manipulation 
D)  a manipulation check 
A)  an instructional manipulation 
B)  an environmental manipulation 
C)  a stooge manipulation 
D)  a manipulation check

Question 11

The problem of observers seeing what they expect to see is called

Accepted Answer

A)  observer bias 
B)  random observer error 
C)  subject bias 
D)  demand characteristics 
A)  observer bias 
B)  random observer error 
C)  subject bias 
D)  demand characteristics

Question 12

Interobserver reliability coefficients are a good way to assess how much random error is affecting scores assigned by observers.

Accepted Answer

A) True 
 B)False

Question 13

If you establish that a measure of lust does not correlate highly with a measure of liking, you have taken a step toward establishing the measure's

Accepted Answer

A)  content validity 
B)  criterion validity 
C)  discriminant validity 
D)  internal consistency 
A)  content validity 
B)  criterion validity 
C)  discriminant validity 
D)  internal consistency

Question 14

Which of the following is an operational definition?

Accepted Answer

A)  hunger is 8 hours of food deprivation 
B)  attachment is the bond between an infant and its mother 
C)  learning is a relatively permanent change in behavior 
D)  anger is a negative emotional state 
A)  hunger is 8 hours of food deprivation 
B)  attachment is the bond between an infant and its mother 
C)  learning is a relatively permanent change in behavior 
D)  anger is a negative emotional state

Question 15

A major advantage that objective measures (e.g., multiple-choice) items generally have over subjectively scored measures is

Accepted Answer

A)  less vulnerability to observer biases 
B)  less vulnerability to subject biases 
C)  neither a nor b 
D)  both a and b 
A)  less vulnerability to observer biases 
B)  less vulnerability to subject biases 
C)  neither a nor b 
D)  both a and b

Question 16

If participants' scores on a new social intelligence test are correlate with their scores on an established test of social intelligence, the new test has ________ validity. If participants' scores on the new social intelligence test do not correlate with their scores on an extroversion test, the test has ______ validity.

Accepted Answer

A)  construct, internal 
B)  convergent, discriminant 
C)  discriminant, convergent 
D)  internal, construct 
A)  construct, internal 
B)  convergent, discriminant 
C)  discriminant, convergent 
D)  internal, construct

Question 17

_____ manipulations are most vulnerable to subject biases, whereas _____ manipulations are most vulnerable to experimenter biases.

Accepted Answer

A)  instructional; environmental 
B)  environmental; instructional 
C)  instructional; stooges 
D)  stooges; instructional 
A)  instructional; environmental 
B)  environmental; instructional 
C)  instructional; stooges 
D)  stooges; instructional

Question 18

Which reliability coefficient would you expect to be the highest?

Accepted Answer

A)  inter-observer reliability 
B)  median inter-item correlations 
C)  test-retest reliability 
D)  all of the above should be about the same 
A)  inter-observer reliability 
B)  median inter-item correlations 
C)  test-retest reliability 
D)  all of the above should be about the same

Question 19

Random error and bias are the same thing.

Accepted Answer

A) True 
 B)False

Question 20

Which technique is more effective for reducing observer bias than for reducing random observer error?

Accepted Answer

A)  using instruments 
B)  using multiple-choice tests 
C)  making raters blind 
D)  training raters 
A)  using instruments 
B)  using multiple-choice tests 
C)  making raters blind 
D)  training raters

A test-retest coefficient can range in value from

All but one of the following techniques were mentioned as methods of reducing observer bias. Which is it?

__ manipulations are most easily standardized whereas _ manipulations are hardest to standardize.

The extent to which a test measures anything consistently is its

If participants' scores on a social intelligence test are consistent from one time of testing to the next, the test is __. If participants' scores on a social intelligence test are accurate indicators of their social intelligence, the test is

Which of the following would be the most effective strategy for reducing the Hawthorne effect:

Psychologists believe that manipulation checks

Introducing random error into a study

An unreliable measure cannot be a valid measure.

If subject bias is your biggest concern, you would use:

The problem of observers seeing what they expect to see is called

Interobserver reliability coefficients are a good way to assess how much random error is affecting scores assigned by observers.

If you establish that a measure of lust does not correlate highly with a measure of liking, you have taken a step toward establishing the measure's

Which of the following is an operational definition?

A major advantage that objective measures (e.g., multiple-choice) items generally have over subjectively scored measures is

_ manipulations are most vulnerable to subject biases, whereas _ manipulations are most vulnerable to experimenter biases.

Which reliability coefficient would you expect to be the highest?

Random error and bias are the same thing.

Which technique is more effective for reducing observer bias than for reducing random observer error?

Psychology, Science, and You

Ethics and Validity

Generating Research Hypotheses

Reading and Evaluating Research

Choosing the Best Measure for Your Study

Introduction to Descriptive Methods

Survey Research

Internal Validity

The Simple Experiment

Expanding the Simple Experiment: The Multiple Group Experiment

Expanding the Simple Experiment: Factorial Designs

Within-Subjects Designs

Single-N Experiments and Quasi-Experiments

Writing Research Proposals and Reports

Appendix E: Using Theory to Generate Research Hypotheses

Filters

Exam 5: Measuring and Manipulating Variables: Reliability and Validity

A test-retest coefficient can range in value from

All but one of the following techniques were mentioned as methods of reducing observer bias. Which is it?

____ manipulations are most easily standardized whereas ___ manipulations are hardest to standardize.

The extent to which a test measures anything consistently is its

If participants' scores on a social intelligence test are consistent from one time of testing to the next, the test is ________. If participants' scores on a social intelligence test are accurate indicators of their social intelligence, the test is ______

Which of the following would be the most effective strategy for reducing the Hawthorne effect:

Psychologists believe that manipulation checks

Introducing random error into a study

An unreliable measure cannot be a valid measure.

If subject bias is your biggest concern, you would use:

The problem of observers seeing what they expect to see is called

Interobserver reliability coefficients are a good way to assess how much random error is affecting scores assigned by observers.

If you establish that a measure of lust does not correlate highly with a measure of liking, you have taken a step toward establishing the measure's

Which of the following is an operational definition?

A major advantage that objective measures (e.g., multiple-choice) items generally have over subjectively scored measures is

_____ manipulations are most vulnerable to subject biases, whereas _____ manipulations are most vulnerable to experimenter biases.

Which reliability coefficient would you expect to be the highest?

Random error and bias are the same thing.

Which technique is more effective for reducing observer bias than for reducing random observer error?

Psychology, Science, and You

Ethics and Validity

Generating Research Hypotheses

Reading and Evaluating Research

Choosing the Best Measure for Your Study

Introduction to Descriptive Methods

Survey Research

Internal Validity

The Simple Experiment

Expanding the Simple Experiment: The Multiple Group Experiment

Expanding the Simple Experiment: Factorial Designs

Within-Subjects Designs

Single-N Experiments and Quasi-Experiments

Writing Research Proposals and Reports

Appendix E: Using Theory to Generate Research Hypotheses

Filters

__ manipulations are most easily standardized whereas _ manipulations are hardest to standardize.

If participants' scores on a social intelligence test are consistent from one time of testing to the next, the test is __. If participants' scores on a social intelligence test are accurate indicators of their social intelligence, the test is

_ manipulations are most vulnerable to subject biases, whereas _ manipulations are most vulnerable to experimenter biases.