Deck 5: Introduction to Measurement

Question 1

In what level of measurement is there a meaningful absolute zero?​

A)nominal
B)ordinal
C)interval
D)ratio

Answer 1

D

Question 2

With true score theory,____ error is considered to contribute to test scores.

A)random​
B)systematic
C)environmental​
D)consistent

Answer 2

A

Question 3

Donna's study of time management includes having participants record the amount of time spent studying each day.This is best described as a(n)____ scale.

A)nominal
B)ordinal
C)interval
D)ratio

Answer 3

D

Question 4

Leslie is studying test anxiety and administers a test to his research participants that asks them to rate their anxiety in various situations on a scale of 0 (no anxiety)to 10 (the worst anxiety imaginable).He then uses the scores to divide his participants into high,medium,and low anxiety groups.Leslie's "high-medium-low" scale is best described as an example of a(n)____ scale.

A)nominal
B)ordinal
C)interval
D)ratio

Question 5

The formula X = T + E best describes ____.

A)item response theory
B)true score theory
C)the Rasch model
D)generalizability theory

Question 6

Cronbach's Alpha is mathematically equivalent to the average of all possible split-half correlations.

Question 7

In what level of measurement can the attributes be ranked?​

A)nominal
B)ordinal
C)interval
D)ratio

Question 8

Levels of measurement are important because they determine what type of analysis can be used.

Question 9

When an individual participating in a study tries to guess what the experimenter's hypothesis is,there is a social threat to construct validity.

Question 10

In True Score Theory,the observed score = true ability + random error.

Question 11

One of the measures Rosalyn is including in her study of the effects of environmental enrichment is the score on a standardized scale of intelligence.This is best described as a(n)____ scale.

A)nominal
B)ordinal
C)interval
D)ratio

Question 12

Random error is also called noise.

Question 13

Nominal scales are the weakest form of measurement.

Question 14

In what level of measurement are the attributes simply names?​

A)nominal
B)ordinal
C)interval
D)ratio

Question 15

Jamie has people in her study of taste perception self-identify as "foodies" (people with an intense interest in food who enjoy the adventure of trying new foods)or "non-foodies." This is best described as an example of a(n)____ scale.

A)nominal
B)ordinal
C)interval
D)ratio

Question 16

Random error can drastically affect the average performance for a group.

Question 17

When you know that a measure is nominal,you know that the numerical values are simply placeholders for the text names.

Question 18

As long as your test is reliable,it need not be valid.

Question 19

In what level of measurement is the distance from one attribute to another meaningful?​

A)nominal
B)ordinal
C)interval
D)ratio

Question 20

Ordinal scales have absolute zeroes.

Question 21

When there is no error in measurement,reliability is ____.

A)0
B)1
C)equal to the variability of the distribution
D)equal to the inverse of the variability of the distribution

Question 22

Figure 5.13

In the formula illustrated in the accompanying figure,sd stands for ____.

A)standard deviation
B)systematic deviation 
C)standard dispersion
D)systematic dispersion

Question 23

Cohen's kappa is used to overcome limitations associated with reliability assessed using the ____ method.

A)inter-rater
B)split-half
C)average inter-item correlation
D)average item-total correlation

Question 24

Hannah has developed a scale for assessing social interaction among children with moderate to severe developmental disabilities.Because it is in the early stages,she trains two research assistants in how to use the scale,has them both observe the same children,and compares the scores they give the children.Hannah is assessing ____ reliability.

A)inter-rater​
B)test-retest
C)parallel-forms
D)internal consistency

Question 25

The proportion of truth in a set of scores across your sample can be thought of as ____.

A)validity
B)reliability
C)variability
D)power

Question 26

The consistency of results across items within a test is referred to as ____ reliability.

A)inter-rater
B)test-retest
C)parallel-forms
D)internal consistency

Question 27

A measure that consistently and accurately measures what is supposed to measure is ____.

A)both valid and reliable
B)neither valid nor reliable
C)valid but not reliable
D)reliable but not valid

Question 28

Cronbach's Alpha is used to overcome limitations associated with reliability assessed using the ____ method.

A)inter-rater
B)split-half
C)average inter-item correlation
D)average item-total correlation

Question 29

Combining multiple independent measures to get at a more accurate estimate of a variable is referred to as ____.

A)triangulation
B)covariation
C)validation
D)imputation

Question 30

A measure that does not yield consistent scores and does not measure what it is supposed to measure is ____.

A)both valid and reliable
B)neither valid nor reliable
C)valid but not reliable
D)reliable but not valid

Question 31

Figure 5.13

The formula illustrated in the accompanying figure provides an estimate of ____.

A)validity
B)reliability
C)bias
D)variability

Question 32

Hannah has developed a scale for assessing social interaction among children with moderate to severe developmental disabilities.Because it is in the early stages,she decides to rate the same children on two different occasions.Hannah is assessing ____ reliability.

A)inter-rater
B)test-retest
C)parallel-forms
D)internal consistency

Question 33

When systematic error affects the mean of a distribution,it is referred to as ____.

A)shifting
B)variance
C)bias
D)regression

Question 34

If you could see all random error in a distribution,it would ____.

A)have a variance equal to the mean
B)sum to zero
C)shift the mean in a positive direction
D)be greater than the population variance

Question 35

The consistency of an observation from one time to another is referred to as ____ reliability.

A)inter-rater
B)test-retest
C)parallel-forms
D)internal consistency

Question 36

The degree to which different observers give consistent estimates of the same phenomenon is referred to as ____ reliability.

A)inter-rater
B)test-retest
C)parallel-forms
D)internal consistency

Question 37

A measure that measures what it is supposed to measure but does not yield consistent scores is ____.

A)both valid and reliable
B)neither valid nor reliable
C)valid but not reliable
D)reliable but not valid

Question 38

A measure that yields consistent scores but does not measure what it is supposed to measure is ____.

A)both valid and reliable
B)neither valid nor reliable
C)valid but not reliable
D)reliable but not valid

Question 39

The consistency of the results of two tests constructed in the same way from the same content domain is referred to as ____ reliability.

A)inter-rater
B)test-retest
C)parallel-forms
D)internal consistency

Question 40

The reliability ratio is expressed as ____.

A)var(T)/ var(X)
B)var(X)/ var(T)
C)rel(X)/ rel(T)
D)rel(T)/ rel(X)

Question 41

Wanda is assessing a new treatment for performance anxiety that involves teaching individuals how to control their breathing.She presents her preliminary results at a student research symposium and is questioned as to whether her intervention affects the cognitive components of performance anxiety.She is being questioned about the possibility of ____.

A)mono-method bias
B)mono-operation bias
C)treatment interactions
D)hypothesis guessing

Question 42

A(n)_______________ scale simply ranks attributes.

Question 43

When a(n)_______________ scale is used,it makes sense to say one score is twice as much as another or that twice as much of the characteristic being measured is present.

Question 44

In ____,research participants do not respond the way they normally would because they are anxious about being tested.

A)hypothesis guessing
B)evaluation apprehension
C)researcher expectancies
D)construct confounding

Question 45

Ahran develops a measure of test anxiety and finds that,on average,it measures test anxiety for the group,but individual scores are highly variable from test to retest.His test is _______________ but not _______________.

Question 46

The type of reliability that is used to assess the consistency of the results of two tests constructed in the same way from the same content domain is _______________.

Question 47

Hannah has developed a scale for assessing social interaction among children with moderate to severe developmental disabilities.Because it is in the early stages,she has many dozens of potential items and decides to create two versions of the test from among her many items and then have individual observers score the same children using the two different versions.Hannah is assessing ____ reliability.

A)inter-rater
B)test-retest
C)parallel-forms
D)internal consistency

Question 48

If a test looks as though it measures what it claims to measure is an assessment of ____ validity.

A)convergent
B)face
C)discriminant
D)concurrent

Question 49

Systematic error in an estimate is referred to as _______________.

Question 50

Which type of validity is a type of translation validity?​

A)face
B)predictive
C)discriminant
D)concurrent

Question 51

In ____,research participants try to figure out what the experimenter is "really" trying to do.

A)hypothesis guessing
B)evaluation apprehension
C)researcher expectancies
D)construct confounding

Question 52

Von has a new measure of stress from daily hassles.He finds that it yields consistent scores,but seems not to be measuring stress at all.His test is _______________ but not _______________.

Question 53

Checking on whether the new measure is different from measures from which it should,indeed,be different provides an assessment of ____ validity.

A)content
B)face
C)discriminant
D)concurrent

Question 54

Checking a new test to be certain that it contains items that it would be expected to contain based on the relevant literature provides an assessment of ____ validity.

A)content​
B)face
C)discriminant
D)concurrent

Question 55

Wanda is assessing a new treatment for performance anxiety and includes a single assessment for performance anxiety.Her study is at risk for ____.

A)mono-method bias
B)mono-operation bias
C)treatment interactions
D)restricted generalizability

Question 56

Joe creates a measure of life satisfaction that yields consistent scores and seems to be measuring life satisfaction.His measure is (neither/both)_______________ reliable or/and valid.

Question 57

Lydia develops a measure of postpartum depression.It has tremendous variability and seems not to be measuring depression at all.Her measure is (neither/both)_______________ reliable or/and valid.

Question 58

The type of reliability that is used to assess the degree to which different observers give consistent estimates of the same phenomenon is _______________.

Question 59

Hannah has developed a scale for assessing social interaction among children with moderate to severe developmental disabilities.She decides to look at the interrelationships among the items in the test. Hannah is assessing ____ reliability.

A)inter-rater
B)test-retest
C)parallel-forms
D)internal consistency

Question 60

When a television competition show has a "red" team and a "blue" team,they are using a(n)_______________ scale.

Question 61

An evaluation of whether the operationalization or the implementation of the construct behaves the way it should is referred to as _______________.

Question 62

If an instrument looks as though it measures what it is supposed to measure,it has _______________.

Question 63

The type of reliability that is used to assess the consistency of an observation from one time to another is _______________.

Question 64

What is test-retest reliability and how is it measured?​

Question 65

What are the four levels of measurement and what are the characteristics of each level?​

Question 66

The extent to which a measure or instrument actually measures what it is theoretically supposed to measure is _______________.

Question 67

What is true score theory and why is it important?​

Question 68

The type of reliability that is used to assess the consistency of results across items within a test is _______________.

Question 69

What is content validity and how is it specified?​

Question 70

What is random error and why is it important?