Deck 6: Selecting Measurement Instruments

Question 1

Given the following research question: "Are there differences in individual student achievement scores in advanced science classes between classes where students sit in the lecture style seating and those where students sit in cluster seating?" Achievement scores represents an)

A) independent variable.
B) dependent variable.
C) extraneous variable.
D) affective variable.

Answer 1

B

Question 2

Gender is considered an) ___________ level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Answer 2

A

Question 3

Item 6 best represents an example of which of the following types of items?

A) Semantic Differential Scale
B) Likert Scale
C) Mann-Whitney Scale
D) Wilcoxon Scale

Answer 3

B

Question 4

Marital status is considered an) ______________ level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 5

Self-esteem, in Gary's study, is measured as an)___________ level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 6

A local government group recently conducted a survey to ask those living in the community if they would like to see a new pool facility built. The survey asked the following six questions:
1. Do you live in the community defined by zip codes 16801,16802, 16803 or 16804? Y_______ N_______
2. Do you currently own a membership to any community or private swimming pools? Y_______ N_______
3. How many people live at your residence.
1_______ 2_________ 3-6_________ 6+___________
4. Please indicate the combined annual income of the members of your residence in thousands of dollars. $__________________
Given the following scale answer questions 5 and 6.
1=Strongly Disagree, 2=Disagree, 3 =Neutral, 4=Agree, 5=Strongly Agree
5. Our community should build a new indoor pool facility. 1 2 3 4 5
6. I support spending tax dollars for recreational opportunities. 1 2 3 4 5
Given the above survey, Item 4 data would represent _______level data.

A) nominal
B) ordinal
C) interval
D) ratio

Question 7

Age is considered an) ________________level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 8

Gary is a researcher interested in self-esteem. He develops an instrument he names the "I am great questionnaire." He administers the survey and collects information from 500 middle school learners. He calculates a self-esteem score for each child in the study and then groups the students as low, medium, or high self-esteem. Given this scenario please answer the following questions.
The information that Gary collects from the learners is referred to

A) assessment.
B) data.
C) constructs.
D) variables.

Question 9

Given the following research question: "Are there differences in individual student achievement scores in advanced science classes between classes where students sit in the lecture style seating and those where students sit in cluster seating?" Type of classroom represents an)

A) independent variable.
B) dependent variable.
C) extraneous variable.
D) affective variable.

Question 10

Marty assesses teachers' attitudes toward inclusion based upon number of years of teacher experience. He groups his teachers as those that have 4 or less years of experience, 5-10 years of experience, 11-20 years of experience and more than 20 years. The variable of years of experience in Marty's study illustrates an example of ___________level data.

A) nominal
B) ordinal
C) interval
D) ratio

Question 11

Ne is a program evaluator for a large school district. This past year the district implemented a new reading program. Ne must measure the level of implementation of the program by individual schools in the district. In this study, school is measured as a __________ level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 12

Performance on an attitude measure with Likert type items is considered an) _____________ level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 13

Political party affiliation is considered __________ level data.

A) nominal
B) ordinal
C) interval
D) ratio

Question 14

A local government group recently conducted a survey to ask those living in the community if they would like to see a new pool facility built. The survey asked the following six questions:
1. Do you live in the community defined by zip codes 16801,16802, 16803 or 16804? Y_______ N_______
2. Do you currently own a membership to any community or private swimming pools? Y_______ N_______
3. How many people live at your residence.
1_______ 2_________ 3-6_________ 6+___________
4. Please indicate the combined annual income of the members of your residence in thousands of dollars. $__________________
Given the following scale answer questions 5 and 6.
1=Strongly Disagree, 2=Disagree, 3 =Neutral, 4=Agree, 5=Strongly Agree
5. Our community should build a new indoor pool facility. 1 2 3 4 5
6. I support spending tax dollars for recreational opportunities. 1 2 3 4 5
Given the above survey, Item 5 would represent ________ level data.

A) nominal
B) ordinal
C) interval
D) ratio

Question 15

Gary is a researcher interested in self-esteem. He develops an instrument he names the "I am great questionnaire." He administers the survey and collects information from 500 middle school learners. He calculates a self-esteem score for each child in the study and then groups the students as low, medium, or high self-esteem. Given this scenario please answer the following questions.
The instrument that Gary developed is an example of _______________ an) assessment.

A) affective
B) cognitive
C) projective
D) aptitude

Question 16

Test scores, reported as proportion correct, on a recent math test in Ms. Polk's fourth grade class represent _____________ level data.

A) nominal
B) ordinal
C) interval
D) ratio

Question 17

Standardized test scores are often given as percentile ranks. These data are considered ________________ level measurement.

A) nominal
B) ordinal
C) interval
D) ratio

Question 18

In a study that compares different drop out rates of college students by intended major; intended major is considered an)________level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 19

Matilda is interested in number of books read by each of the third grade children in her school district during the academic year. She believes that there may be differences in the number of books read by classroom and by school and she thinks there is a positive relationship between number of books read and reading achievement as measured on the standardized assessment given at the end of the year.
In Matilda's study the variable 'classroom' would be considered an) ___________ level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 20

A local government group recently conducted a survey to ask those living in the community if they would like to see a new pool facility built. The survey asked the following six questions:
1. Do you live in the community defined by zip codes 16801,16802, 16803 or 16804? Y_______ N_______
2. Do you currently own a membership to any community or private swimming pools? Y_______ N_______
3. How many people live at your residence.
1_______ 2_________ 3-6_________ 6+___________
4. Please indicate the combined annual income of the members of your residence in thousands of dollars. $__________________
Given the following scale answer questions 5 and 6.
1=Strongly Disagree, 2=Disagree, 3 =Neutral, 4=Agree, 5=Strongly Agree
5. Our community should build a new indoor pool facility. 1 2 3 4 5
6. I support spending tax dollars for recreational opportunities. 1 2 3 4 5
Given the above survey, Item 1 data would represent ________ level data.

A) nominal
B) ordinal
C) interval
D) ratio

Question 21

Matilda is interested in number of books read by each of the third grade children in her school district during the academic year. She believes that there may be differences in the number of books read by classroom and by school and she thinks there is a positive relationship between number of books read and reading achievement as measured on the standardized assessment given at the end of the year.
In Matilda's study the variable 'number of books read' would be considered an) ___________ level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 22

Hanna is conducting a problem-solving study that relates learners' motivation to number of challenging problems attempted. She defines motivation as self-efficacy. She uses a self-report instrument to measure self-efficacy.
Paul is a participant in Hanna's study. His score on the self-efficacy measure is considered

A) a variable.
B) a construct.
C) data.
D) knowledge.

Question 23

Which of the following is the best example of a standardized test?

A) A classroom-based teacher developed test
B) An attitude measure developed by a researcher
C) The national achievement test
D) The outcome measures of amount learned in an experimental study

Question 24

Selection methods of assessment include

A) essays.
B) authentic assessments.
C) short answer.
D) matching.

Question 25

Jill correctly answered 15 items on a fifty-item, 150 point biology test correctly. The 15 items represent Jill's

A) percentile score.
B) raw score.
C) stanine score.
D) grade-equivalent score.

Question 26

Matilda is interested in number of books read by each of the third grade children in her school district during the academic year. She believes that there may be differences in the number of books read by classroom and by school and she thinks there is a positive relationship between number of books read and reading achievement as measured on the standardized assessment given at the end of the year.
In Matilda's study the variable 'school' would be considered an) ____________ level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 27

Performance assessments include

A) fill-in-the-blank.
B) lab demonstrations.
C) multiple choice.
D) true/false.

Question 28

Matilda is interested in number of books read by each of the third grade children in her school district during the academic year. She believes that there may be differences in the number of books read by classroom and by school and she thinks there is a positive relationship between number of books read and reading achievement as measured on the standardized assessment given at the end of the year.
Matilda's study addresses two primary research questions. One addresses whether there are differences in number of books read by class and by school. The type of research addressed by this question represents an) _________research study.

A) Descriptive
B) Casual-Comparative
C) Correlational
D) Experimental

Question 29

Matilda is interested in number of books read by each of the third grade children in her school district during the academic year. She believes that there may be differences in the number of books read by classroom and by school and she thinks there is a positive relationship between number of books read and reading achievement as measured on the standardized assessment given at the end of the year.
In Matilda's study the variable 'school' represents which of the following type of variable?

A) Independent variable
B) Neutral variable
C) Manipulated variable
D) Dependent variable

Question 30

Mitch's study addresses the role of parental involvement in the classroom and the effects on student grades. In his work, final averages in the core subject areas are compared between children who are in classrooms with parent volunteers and those in classrooms with no parent volunteers. His dependent measure, final averages in core subjects, illustrates which type of assessment?

A) Cognitive
B) Aptitude
C) Attitude
D) Personality

Question 31

Assessments include all of the following EXCEPT

A) measurements.
B) tests.
C) observations.
D) interviews.

Question 32

Sam is a psychology researcher interested in personality differences between university faculty who do and do not include computer-assisted technology in their class lectures. He groups the faculty based upon use of computer-assisted technology and he administers a 13-item Likert scale personality assessment.
In Sam's study, personality is measured with an)

A) nonprojective instrument.
B) projective instrument.
C) standardized instrument.
D) alternative assessment.

Question 33

Matilda is interested in number of books read by each of the third grade children in her school district during the academic year. She believes that there may be differences in the number of books read by classroom and by school and she thinks there is a positive relationship between number of books read and reading achievement as measured on the standardized assessment given at the end of the year.
In Matilda's study the variable 'reading achievement' would be considered an) ___________ level variable.

A) nominal
B) ordinal
C) interval
D) ratio

Question 34

A formal, systematic procedure for gathering information is an)

A) measurement.
B) observation.
C) instrument.
D) score.

Question 35

Hanna is conducting a problem-solving study that relates learners' motivation to number of challenging problems attempted. She defines motivation as self-efficacy. She uses a self-report instrument to measure self-efficacy.
Of the following, which is considered an affective measurement?

A) The Scholastic Aptitude Test SAT)
B) Preschool Reading Ability Measure
C) A Field Dependence Test
D) A self-esteem measure

Question 36

Sam is a psychology researcher interested in personality differences between university faculty who do and do not include computer-assisted technology in their class lectures. He groups the faculty based upon use of computer-assisted technology and he administers a 13-item Likert scale personality assessment.
In Sam's study, personality is considered an)

A) aptitude measure.
B) affective measure.
C) achievement measure.
D) cognitive measure.

Question 37

Lara administers an exam to her 10^th grade history class. The test includes multiple-choice, true/false, matching, and fill-in-the-blank items. Lara's instrument includes

A) selection method items only.
B) supply method items only.
C) both supply and selection method items.
D) neither supply nor selection method items.

Question 38

Of the following which is a supply method for collecting data?

A) Multiple choice
B) True/false
C) Fill-in-the-blank
D) Matching

Question 39

Hanna has operationalized which of the following variables?

A) Self-efficacy
B) Motivation
C) Problem-solving
D) Challenging problems

Question 40

Matilda is interested in number of books read by each of the third grade children in her school district during the academic year. She believes that there may be differences in the number of books read by classroom and by school and she thinks there is a positive relationship between number of books read and reading achievement as measured on the standardized assessment given at the end of the year.
Matilda's study addresses two primary research questions. One addresses whether there is a positive relationship between number of books read by standardized test score. The type of research addressed by this question represents an) _________research study.

A) Descriptive
B) Casual-Comparative
C) Correlational
D) Experimental

Question 41

Which of the following is NOT an example of an affective assessment?

A) The Thurstone scales
B) The Otis-Lennon School Ability Test
C) The Strong-Cambell Interest Inventory
D) The Minnesota Multiphasic Personality Inventory

Question 42

In a semantic differential scale a neutral response is recorded as a

A) 0.
B) 3.
C) 5.
D) 50.

Question 43

Tests of logical reasoning are generally found on

A) achievement tests.
B) aptitude tests.
C) affective tests.
D) attitude scales.

Question 44

Recently, many lawmakers have been advocating for assessments to be administered to all children at varying levels in their schooling.
These types of assessments are used as __________ assessments

A) criterion-referenced
B) self-referenced
C) norm-referenced
D) individual-referenced

Question 45

Generally projective tests, but not achievement tests, are administered

A) in groups.
B) across several testing sessions.
C) by the classroom teacher.
D) individually.

Question 46

The type of instrument that examines our values is classified as an)

A) diagnostic assessment.
B) projective assessment.
C) affective assessment.
D) cognitive assessment.

Question 47

Jillian is struggling in mathematics. Her teacher wants to administer a test to assist in a decision about whether to provide remedial math classes for Jillian. Of the following, which is the test most likely the type of assessment to be administered for this purpose?

A) An attitude assessment
B) A cognitive test
C) An affective test
D) A self-referenced test

Question 48

Some individual differences, such as cultural differences for example, may distort information obtained from an assessment. This is referred to as

A) response set.
B) bias.
C) interpretation error.
D) sampling error.

Question 49

Sal recently took an instrument that asked him to rate his opinions about the effectiveness of different instructional practices as 'Strongly Agree', 'Agree', 'Uncertain', 'Disagree', 'Strongly Disagree'. This instrument is using a

A) Semantic Differential Scale.
B) Guttman Scale.
C) Likert Scale.
D) Thurstone Scale.

Question 50

On the test report Sheri received from the standardized achievement test, there were several different tests reported. This indicates that the test represented an)

A) affective test.
B) multitrait test.
C) test battery.
D) subtest.

Question 51

Stephenie recently took an interest inventory to determine which career might be good for her. She answered 'strongly interested' to almost every question. The career counselor suggested a different strategy because her results were not informative. What is most likely the reason for Stephenie's answers?

A) Bias
B) Validity
C) Reliability
D) Response set

Question 52

Recently, many lawmakers have been advocating for assessments to be administered to all children at varying levels in their schooling.
These types of assessments are designed to be

A) aptitude tests.
B) achievement tests.
C) attitude tests.
D) affective tests.

Question 53

The Columbia Mental Maturity Scale is an example of an

A) achievement test.
B) aptitude test.
C) affective test.
D) attitude scale.

Question 54

In The Thematic Apperception Test, participants are asked to tell a story about each of a series of pictures. This is an example of an)

A) a projective test.
B) an aptitude test.
C) an achievement test.
D) an interest scale.

Question 55

Susan has her life skills class keep a bank account and 'pay bills' throughout the semester. Susan's assessment strategy illustrates

A) performance assessment.
B) supply methods of assessment.
C) selection methods of assessment.
D) problem-based assessment.

Question 56

Of the following which illustrates criterion-referenced scoring?

A) Jody got the highest score on the test.
B) Jody performed worse than she did on the midterm.
C) Jody received an 86 which was a B.
D) Jody received an 86 which was the average.

Question 57

Projective tests are an example of

A) cognitive tests.
B) achievement tests.
C) affective tests.
D) self-referenced tests.

Question 58

Sheri got her son's standardized achievement scores back. One of the things she noted was that her son achieved a national percentile ranking of 89 in math. This score represents

A) a norm-referenced score.
B) a criterion-referenced score.
C) that her son likely got a B in his math class.
D) that her son is better in math than his classmates.

Question 59

Of the following, which is an example of self-referenced approach?

A) Jon finished first in the race.
B) Jon performed worse than his teammates.
C) Jon ran the mile in less than 6 minutes.
D) Jon ran the mile faster than his last race.

Question 60

Which of the following illustrates norm-referenced scoring?

A) Sally got all the items correct on her exam.
B) Sally performed at the average of the class.
C) Sally's score on the exam was an 85.
D) Sally's score indicated improvement.

Question 61

The degree to which an instrument consistently measures the construct of interest is referred to as

A) predictive validity.
B) criterion-related validity.
C) content validity.
D) reliability.

Question 62

The rationale for selection of a given assessment should be included in the ______________ section of your research plan.

A) participants
B) design
C) procedures
D) results

Question 63

Robert scored an 87 on a recent mathematics placement test. John scored an 86. The standard error of measurement of the test is 4. What can we conclude about the two students' actual measures?

A) Robert's true score is higher than John's
B) John's true score is higher than Robert's
C) Robert's true score may be higher than John's
D) The two student's true scores are equal

Question 64

You want to make sure the math test you give your students is reliable. You are afraid they can memorize facts so your test is all word problems. However, you now are concerned that you have hindered the validity of the test. It still looks like a math test, so which type of validity have you potentially violated?

A) Content
B) Consequential
C) Predictive
D) Construct

Question 65

The district is considering changing the achievement tests that they administer. A new alternative test is much shorter and if valid to measure student achievement could save substantial instructional time. This year the school will administer both tests and assess the ____________ validity.

A) content
B) concurrent
C) predictive
D) sampling

Question 66

The type of validity that focuses on the extent to which the test relates to future performance is referred to as _________ validity.

A) predictive
B) concurrent
C) content
D) construct

Question 67

Michael left the Physics final and complained. The content on the cumulative final only covered about one quarter of the concepts for the course. Michael is questioning the _____________ validity of the test.

A) content
B) criterion-related
C) construct
D) consequential

Question 68

The extent to which a test actually measures what it is designed to measure is referred to as ____________ validity.

A) content
B) criterion-related
C) construct
D) consequential

Question 69

Cronbach's alpha is a measure of

A) Standard Error of Measurement.
B) Internal consistency reliability.
C) Criterion related validity.
D) Alternate-form reliability.

Question 70

The extent to which unintended outcomes arise from the testing activity is referred to as ___________ validity.

A) content
B) criterion-related
C) construct
D) consequential

Question 71

Standard error of measurement is an expression of an instruments'

A) internal consistency reliability.
B) consequential validity.
C) test-retest reliability.
D) construct validity.

Question 72

The University uses an algebra test to screen students into statistics courses. Students' responses are scored as correct or incorrect and are summed for a total score. The test is really long and seems to cover a lot of content. So Carlos divides the test in two and assesses the reliability of the entire test and the reliability of the two halves. Carlos is assessing the ________________ of the test.

A) content validity
B) internal consistency reliability.
C) test-retest reliability
D) criterion-related validity

Question 73

Some of the students in his class had to take an AP physics exam on the day his US History final was scheduled so Mike will have to administer two different versions of his test. With which of the following reliability constructs should Mike be most concerned?

A) Internal consistency
B) Split-Half
C) Test-retest
D) Alternate forms

Question 74

Lori has found two measures of attitudes about technology that she thinks might work for her dissertation. She would like to examine reviews of the two instruments. From the following choices which should Lori consult for actual reviews?

A) PRO-ED
B) Tests in Print
C) Mental Measurements Yearbooks
D) ETS test collection

Question 75

You have recently constructed a self-report measure of achievement motivation. You are sure your measure is better than other measures because it is shorter than they are. You decide to administer your measure along with a standard measure generally used in the field. Which type of validity will this strategy help you to assess?

A) Content
B) Consequential
C) Criterion-related
D) Construct

Question 76

Split-half and odd-even reliability are both measures of

A) test-retest reliability.
B) alternate forms reliability.
C) internal consistency reliability.
D) external reliability.

Question 77

According to your text the most important type of validity is _____________validity.

A) content
B) criterion-related
C) construct
D) consequential

Question 78

A recent study reported about a new instrument that measures students' motivation for challenging academic tasks. In the study the instrument had been given to a number of children at the beginning of their academic year. After reading the study, Susan wondered if students' responses would be different at the end of the academic year. She decides to conduct a study that administers the instrument several times over the course of an academic year and measures the correlation across administrations. Susan has addressed a concern with which of the following types of reliability?

A) Internal consistency
B) Split-Half
C) Stability
D) Equivalence

Question 79

Gavin recently administered a science test to his fourth grade class. He questions the validity of the test as a science test because although it looks as if it measures science content, it relies heavily on reading ability. Gavin's concern is with the _____________ validity of the test.

A) content
B) criterion-related
C) construct.
D) consequential

Question 80

The type of validity that addresses if the test appears to measure the variable of interest is referred to as ________________ validity.

A) content
B) criterion-related
C) construct
D) consequential