Question 1

List and describe the four successive stages in Rossi and Freemanʹs comprehensive model of program evaluation.

Accepted Answer

Rossi and Freeman's comprehensive model of program evaluation consists of four successive stages:

1. Needs Assessment: This stage involves identifying the specific needs and problems that a program aims to address. This may include conducting surveys, interviews, and research to understand the target population's needs and the context in which the program operates.

2. Program Theory and Design: In this stage, the evaluators develop a clear understanding of the program's theory of change and the underlying logic model. This involves identifying the program's intended outcomes, inputs, activities, and the causal pathways through which the program is expected to achieve its goals.

3. Implementation Monitoring: This stage focuses on assessing how well the program is being implemented and whether it is reaching its intended target population. Evaluators may use various methods such as site visits, interviews, and document reviews to gather data on program implementation.

4. Impact Evaluation: The final stage involves assessing the program's impact on its intended outcomes. This may include using quantitative and qualitative methods to measure the extent to which the program has achieved its goals and whether any unintended consequences have emerged.

Overall, Rossi and Freeman's model provides a comprehensive framework for evaluating programs, ensuring that the evaluation process is systematic, thorough, and capable of providing meaningful insights for program improvement and decision-making.

Question 2

The judicial decision in the landmark court case presided over by Judge Robert Peckham, which resulted in restrictions on the use of IQ tests for the placement of children in special school classes for the mentally retarded in California,

Accepted Answer

A)  was adopted as law by several other states. 
B)  passed by the U.S. Congress and became federal law. 
C)  was judged to be unconstitutional by the U.S. Supreme Court. 
D)  banned the use of IQ tests in assigning children to classes for the mentally retarded. 
A)  was adopted as law by several other states. 
B)  passed by the U.S. Congress and became federal law. 
C)  was judged to be unconstitutional by the U.S. Supreme Court. 
D)  banned the use of IQ tests in assigning children to classes for the mentally retarded. D

Question 3

In general, public school teachers are not very well trained in test construction and test score interpretation.

Accepted Answer

A) True 
 B)False  True

Question 4

Consider the four stages in the comprehensive program evaluation model of Rossi and Freeman: (1) economic efficiency assessment, (2) impact assessment, (3) program monitoring, (4) program planning. Which of the following is the correct order, from first to last, in which these stages occur?

Accepted Answer

A)  4, 1, 2, 3 
B)  4, 2, 1, 3 
C)  4, 2, 3, 1 
D)  4, 3, 1, 2 
E)  4, 3, 2, 1 
A)  4, 1, 2, 3 
B)  4, 2, 1, 3 
C)  4, 2, 3, 1 
D)  4, 3, 1, 2 
E)  4, 3, 2, 1

Question 5

The current policy of the College Entrance Examination Board concerning the disclosure of SAT questions is

Accepted Answer

A)  questions are provided only when a legal warrant is filed. 
B)  questions are disclosed one month after the test is administered. 
C)  questions are disclosed one year after the test is administered. 
D)  questions are made available immediately after taking the examination. 
A)  questions are provided only when a legal warrant is filed. 
B)  questions are disclosed one month after the test is administered. 
C)  questions are disclosed one year after the test is administered. 
D)  questions are made available immediately after taking the examination.

Question 6

At what stages of program evaluation are statistical methods least likely to be employed?

Accepted Answer

A)  economic efficiency assessment 
B)  impact assessment 
C)  program monitoring 
D)  program planning 
A)  economic efficiency assessment 
B)  impact assessment 
C)  program monitoring 
D)  program planning

Question 7

During which of the following stages of the Rossi & Freeman program evaluation model is cost-benefit analysis of most concern?

Accepted Answer

A)  economic efficiency assessment 
B)  impact assessment 
C)  program monitoring 
D)  program planning 
A)  economic efficiency assessment 
B)  impact assessment 
C)  program monitoring 
D)  program planning

Question 8

Asian-Americans score higher than White Americans on the SAT-Verbal but not on the SAT-Mathematical tests.

Accepted Answer

A) True 
 B)False

Question 9

The "Golden Rule" settlement was an out-of-court settlement concerned with the issue of gender bias of test items.

Accepted Answer

A) True 
 B)False

Question 10

Total reliance on objective tests for assessing achievement may lead to poor writing abilities, inferior teaching, and improper study habits.

Accepted Answer

A) True 
 B)False

Question 11

The legal statute specifying that test results and other school records of a student may be made available in a personally identifiable way to other people only when the student or his/her parents give their written consent is known as the

Accepted Answer

A)  Buckley-Pell Amendment. 
B)  Dunlop Act. 
C)  Griggs-Duke Amendment. 
D)  Carey-Mann Act. 
A)  Buckley-Pell Amendment. 
B)  Dunlop Act. 
C)  Griggs-Duke Amendment. 
D)  Carey-Mann Act.

Question 12

According to the item characteristic curve approach to detecting item bias, a test is unbiased if

Accepted Answer

A)  establishing separate job performance cutoff scores for different groups makes the probability of selecting potentially successful applicants in the various groups the same. 
B)  qualifying scores on the test are established in such a way that different groups of applicants are selected in proportion to the number in each group who are capable of attaining an acceptable level on the performance criterion. 
C)  regardless of their group membership, examinees of the same ability have equal probabilities of getting an item right. 
D)  regression slopes for predicting job performance from the scores are the same for different groups. 
A)  establishing separate job performance cutoff scores for different groups makes the probability of selecting potentially successful applicants in the various groups the same. 
B)  qualifying scores on the test are established in such a way that different groups of applicants are selected in proportion to the number in each group who are capable of attaining an acceptable level on the performance criterion. 
C)  regardless of their group membership, examinees of the same ability have equal probabilities of getting an item right. 
D)  regression slopes for predicting job performance from the scores are the same for different groups.

Question 13

Which court decision issued a ban on IQ testing for the placement of Black children in California school classes for educable mentally retarded children?

Accepted Answer

A)  Diana vs. State Board of Education 
B)  Hobson vs. Hansen 
C)  Larry P. vs. Riles 
D)  PASE vs. Hannon 
A)  Diana vs. State Board of Education 
B)  Hobson vs. Hansen 
C)  Larry P. vs. Riles 
D)  PASE vs. Hannon

Question 14

The strongest "truth-in-testing" legislation was enacted in New York State.

Accepted Answer

A) True 
 B)False

Question 15

Which of the following was not suggested by a special panel as a cause of the nationwide decline in SAT scores during the 1970s?

Accepted Answer

A)  Changes in the economic, ethnic, sex, and social class composition of the group taking the test. 
B)  Declines in student motivation and teacher abilities. 
C)  Declining educational standards and too much time spent watching television. 
D)  Less intellectually demanding high school curricula. 
A)  Changes in the economic, ethnic, sex, and social class composition of the group taking the test. 
B)  Declines in student motivation and teacher abilities. 
C)  Declining educational standards and too much time spent watching television. 
D)  Less intellectually demanding high school curricula.

Question 16

The "Lake Wobegon effect"refers to the effect of teachers? expectations on students? test scores.

Accepted Answer

A) True 
 B)False

Question 17

A test is legally unfair to a minority group if the mean and variance of the test scores of that group are lower than those of a representative sample of majority-group applicants.

Accepted Answer

A) True 
 B)False

Question 18

The most accurate conclusion regarding the effects of coaching on SAT scores is that

Accepted Answer

A)  coaching has a greater effect on the SAT-Verbal than on the SAT-Mathematical score. 
B)  coaching has little or no effect on SAT scores and is probably a waste of time and money. 
C)  depending on the number of hours, coaching has some effect on SAT scores. 
D)  with a good coach, scores change on the average by 100 points or more. 
A)  coaching has a greater effect on the SAT-Verbal than on the SAT-Mathematical score. 
B)  coaching has little or no effect on SAT scores and is probably a waste of time and money. 
C)  depending on the number of hours, coaching has some effect on SAT scores. 
D)  with a good coach, scores change on the average by 100 points or more.

Question 19

The Federal Trade Commission?s report on the effects of coaching on SAT scores concluded that these effects are

Accepted Answer

A)  dependent on the similarities between test material and coached material. 
B)  insignificant and unimportant. 
C)  significant for mathematical but not for verbal items. 
D)  significant in certain instances on both verbal and mathematical items. 
A)  dependent on the similarities between test material and coached material. 
B)  insignificant and unimportant. 
C)  significant for mathematical but not for verbal items. 
D)  significant in certain instances on both verbal and mathematical items.

Question 20

The primary purpose of program evaluation is to plan strategies for implementing effective programs.

Accepted Answer

A) True 
 B)False

List and describe the four successive stages in Rossi and Freemanʹs comprehensive model of program evaluation.

The judicial decision in the landmark court case presided over by Judge Robert Peckham, which resulted in restrictions on the use of IQ tests for the placement of children in special school classes for the mentally retarded in California,

In general, public school teachers are not very well trained in test construction and test score interpretation.

Consider the four stages in the comprehensive program evaluation model of Rossi and Freeman: (1) economic efficiency assessment, (2) impact assessment, (3) program monitoring, (4) program planning. Which of the following is the correct order, from first to last, in which these stages occur?

The current policy of the College Entrance Examination Board concerning the disclosure of SAT questions is

At what stages of program evaluation are statistical methods least likely to be employed?

During which of the following stages of the Rossi & Freeman program evaluation model is cost-benefit analysis of most concern?

Asian-Americans score higher than White Americans on the SAT-Verbal but not on the SAT-Mathematical tests.

The "Golden Rule" settlement was an out-of-court settlement concerned with the issue of gender bias of test items.

Total reliance on objective tests for assessing achievement may lead to poor writing abilities, inferior teaching, and improper study habits.

The legal statute specifying that test results and other school records of a student may be made available in a personally identifiable way to other people only when the student or his/her parents give their written consent is known as the

According to the item characteristic curve approach to detecting item bias, a test is unbiased if

Which court decision issued a ban on IQ testing for the placement of Black children in California school classes for educable mentally retarded children?

The strongest "truth-in-testing" legislation was enacted in New York State.

Which of the following was not suggested by a special panel as a cause of the nationwide decline in SAT scores during the 1970s?

The "Lake Wobegon effect"refers to the effect of teachers? expectations on students? test scores.

A test is legally unfair to a minority group if the mean and variance of the test scores of that group are lower than those of a representative sample of majority-group applicants.

The most accurate conclusion regarding the effects of coaching on SAT scores is that

The Federal Trade Commission?s report on the effects of coaching on SAT scores concluded that these effects are

The primary purpose of program evaluation is to plan strategies for implementing effective programs.

Historical and Professional Matters

Test Design and Construction

Administration and Scoring of Tests

Item Analysis and Standardization of Tests

Reliability and Validity

Intelligence Testing

Individual and Group Differences in Mental Abilities

Neuropsychological Assessment

Standardized Achievement Tests

Testing Special Abilities

Vocational Interests

Attitudes, Values, and Personal Orientations

Personality Assessment: Origins,applications, and Issues

Observations and Interviews

Rating Scales and Checklists

Personality Inventories

Projective Techniques

Appendix A: Measurement and Statistics

Filters

Exam 10: Applications and Issues in Ability Testing

List and describe the four successive stages in Rossi and Freemanʹs comprehensive model of program evaluation.

The judicial decision in the landmark court case presided over by Judge Robert Peckham, which resulted in restrictions on the use of IQ tests for the placement of children in special school classes for the mentally retarded in California,

In general, public school teachers are not very well trained in test construction and test score interpretation.

Consider the four stages in the comprehensive program evaluation model of Rossi and Freeman: (1) economic efficiency assessment, (2) impact assessment, (3) program monitoring, (4) program planning. Which of the following is the correct order, from first to last, in which these stages occur?

The current policy of the College Entrance Examination Board concerning the disclosure of SAT questions is

At what stages of program evaluation are statistical methods least likely to be employed?

During which of the following stages of the Rossi & Freeman program evaluation model is cost-benefit analysis of most concern?

Asian-Americans score higher than White Americans on the SAT-Verbal but not on the SAT-Mathematical tests.

The "Golden Rule" settlement was an out-of-court settlement concerned with the issue of gender bias of test items.

Total reliance on objective tests for assessing achievement may lead to poor writing abilities, inferior teaching, and improper study habits.

The legal statute specifying that test results and other school records of a student may be made available in a personally identifiable way to other people only when the student or his/her parents give their written consent is known as the

According to the item characteristic curve approach to detecting item bias, a test is unbiased if

Which court decision issued a ban on IQ testing for the placement of Black children in California school classes for educable mentally retarded children?

The strongest "truth-in-testing" legislation was enacted in New York State.

Which of the following was not suggested by a special panel as a cause of the nationwide decline in SAT scores during the 1970s?

The "Lake Wobegon effect"refers to the effect of teachers? expectations on students? test scores.

A test is legally unfair to a minority group if the mean and variance of the test scores of that group are lower than those of a representative sample of majority-group applicants.

The most accurate conclusion regarding the effects of coaching on SAT scores is that

The Federal Trade Commission?s report on the effects of coaching on SAT scores concluded that these effects are

The primary purpose of program evaluation is to plan strategies for implementing effective programs.

Historical and Professional Matters

Test Design and Construction

Administration and Scoring of Tests

Item Analysis and Standardization of Tests

Reliability and Validity

Intelligence Testing

Individual and Group Differences in Mental Abilities

Neuropsychological Assessment

Standardized Achievement Tests

Testing Special Abilities

Vocational Interests

Attitudes, Values, and Personal Orientations

Personality Assessment: Origins,applications, and Issues

Observations and Interviews

Rating Scales and Checklists

Personality Inventories

Projective Techniques

Appendix A: Measurement and Statistics

Filters