Deck 9: Evaluation of Training

Question 1

Which of the following statements regarding process evaluation is true?

A)The training manager is always interested in this data.
B)It is not that important to gather such information for a one- time half-day seminar.
C)Trainees are not interested in this data.
D)Only newer trainers are interested in this type of data.

Answer 1

C

Question 2

Scripted situations are a

A)Process for assessing learning.
B)Process for training interpersonal skills.
C)Process for assessing transfer of training to the job.
D)Means of measuring attitudes.

Answer 2

C

Question 3

If the training was designed to teach trainees how to use the new forms that were developed by Human Resources, you can expect to measure this transfer of training

A)In about 6 months.
B)In about 3 weeks.
C)It is not necessary if learning was indicated to have occurred.
D)A few days after training.

Answer 3

D

Question 4

What are the outcome levels of evaluation identified in the text?

A)Proactive and reactive
B)Cost benefit and cost effectiveness
C)Reaction, learning, behavior, and organizational results
D)Utility, value, and evaluative

Question 5

Which of the following statements is true regarding the evaluation of transfer of training?

A)It is often more difficult to assess than organizational results.
B)The evaluation needs to take place a few weeks after training, before forgetting becomes a possibility.
C)Attitude change needs to be measured using well-developed instruments.
D)It is useful to ask coworkers if they have noted the specific change in behavior.
E)C & D

Question 6

According to the text, which of the following groups would be interested in "process evaluation" data?

A)Trainers (including trainer doing the training)
B)Trainees
C)Trainees' supervisor
D)Both A & B
E)All of the above

Question 7

_____ are measures of the trainee's perceptions, emotions, and subjective evaluations of the training experience.

A)Reaction outcomes
B)Learning outcomes
C)Job behavior outcomes
D)Organizational results
E)Value outcomes

Question 8

Outcome evaluation determines

A)The learning outcomes.
B)How well the training accomplished its goals.
C)How well the trainer covered the objectives.
D)None of the above.

Question 9

Which of the following statements is true regarding learning outcomes?

A)There are two main categories, knowledge and skill.
B)To assess knowledge, you will need to develop a knowledge test.
C)Learning must be determined within the first 2 weeks after training.
D)It is sometimes useful to assess learning periodically during training.

Question 10

Which kind of analysis compares the monetary cost of training with the intangible or nonmonetary results?

A)Cost saving
B)Cost effectiveness
C)Cost benefit
D)All of the above

Question 11

Which of the following times is best for providing the opportunity to complete a reaction questionnaire?

A)During training (after each segment)
B)Immediately following training
C)One or two months after training
D)A or B, depending on what information you are after
E)A, B, or C, depending on what information you are after

Question 12

Research has shown the relationship between reaction, learning, behavior and results is

A)Strongly correlated.
B)Weakly correlated.
C)Evidence is mixed.
D)None of the above.

Question 13

Which of the following statements concerning reaction questionnaires is NOT true?

A)They are used to determine what trainees thought about training.
B)There are two classifications of reaction questionnaires.
C)Utility reaction questionnaires reflect the trainee's belief about the value of the training.
D)All of the above are true.

Question 14

Which of the following are reasons usually given by managers for not evaluating training?

A)Nothing to evaluate
B)Too complex a job
C)No one cares about the evaluation
D)Both A & C
E)All of the above

Question 15

What are the inputs into the evaluation phase of training?

A)Evaluation strategy and design
B)Evaluation objectives and design issues
C)Organizational constraints
D)B & C
E)A & C

Question 16

Training was developed to improve productivity.When assessing training's effectiveness at the organizational results level, which of the following would be the most appropriate thing to focus your attention on?

A)Organizational profitability
B)Work unit productivity
C)Market share
D)Corporate strategy
E)All of the above

Question 17

Evaluation of the _____ examines how the training was carried out._____ evaluation determines if training accomplished its _____.

A)Process; Outcome; Objectives
B)Objectives; Process; Task
C)Outcome; Task; Goals
D)Design; Implementation; Strategy

Question 18

Which of the following categories should be included in a reaction questionnaire?

A)Relevance of training
B)Training content
C)Trainer's behavior
D)Both A & B
E)A, B, & C

Question 19

Which of the following is NOT obtained from a reaction questionnaire?

A)Facilities issues
B)Trainer issues
C)Amount of learning
D)Perceived value of training
E)Relevance of training

Question 20

Cost effectiveness evaluation _____.

A)Compares the monetary costs of training to the financial benefits accrued from training
B)Compares the monetary costs of training to the nonmonetary benefits from training
C)Compares the social costs of training to the financial benefits accrued from training
D)Compares the monetary costs of trainers to the financial benefits accrued from training
E)Compares the monetary costs and nonmonetary costs of training to the financial benefits accrued from training

Question 21

_______The ultimate reason for training is organizational results.

Question 22

______To assess a change in attitude toward teamwork after training, simply ask trainees if they feel more positive toward teamwork.

Question 23

____The trainees are very interested in obtaining the process evaluation data.

Question 24

Which of these statements is true regarding small business?

A)It might not be necessary to evaluate training.
B)If the training costs were significant, evaluation can be of value.
C)Much of the training in a small business is OTJ.
D)All of the above are true.

Question 25

Each of the following statements states a weakness with the evaluation techniques presented in the text; which of the statements is NOT true?

A)Posttest only - there could be a number of other competing causes for any change.
B)Pretest/posttest - it is difficult to determine the impact of training on any changes that occur.
C)Posttest only with control group - results may not generalize to other groups
D)Pretest/posttest with control group - threats to external validity are still a concern.
E)All of the above are true.

Question 26

_______An inexpensive but effective way to determine if training transferred to the job is to ask trainees in a reaction questionnaire.

Question 27

____The best time to determine if the training transferred to the job is 2 months after training

Question 28

The authors suggest that when assigning trainees to a control group or trained group, the best method to use is

A)Sampling.
B)Representative sampling.
C)Random assignment.
D)Random selection.

Question 29

The confidence that evaluation findings will generalize to others who undergo the training is known as

A)History.
B)Maturation.
C)Internal validity.
D)External validity.
E)Testing.

Question 30

____To be of any value, the reaction questionnaire must be administered right after training.

Question 31

Which of the following is NOT listed as a threat to internal validity?

A)Maturation
B)Testing
C)Instrumentation
D)Statistical regression
E)Reaction to evaluation

Question 32

____For organizational results measures, you can often use the data obtained in the original TNA as the pre measure.

Question 33

The training manager is likely interested in which of the evaluation outcomes?

A)Reaction, learning, and behavior
B)Reaction, learning, behavior, and results
C)Learning and behavior
D)Behavior and results
E)None of the above

Question 34

Utility analysis is a

A)Measure of learning.
B)Method of estimating overall value of training based on the trainee's change in behavior.
C)Simplified method of cost/benefit analysis.
D)A cost-savings analysis.

Question 35

Name the design that fits the following description - Multiple measures of performance are taken and each group receives training, but at different points in time.

A)Multiple baseline design
B)Solomon's time series design
C)Group 4-time series design
D)Solomon's multiple baseline series design

Question 36

A group of similar employees who do not receive the training is called the

A)Random assignment group.
B)Factor analysis assignment.
C)Neutral group.
D)Control group.

Question 37

The confidence you have that the results of the evaluation are in fact correct is called

A)Validity.
B)External validity.
C)Internal validity.
D)General validity.
E)History validity.

Question 38

When is the best time to evaluate training?

A)Immediately after training
B)A few days after training
C)3-6 months after training
D)It depends on each organization

Question 39

When the number of employees being trained is small, Blanchard & Thacker recommend which of the following evaluation designs?

A)Do not evaluate; it is not cost effective
B)Posttest only
C)Single case designs
D)Multiplecase designs

Question 40

Upper management's interest in "outcome evaluation" data is focused on

A)Learning behavior and results.
B)Behavior and results.
C)Perhaps an interest in behavior and a definite interest in results.
D)No interest in any level.

Question 41

_____ It is always best to evaluate training using all three levels of evaluation.

Question 42

Describe the cost benefit evaluation and cost effectiveness evaluation methods of evaluating whether training was "worth it."

Question 43

____You must always have a pretest to compare your posttest to in a well-designed evaluation.

Question 44

Define internal and external validity and explain five threats to internal validity and two threats to external validity.

Question 45

Explain the four types of evaluation outcomes identified in the text.

Question 46

Briefly discuss the reasons and counter reasons for not evaluating training programs

Question 47

Describe the three kinds of knowledge that can be evaluated in training and how they can be measured.

Question 48

_____In organizations, random assignment is the method to use when placing individuals in the control group and trainee group

Question 49

____Maturation refers to the events other than training that take place concurrently with the training program.

Question 50

______ A cost/ benefit evaluation compares the monetary cost of training with the non-monetary benefits.