Deck 10: VG Psychometric Meta-Analysis Copy

Question 1

The development of validity generalization procedures in the mid to late 1970s were primarily concerned with dispelling the conventional wisdom up to that point in time with regard to the ________.

A) null hypothesis
B) hypothesis of limitations
C) situation specificity hypothesis
D) use of statistical significance testing

Answer 1

C

Question 2

In a bare-bones validity generalization study, the researcher typically only corrects for _______.

A) sampling error
B) restriction of range
C) unreliability
D) dichotomization

Answer 2

A

Question 3

Validity generalization procedures summarize which of the following types of validity estimates?

A) content
B) construct
C) synthetic
D) criterion-related

Answer 3

D

Question 4

If statistical artifacts account for less than _______ of the variance of validity coefficients across studies, then moderator analysis should be conducted.

A) 25%
B) 75%
C) 50%
D) 95%

Question 5

According to Shultz, Whitney, and Zickar (2021), Module 10, a major goal of most meta-analytic studies is to _________.

A) determine the reliability of each data point
B) decide on which moderators will be most relevant to investigate
C) obtain the most accurate point estimate of the population parameter possible
D) identify the major theories and concepts to be studied as part of an M-A project

Question 6

The next step in the meta-analysis process after developing a coding scheme and rules for coding the studies is to _________.

A) analyze the data
B) code the study characteristics
C) train the coders and check for inter-coder accuracy
D) draw conclusions regarding the effects and any moderators

Question 7

Hypotheses about potential moderators in a meta-analytic study are typically formulated __________.

A) at the very beginning
B) after the first round of study coding
C) after the initial round of analyzing the results
D) not until the very end of the process when final results are determined

Question 8

When compiling studies for a meta-analysis is it best to ________.

A) manually search only the relevant journals
B) search for both unpublished and published studies
C) only use studies published within the last 10 years or so
D) use all possible published studies, regardless of when they were published

Question 9

If we wanted to conduct a meta-analysis to compare two groups, the most appropriate statistic to use would be the ________ statistic.

A) r
B) d
C) z
D) x

Question 10

If two sets of competent researchers, experienced in conducting meta-analytic studies, conducted a meta-analysis study on the same set of data, but then came to different conclusions, the most likely reason why would be because one set of researchers ___________.

A) were not precise enough
B) didn't code the studies properly
C) must have made a computational error
D) made different judgment calls at various decisions points

Question 11

Briefly discuss and distinguish the difference between meta-analysis and psychometric meta-analysis?

Question 12

What is the difference between a confidence interval (CI) and a credibility interval (CRI) when conducting a meta-analysis?

Question 13

Outline the major steps you would need to engage in in order to conduct a meta-analytic study?

Question 14

Assume you wanted to carry out a meta-analysis study to examine the relationship between job satisfaction and employee engagement. What is the best way to get started in conducting this study?

Question 15

What is the difference between validity generalization and meta-analysis ?