Question 1

Which type of study design will you use for this research? How will it differ from a classical experiment and why? How will this affect the validity of your results?

Accepted Answer

See pages 211-216. Use Box 8.3 to help you choose a study design. Effects on validity:
F1F1F1S1F1F1F10No control group: cannot rule out plausible alternatives in determining causality, and can't know the true size of effects
F1F1F1S1F1F1F10Naturally occurring groups: bias in the composition of groups, the effect may be exaggerated or minimized, and can't know the extent of the effect of this bias on the results
F1F1F1S1F1F1F10No pretest: least damaging to validity
F1F1F1S1F1F1F10The more your design deviates from the classical experiment (combining these), the less valid the results

Question 2

What are the threats to internal validity, and how would you try to minimize them?

Accepted Answer

Threats to internal validity refer to factors that can affect the accuracy of the results of an experiment or study. Some common threats to internal validity include history, maturation, testing, instrumentation, regression to the mean, selection bias, and experimental mortality.

To minimize these threats, researchers can employ various strategies. For example, they can use random assignment to ensure that participants are equally distributed across different conditions, which can help minimize selection bias. They can also use control groups to account for the effects of history and maturation, and counterbalancing to control for the effects of testing and instrumentation. Additionally, researchers can use statistical techniques such as analysis of covariance to control for potential confounding variables and reduce the impact of regression to the mean.

Overall, minimizing threats to internal validity requires careful planning, rigorous methodology, and thoughtful consideration of potential confounding variables. By addressing these threats proactively, researchers can increase the internal validity of their studies and enhance the reliability of their findings.

Question 3

How will you assign subjects to research groups? Why? What are the pros and cons of this approach?

Accepted Answer

Assigning subjects to research groups can be done in a variety of ways, but the most common methods include random assignment, matched pairs, and stratified random sampling. Each approach has its own advantages and disadvantages, and the best method will depend on the specific research question and the characteristics of the subjects being studied.

Random assignment is often considered the gold standard for assigning subjects to research groups because it helps to ensure that the groups are comparable at the outset of the study. This approach minimizes the potential for bias and allows researchers to make causal inferences about the effects of the independent variable on the dependent variable. However, random assignment may not always be feasible or ethical, especially in cases where certain subjects may be at higher risk for harm or where it is not possible to control for all relevant variables.

Matched pairs and stratified random sampling are alternative approaches that can help to address some of the limitations of random assignment. Matched pairs involves pairing subjects based on specific characteristics and then randomly assigning one member of each pair to the treatment group and the other to the control group. This approach can help to ensure that the groups are balanced with respect to important variables, but it may be more time-consuming and difficult to implement than simple random assignment. Stratified random sampling involves dividing the population into subgroups based on certain characteristics and then randomly selecting subjects from each subgroup to ensure that the groups are representative of the population as a whole. This approach can help to ensure that the groups are balanced with respect to important variables, but it may also be more complex and resource-intensive than simple random assignment.

In conclusion, the best approach for assigning subjects to research groups will depend on the specific research question and the characteristics of the subjects being studied. Random assignment is often considered the gold standard, but matched pairs and stratified random sampling can also be valuable alternatives in certain situations. Ultimately, researchers must carefully consider the pros and cons of each approach and choose the method that is most appropriate for their study.

Question 4

Identify the independent and dependent variables in your hypotheses.

Accepted Answer

The answer of Identify the independent and dependent variables in...

Question 5

What steps would you take to prepare for data collection?

Accepted Answer

The answer of What steps would you take to prepare...

Question 6

How would you try to diminish the attrition rate? How will it affect your results if the rate is high?

Accepted Answer

The answer of How would you try to diminish the...

Question 7

Will informed consent be needed for your study? Why or why not?

Accepted Answer

The answer of Will informed consent be needed for your...

Question 8

Classical experiments are done in laboratories because researchers can better control ______.

Accepted Answer

A)   the treatment
B)   the effects
C)   outside influences
D)   validity

Question 9

How will you assign subjects to research groups? Why? What are the pros and cons of this approach?

Accepted Answer

The answer of How will you assign subjects to research...

Question 10

How will you ensure quality control in your data collection procedures?

Accepted Answer

The answer of How will you ensure quality control in...

Question 11

How will you ensure quality control in your data collection procedures?

Accepted Answer

The answer of How will you ensure quality control in...

Question 12

You are conducting experimental evaluation research on a Dealing with Divorce support group. Write a research question for this research project.

Accepted Answer

The answer of You are conducting experimental evaluation research on...

Question 13

You are conducting evaluation research, studying the effects of a city ordinance that recently went into effect that prohibits people from sitting or sleeping on sidewalks in the downtown area. The ordinance is intended to reduce the number of homeless people in the city. You want to see how it has affected the daily routines of the local homeless people. Write a research question for this research project.

Accepted Answer

The answer of You are conducting evaluation research, studying the...

Question 14

How will you ensure quality control in your data collection procedures?

Accepted Answer

The answer of How will you ensure quality control in...

Question 15

Write four hypotheses for your research question.

Accepted Answer

The answer of Write four hypotheses for your research question....

Question 16

What other ethical issues might be likely to arise in conducting this research?

Accepted Answer

The answer of What other ethical issues might be likely...

Question 17

How would you try to diminish the attrition rate? How will it affect your results if the rate is high?

Accepted Answer

The answer of How would you try to diminish the...

Question 18

Classical studies are typically done in laboratories. When we do evaluation research in real-life settings, what can happen?

Accepted Answer

A)   Your results are invalid if all forms of bias were not able to be ruled out.
B)   Your study could become nonreplicable, and thus meaningless.
C)   You may not be able to conclude that your results were caused by the treatment and not by something else.
D)   Your research may be deemed unethical if it affects anyone other than your subjects.

Question 19

Will informed consent be needed for your study? Why or why not?

Accepted Answer

The answer of Will informed consent be needed for your...

Question 20

How will you draw a sample of participants for your research? Why?

Accepted Answer

The answer of How will you draw a sample of...

Exam 8: Experiments for Evaluation Research

Which type of study design will you use for this research? How will it differ from a classical experiment and why? How will this affect the validity of your results?

What are the threats to internal validity, and how would you try to minimize them?

How will you assign subjects to research groups? Why? What are the pros and cons of this approach?

Identify the independent and dependent variables in your hypotheses.

What steps would you take to prepare for data collection?

How would you try to diminish the attrition rate? How will it affect your results if the rate is high?

Will informed consent be needed for your study? Why or why not?

Classical experiments are done in laboratories because researchers can better control ______.

How will you assign subjects to research groups? Why? What are the pros and cons of this approach?

How will you ensure quality control in your data collection procedures?

How will you ensure quality control in your data collection procedures?

You are conducting experimental evaluation research on a Dealing with Divorce support group. Write a research question for this research project.

How will you ensure quality control in your data collection procedures?

Write four hypotheses for your research question.

What other ethical issues might be likely to arise in conducting this research?

How would you try to diminish the attrition rate? How will it affect your results if the rate is high?

Classical studies are typically done in laboratories. When we do evaluation research in real-life settings, what can happen?

Will informed consent be needed for your study? Why or why not?

How will you draw a sample of participants for your research? Why?