Deck 4: Nonexperimental Methods: Descriptive Methods, Correlational Studies, Ex Post Facto Studies, Surveys and Questionnaires, Sampling, and Basic Research Strategies

Question 1

With archival research,

A) we can make statements about causality under most circumstances.
B) we can make statements about causality when the researcher has exhibited tight control over the variables.
C) we can make statements about causality when the researcher has examined only one variable instead of several.
D) we cannot make statements about causality.

Answer 1

D

Question 2

What are some disadvantages to doing telephone interviewing?

Answer 2

(1) potentially biased sample researcher is unable to evaluate nonverbal behavior of participants

Question 3

Leslie and Charlie observe children on a playground and note instances of aggression displayed by the children. They have engaged in what kind of research?

A) participant observation
B) naturalistic observation
C) ethnography
D) case study

Answer 3

B

Question 4

Which of the following is NOT a potential problem associated with archival research?

A) The records may not be a representative sample.
B) The records may be incomplete.
C) The researcher has no control over how the data were originally collected.
D) It is usually difficult to obtain IRB approval for archival research.

Question 5

The overarching purpose of this research was to assess whether having contact with gay men and lesbians affected attitudes toward gay men and lesbians. Why is this an ex post facto study?

Question 6

According to your text, "You find a research idea when you identify a gap in the current knowledge base…" . What was the gap in the knowledge base, according to the authors?

Question 7

Research methods that do not involve the manipulation of any variables are called

A) inferential research methods.
B) descriptive research methods.
C) one-factor analysis of variance.
D) two-factor analysis of variance.

Question 8

What is the goal of naturalistic observation?

A) To describe behavior as it occurs in a natural setting
B) To describe the variables that are present and the relations among them
C) To understand cause-and-effect relationships
D) Both (a) and (b)

Question 9

Descriptive research methods

A) involve manipulation of one independent variable.
B) involve manipulation of two independent variables.
C) do not involve manipulation of an independent variable.
D) are used to assess causality.

Question 10

How does qualitative research differ from other nonexperimental research, such as descriptive research methods, correlational studies, and surveys?

A) Qualitative research is more likely to involve statistics.
B) Qualitative research is less narrow.
C) Qualitative research is more well regarded by scientists in general.
D) All of the above.

Question 11

The researchers chose to do telephone surveys for this research. Describe some advantages to this approach.

Question 12

What is one potential problem associated with the naturalistic observation method?

A) The setting is very artificial.
B) There are a limited number of independent variables that can be manipulated.
C) The presence of a researcher may alter participants' behavior.
D) Because the researcher is also a participant, he/she may lose objectivity.

Question 13

Salhany and Roig (2004) analyzed course catalogues found on the Internet in order to examine differences in academic misconduct policies across different universities. They conducted a(n)

A) naturalistic observation.
B) participant observation.
C) archival study.
D) ex post facto study.

Question 14

What kind of survey is used in this study: descriptive or analytic? How do you know?

Question 15

When researchers answer their research questions by using data recorded by other individuals, it is called a(n)

A) experiment.
B) naturalistic observation.
C) participant observation.
D) archival study.

Question 16

The criteria for being included as a participant in the study was as follows: (a) have a telephone, (b) be 18 years of age or older, (c) live in the contiguous 48 states, and (d) speak English. Do you think the authors obtained a random sample of such individuals? Why or why not?

Question 17

Would this research be classified as single-strata, cross-sectional, or longitudinal? How do you know?

Question 18

Selective deposit refers to

A) omissions from archival data that are not under the control of the researcher.
B) a research method that does not involve the manipulation of an independent variable.
C) the finding that participants respond differently when they know they are being observed.
D) Research conducted in a natural setting.

Question 19

Archival data can be found

A) in libraries.
B) online.
C) in real life.
D) All of the above.

Question 20

Dana conducts a study in which she compares the graffiti on the walls of male and female restrooms. Dana has conducted an

A) archival study.
B) experiment.
C) ex post facto study.
D) ethnography.

Question 21

____________ sampling refers to observing the same behavior in different situations.

A) Situation
B) Time
C) Event
D) Participant

Question 22

In __________ research, the researcher examines the relationship between two variables.

A) archival
B) systematic
C) correlational
D) qualitative

Question 23

Joe and Sam are coders in an observational study on sex stereotyping in television commercials. When they have finished collecting their data, they should calculate

A) time sampling validity.
B) interobserver validity.
C) time sampling reliability.
D) interobserver reliability.

Question 24

One advantage of situation sampling is that

A) it allows the researcher to be both an observer and a participant.
B) researchers can get in-depth information on one individual.
C) there is increased generalizability.
D) it eliminates the need for independent variables.

Question 25

If there is a positive correlation between number of hours spent studying and exam grades, then the _____ time people spend studying, the _____ their exam grades.

A) more; lower
B) more; higher
C) less; higher
D) None of the above.

Question 26

Why should observational research involve two or more observers?

A) One observer may miss or overlook something.
B) Observers may disagree with each other over what was observed or how it should be categorized.
C) Both (a) and (b) are correct.
D) None of the above.

Question 27

Which of the following is an advantage associated with naturalistic observation?

A) The researcher is also a participant and so can gather more in-depth information.
B) Statements about causality are possible using naturalistic observation.
C) It is easy to manipulate independent variables using naturalistic observation.
D) Naturalistic observation may be the only way to examine certain types of variables.

Question 28

____________ sampling refers to making observations at different time periods.

A) Situation
B) Time
C) Event
D) Participant

Question 29

Abby is conducting an observational study of walking speed by college students between classes. She observes behavior at two time periods in the morning, two in the afternoon, and two in the evening. Abby has engaged in ___________ sampling.

A) situation
B) time
C) qualitative
D) participant

Question 30

If there is a ______ correlation, then the two variables are not related.

A) positive
B) negative
C) zero
D) curvilinear

Question 31

Another name for reactance is

A) the Hawthorne effect.
B) situation sampling.
C) interobserver reliability.
D) pilot testing.

Question 32

Which of the following is NOT a reason why interobserver reliability might be low?

A) Observers were not given clear, precise definitions.
B) The behavior in question can be interpreted by observers in different ways.
C) The observers are fatigued or bored.
D) All of the above are reasons why interobserver reliability might be low.

Question 33

Researchers use correlations to

A) understand cause-and-effect relationships.
B) make predictions.
C) understand the axial coding process.
D) All of the above.

Question 34

Of the following research methods, which is likely the most rigorous in terms of control and statistical analysis?

A) Archival research
B) Naturalistic observation
C) Qualitative research
D) Correlational research

Question 35

The extent to which observers in an observational study agree is referred to as

A) interobserver validity.
B) grounded theory.
C) interobserver reliability.
D) open coding.

Question 36

Participants in the Hawthorne study increased their productivity regardless of whether conditions were optimal or inferior. The reason for this increased productivity was attributed to

A) interobserver reliability.
B) reactance.
C) time sampling.
D) selective deposit.

Question 37

Participants sometimes respond differently when they know they are being observed. This is referred to as

A) reactance.
B) selective deposit.
C) reliability.
D) selective coding.

Question 38

What is a good rule regarding how often observers should agree with each other when conducting observational research?

A) 50% agreement
B) 65% agreement
C) 85% agreement
D) 100% agreement

Question 39

"As the amount of exercising decreases, weight increases." This statement represents a _________ correlation.

A) zero
B) positive
C) negative
D) curvilinear

Question 40

Jasper is conducting an observational study of children's aggressive behavior on playgrounds, and he decides to observe aggressive behavior at five different playgrounds. Jasper has engaged in __________ sampling.

A) situation
B) time
C) qualitative
D) participant

Question 41

James conducts a study on the number of churches and amount of crime and finds a strong positive relationship between the two (in other words, the more churches there are in a location, the more crime there is). What should James conclude?

A) Churches cause crime; therefore, cities should attempt to reduce the number of churches.
B) Committing a crime causes people to go to church more in an effort to atone for their sins.
C) High population density causes both churches and crime to increase in any geographical location.
D) None of the above; it is not appropriate to make causal claims based on correlational data.

Question 42

If you would like to determine the percentage of the population that engages in a particular behavior, you would use a(n) _________ survey.

A) analytic
B) descriptive
C) pilot
D) demographic

Question 43

The defining characteristic of an ex post facto study is that

A) an independent variable has been manipulated.
B) only one person has been selected to be a participant.
C) the variables to be studied are selected after the fact.
D) observation occurs in a laboratory instead of a natural setting.

Question 44

If you would like to determine how variables are related, you would use a(n) ________ survey.

A) analytic
B) descriptive
C) pilot
D) demographic

Question 45

Shaundra gave her new survey to 10 participants to get their reactions to the questions. She then made modifications to the survey and gave it to a larger sample. Shaundra has engaged in

A) archival research.
B) observational research.
C) random sampling.
D) pilot testing.

Question 46

Suppose a survey contains the following item: "Explain in words your opinion on the death penalty." This question represents a(n)

A) Likert-type scale question.
B) multiple choice question.
C) open-ended question.
D) forced alternative question.

Question 47

Jack conducts a study in which he compares men and women in terms of locus of control. Jack has conducted a(n)

A) experimental study.
B) ex post facto study.
C) archival study.
D) case study.

Question 48

When the variables to be studied are selected after they have occurred, the research study is called

A) manipulated.
B) positively correlated.
C) ex post facto.
D) experimental.

Question 49

What should come first when developing a survey or questionnaire?

A) Identify the type of questions to use.
B) Develop instructions for the survey.
C) Decide what type of instrument to use.
D) Determine the relevant demographic data to be collected.

Question 50

Suppose a survey contains the following item: "I am shy when around people I don't know well."
$\begin{array}{ccccc}1 & 2 & 3 & 4 & 5 \\\text { Not at all } & \text { Not very } & \text { Slightly } & \text { Fairly } & \text { Very much }\end{array}$
What kind of question is this?

A) Multiple choice
B) Forced alternative
C) Likert-type scale
D) Open-ended

Question 51

Which of the following types of questions allows the researcher to calculate an average or mean response?

A) open-ended
B) yes-no
C) Likert-type scale
D) forced alternative

Question 52

What does "ex post facto" mean?

A) before the study
B) after the study
C) past due
D) after the fact

Question 53

If on a survey a respondent must select between two alternative responses, it is referred to as a(n) ____________ question.

A) open-ended
B) multiple choice
C) Likert-type scale
D) forced alternative

Question 54

Bess conducts a study in which she measures self-esteem and grade point average in a sample of 50 college students. She hypothesizes that higher self-esteem will be associated with higher grade point average. This research approach is best described as _________ research.

A) archival
B) correlational
C) grounded theory
D) ethnographic

Question 55

Brad develops a survey to examine the extent to which self-esteem is related to alcohol abuse. Brad is using a(n) ________ survey.

A) analytic
B) descriptive
C) pilot
D) demographic

Question 56

Preliminary testing that is done prior to the completion of a research project is known as __________ testing.

A) descriptive
B) pilot
C) analytic
D) Likert

Question 57

Which of the following types of questions allows the researcher to code responses?

A) open-ended
B) yes-no
C) Likert-type scale
D) forced alternative

Question 58

Which of the following is one of the guidelines for writing good survey questions?

A) Questions should use familiar vocabulary.
B) Questions should be lengthy so that participants will be able to understand them better.
C) Questions should be above the reading level of the individuals you intend to test.
D) All of the above.

Question 59

Keisha constructs a survey to determine what percentage of students at her school have experienced a violent crime. Keisha is using a(n) _________ survey.

A) analytic
B) descriptive
C) pilot
D) demographic

Question 60

Which of the following is NOT one of the steps in developing a good survey?

A) Identify the types of questions to use.
B) Pilot test the items.
C) Develop instructions for the survey.
D) Write the items; make sure they are lengthy in order to examine multiple issues at once.

Question 61

Which of the following is NOT a strategy to increase the response rate of mail surveys?

A) Include a prepaid envelope for the return of the completed survey.
B) Send a replacement survey if you have not heard from a participant within 2-3 weeks.
C) The cover letter should give very little information about the study in order to make the survey shorter.
D) Include a statement about the confidentiality of responses.

Question 62

Which of the following represents the BEST way to word this question?

A) "Do you agree that wealthy professional athletes are overpaid?"
B) "Do you agree that professional athletes are overpaid?"
C) "Do you disagree that professional athletes are overpaid?"
D) "Do you believe that professional athletes are overpaid?"

Question 63

Researchers often use a panel of judges to assess the _______ validity of their test items.

A) criterion
B) concurrent
C) content
D) split-half

Question 64

The degree to which the score on a test or inventory corresponds with another measure of the designated trait is known as _________ validity.

A) test-retest
B) concurrent
C) content
D) criterion

Question 65

Interrater reliability is used to determine the __________ validity of a test or inventory.

A) concurrent
B) content
C) criterion
D) test-retest

Question 66

The extent to which test items actually represent the type of material they are supposed to represent refers to ___________ validity.

A) criterion
B) content
C) concurrent
D) interrater

Question 67

All of the following are disadvantages of telephone interviews EXCEPT:

A) Many people screen or block calls from people whom they do not know.
B) The researcher is more likely to obtain a biased sample using a telephone survey than a mail survey.
C) The researcher cannot examine nonverbal behavior of the respondent.
D) It is more difficult to establish rapport over the telephone than in personal interviews.

Question 68

_________ validity is established by comparing the score on a test with future score on another test.

A) Criterion
B) Concurrent
C) Content
D) Split-half

Question 69

Which of the following is an advantage of mail surveys?

A) Mail surveys have a very high response rate compared to other kinds of surveys.
B) Mail surveys can target a particular individual in the household whereas other kinds of surveys cannot.
C) Mail surveys can be sent to a large number of people.
D) All of the above are advantages of mail surveys.

Question 70

Kimberly's new depression scale correlates positively with psychologists' ratings of their patients' depression. Kimberly's depression scale shows high

A) criterion validity.
B) concurrent validity.
C) split-half reliability.
D) interrater reliability.

Question 71

All of the following are advantages of personal interviews EXCEPT:

A) There is a high response rate.
B) The researcher can ensure that the questions are answered in the correct order.
C) The researcher can answer questions for the respondents.
D) Data collection is usually very fast compared to other methods.

Question 72

Which of the following is an advantage of telephone interviews?

A) It is easy to create a random sample.
B) The response rate for telephone interviews is higher than the response rate for personal interviews.
C) There is virtually no possibility of a biased sample because the vast majority of people in the U.S. have telephones of some kind.
D) All of the above are advantages of telephone interviews.

Question 73

Which of the following is NOT a disadvantage of mail surveys?

A) The researcher cannot be sure who actually fills out the survey.
B) Response rates are usually low.
C) Researchers cannot send out a large number of surveys.
D) Participants may not answer questions in the order in which they appear on the survey.

Question 74

____________ reliability measures agreement between judges on a test item, whereas ____________ reliability measures agreement between observers of behavior.

A) Interrater; interobserver
B) Interobserver; interrater
C) Interrater; interrater
D) Interobserver; interobserver

Question 75

Researchers have found that SAT scores predict first-semester grade point average. This demonstrates _________ validity.

A) criterion
B) concurrent
C) content
D) split-half

Question 76

________ refers to the extent to which a test measures what it is supposed to measure.

A) Test-retest reliability
B) Interrater reliability
C) Split-half reliability
D) Validity

Question 77

Dale wants to ensure that he has a high response rate for his survey. Which method would be best?

A) Mail survey
B) Personal interview
C) Telephone interview
D) Demographic interview

Question 78

Veronica intended to develop a test to measure locus of control, but it actually measures self-esteem. Veronica's test has low

A) test-retest reliability.
B) validity.
C) interrater reliability.
D) split-half reliability.

Question 79

"What is your age?" This question falls under the category of ________ data.

A) demographic
B) Likert-type scale
C) analytic
D) split-half

Question 80

All of the following are disadvantages of personal interviews EXCEPT:

A) Personal interviews involve a great deal of time.
B) There is a possibility of interviewer bias.
C) There is a possibility of danger to the interviewer.
D) There is a low response rate.