Deck 14: Multiple Regression and Model Building

Question 1

Regression models that employ more than one independent variable are referred to as multiple regression models.

Answer 1

True

Question 2

For the same point estimate of the dependent variable and the same level of significance,the confidence interval is always wider than the corresponding prediction interval.

Answer 2

False

Question 3

When the quadratic regression model y = β₀ + β₁x + β₂x² + ε is used,the term β₁ shows the rate of curvature of the parabola.

Answer 3

False

Question 4

The assumption of independent error terms in regression analysis is often violated when using time-series data.

Question 5

If we are predicting y when the values of the independent variables are x₀₁,x₀₂,... ,x_0k,the farther the values of x₀₁,x₀₂,... ,x_0k are from the center of the observed data,the smaller the distance value and the more precise the associated confidence and prediction intervals.

Question 6

Because multiple regression models consist of multiple independent variables,residual analysis cannot be performed.

Question 7

In a multiple regression mode,if the largest variance inflation factor (VIF)is 21.6,then it can be concluded that there are indications of multicollinearity.

Question 8

Testing the contribution of individual independent variables with t tests is performed prior to the F test for the model in multiple regression analysis.

Question 9

The normal plot is a residual plot that checks the normality assumption.

Question 10

An application of the multiple regression model generated the following results involving the F test of the overall regression model: p-value = .0012,R² = .67,and s = .076.Thus,the null hypothesis,which states that none of the independent variables are significantly related to the dependent variable,should be rejected at the .05 level of significance.

Question 11

In a regression model,a value of the error term depends upon other values of the error term.

Question 12

In comparing regression models,the regression model with the largest R² will also have the smallest standard error (s).

Question 13

The multiple correlation coefficient can assume any value between zero and 1,inclusive.

Question 14

Even when an unimportant variable is added to a regression model,the explained variation will increase.

Question 15

In a regression model,at any given combination of values of the independent variables,the population of potential error terms is assumed to have an F distribution.

Question 16

In a multiple regression analysis,if the normal probability plot exhibits approximately a straight line,then it can be concluded that the assumption of normality is not violated.

Question 17

A t test is used in testing the significance of an individual independent variable.

Question 18

When the F test is used to test the overall significance of a multiple regression model,if the null hypothesis is rejected,it can be concluded that all of the independent variables x₁,x₂,... ,x_k are significantly related to the dependent variable y.

Question 19

The error term in the regression model describes the effects of all factors other than the independent variables on y (response variable).

Question 20

The variance inflation factor measures the relationship between the dependent variable and the rest of the independent variables in the regression model.

Question 21

Using squared and interaction variables in a multiple regression model results in extreme multicollinearity.

Question 22

A multiple regression analysis with 20 observations on each of three independent variables and the dependent variable would yield ______ and _______ degrees of freedom,respectively,for regression (explained)and error.

A)3,17
B)3,16
C)4,16
D)3,19
E)3,20

Question 23

The range of feasible values for the multiple coefficient of determination is from ________.

A)
B)-1 to 0
C)-1 to 1
D)0 to 1
E)

Question 24

When using a multiple regression model,we assume that error terms (residuals)are distributed according to a(n)________________ distribution.

A)Binomial
B)Normal
C)Exponential
D)Poisson

Question 25

A partial F test is used to assess when at least one variable in a subset of squared and interaction variables in the multiple regression model is significant.

Question 26

If a particular multiple regression model has a small value of the C statistic and C for this model is less than k + 1,where k is the number of independent variables in the model,then the model should be considered biased and therefore undesirable.

Question 27

In contrast to stepwise regression,backward elimination is an iterative model selection procedure that begins with all potential independent variables and then attempts to remove them one at a time based on the p-value of the independent variable.

Question 28

If it is desired to include marital status in a multiple regression model by using the categories single,married,separated,divorced,and widowed,what will be the effect on the model?

A)One more independent variable will be included.
B)Two more independent variables will be included.
C)Three more independent variables will be included.
D)Four more independent variables will be included.
E)Five more independent variables will be included.

Question 29

In multiple regression analysis,the mean square regression divided by mean square error yields the _________.

A)Standard error
B)F statistic
C)R²
D)
E)t statistic

Question 30

The graph of the prediction equation obtained from the model is a(n)__________.

A)Line
B)Plane
C)Parabola
D)Exponential curve

Question 31

In multiple regression analysis,the explained sum of squares divided by the total sum of squares yields the __________.

A)Standard error
B)F statistic
C)R²
D)
E)t statistic

Question 32

In multiple regression analysis,which one of the following is the appropriate notation for error (residual)?

A)Option A
B)Option B
C)Option C
D)Option D
E)Option E

Question 33

The mean square error of a multiple regression model with k independent variables and n observations is __________.

A)SSE/n
B)SSE/[n + (k + 1)]
C)SSE/[n - (k + 1)]
D)SSE/(k + 1)

Question 34

Which of the following is not an assumption of the multiple linear regression model?

A)Independent error terms.
B)Population of error terms has a normal distribution.
C)Populations of error terms observed at different combinations of values of the independent variable (x₁,x₂,... ,x_k)have equal variances.
D)The level of measurement of the data for the dependent variable is at least ordinal.
E)At any combination of values of x₁,x₂,... ,x_k,the population of potential error term values has a mean equal to zero.

Question 35

For a given multiple regression model with three independent variables,the value of the adjusted multiple coefficient of determination is _________ less than R².

A)Always
B)Sometimes
C)Never

Question 36

It is appropriate to use an interaction variable if the relationship between the dependent variable and one of the independent variables depends on the value of the other independent variable.

Question 37

The range of feasible values for the multiple coefficient of correlation is from ________.

A)
B)-1 to 0
C)-1 to 1
D)0 to 1
E)

Question 38

Backward elimination regression is an automatic model-building procedure.

Question 39

An investigator hired by a client suing for sex discrimination has developed a multiple regression model for employee salaries for the company in question.In this multiple regression model,the salaries are in thousands of dollars.For example,a data entry of 35 for the dependent variable indicates a salary of $35,000.The indicator (dummy)variable for gender is coded as X₁ = 0 if male and X₁ = 1 if female.The computer output of this multiple regression model shows that the coefficient for this variable (X₁)is -4.2.The t test showed that X₁ was significant at α = 0.1.This result implies that for male and female workers of the company,

A)On the average,females earn $4200 less.
B)On the average,males earn $4200 less.
C)On the average,salaries do not differ.
D)On the average,males have 4.2 more years of experience.
E)On the average,females have 4.2 more years of experience.

Question 40

The multiple coefficient of determination is the _______ divided by the total variation.

A)Unexplained variation
B)SSE
C)Explained variation
D)Distance value
E)Leverage value

Question 41

The y-intercept (β₀)in a multiple regression model represents the estimated value of the __________ variable,when the value of all independent variables are _________.

A)Response,one
B)Dummy,zero
C)Response,zero
D)Dummy,one

Question 42

Which of the following residual plots is not used in regression analysis?

A)Residuals vs.parameter estimates
B)Residuals vs.values of an independent variable
C)Residuals vs.time order
D)Residuals vs.predicted values of the dependent variable
E)Standardized residuals vs.predicted values of the dependent variable

Question 43

Which one of the following is not an assumption about the residuals in a regression model?

A)Constant variance
B)Independence
C)Normality
D)Variance of zero
E)Mean of zero

Question 44

Assumptions of a regression model can be evaluated by plotting and analyzing the ____________.

A)independent variables
B)dependent variables
C)error terms
D)beta values

Question 45

Dummy variables take on the values of _________ and are used to model the effects of different levels of qualitative variables.

A)1 or -1
B)1 or 2
C)0 or 2
D)0 or 1

Question 46

In multiple regression analysis,a desirable residual plot has what type of appearance?

A)Curved
B)Cyclical
C)Fanning out
D)Funneling in
E)Horizontal band

Question 47

In regression analysis,the standard error (s)is _________ greater than the standard deviation of y (the dependent variable).

A)Always
B)Sometimes
C)Never

Question 48

The multiple _________ measures the proportion of the variation in y (response variable)explained by the multiple regression model or the set of independent variables included in the multiple regression equation.

A)Correlation coefficient
B)Coefficient of determination
C)Total variation
D)Standard error
E)F test

Question 49

R² is defined as:

A)Total variation/explained variation.
B)Explained variation/total variation.
C)Unexplained variation/explained variation.
D)Unexplained variation/total variation.

Question 50

In a multiple regression analysis,if the normal probability plot ____________,then it can be concluded that the assumption of normality is not violated.

A)Is a straight line
B)Has the shape of a symmetric bell-shaped curve
C)Is greatly curved
D)Is left skewed
E)Has the shape of a parabola that opens upward

Question 51

Which one of the following tools is not used to check the normality of residuals assumption for a multiple regression model?

A)Histogram
B)Stem-and-leaf display
C)Scatter diagram
D)Normal plot

Question 52

The ____________ term describes the effects on y of all factors other than the independent variables in a multiple regression model.

A)Dependent
B)t test
C)Error
D)Dummy

Question 53

Dummy or indicator variables typically are values of zero or one,and are used to model the effects of different levels of ___________ variables.

A)Qualitative
B)Quantitative
C)Ratio
D)Measured

Question 54

An acceptable residual plot exhibits:

A)Increasing error variance.
B)Decreasing error variance.
C)Constant error variance.
D)A curved pattern.
E)A mixture of increasing and decreasing error variance.

Question 55

If we are testing the significance of the independent variable X₁ and we reject the null hypothesis H₀: β₁ = 0,we conclude that:

A)X₁ is significantly related to y.
B)X₁ is not significantly related to y.
C)X₁ is an unimportant independent variable.
D)β₁ is significantly related to the dependent variable y.

Question 56

The general form of the quadratic multiple regression models is:

A)y = β₁x₁ + β₂x₂ + ε
B)y = β₀ + β₁x₁ + β₂x₂ + ε
C)y = β₀ + β₁x + β₂x² + ε
D)y = β₀ + β₁x² + ε
E)y = β₀ + β₁x₁ + β₂x₂² + ε

Question 57

In a multiple regression model,the residuals were plotted against the values of one of the independent variables.The plot exhibited a funneling out pattern of residuals.This means that as the value of the independent variable increases,the error terms tend to ___________ and the model assumption of __________ is violated.

A)increase,constant variance
B)increase,independence
C)decrease,constant variance
D)decrease,normality

Question 58

In using the multiple regression method,we can model the effects of the different levels of a qualitative independent variable by using a(n)____________.

A)Interaction variable
B)Cross-product term
C)Quadratic term
D)Dummy (indicator)variable
E)Variance equalizing transformation

Question 59

Plotting the residuals in a time-ordered sequence will reveal possible violations of the __________ of error terms assumption.

A)Normality
B)Independence
C)Constant variation
D)Residual sum

Question 60

The effects of different levels of qualitative independent variables are described using ___________ variables.

A)Dependent
B)Response
C)Dummy
D)Quantitative

Question 61

As we increase the number of independent variables in a multiple regression model,the F statistic will __________ increase.

A)Always
B)Sometimes
C)Never

Question 62

In using a regression model,if a new independent variable is added,the value of R² (the coefficient of multiple determination)will ___________ decrease.

A)Always
B)Sometimes
C)Never

Question 63

Adding any independent variable to a regression model will increase ____________.

A)
B)s
C)MSE
D)R²
E)The length of all prediction intervals

Question 64

Significant _________ may exist when the overall F statistic is significant and the individual t statistics for all independent variables are insignificant.

A)Autocorrelation
B)Independence
C)Multicollinearity
D)Outliers

Question 65

If a regression model with k independent variables has a C statistic less than _______,then the model is considered to be desirable.

A)k + 1
B)k
C)k - 1
D)1/k
E)k - 2

Question 66

In the quadratic regression model the β₁ term represents the:

A)Rate of curvature of the parabola.
B)Value of Y when X is zero.
C)Shift parameter of the parabola.
D)Y-intercept of the parabola.

Question 67

If the simple correlation coefficient between two independent variables is greater than .90,then ______________________ is considered to be severe.

A)autocorrelation
B)interaction
C)multicollinearity
D)coefficient of determination

Question 68

In the quadratic regression model if the term β₂ is ___________ zero,then the parabola opens ____________.

A)Less than,upward
B)Greater than,upward
C)Greater than,either upward or downward
D)Less than,either upward or downward
E)Equal to,downward

Question 69

In general,a multiple regression model is considered to be desirable if the value of the C statistic is small and the value of C is less than _____.

A)k
B)k - 1
C)k + 1
D)n - k

Question 70

Multicollinearity is severe if the largest variance inflation factor (VIF)is greater than _____.

A)100
B)5
C)10
D)1

Question 71

___________ is an iterative variable selection procedure that allows an independent variable to be added to a multiple regression model in one iteration and deleted during the next iteration.

A)Logistic regression
B)Stepwise regression
C)Quadratic regression
D)Backward regression

Question 72

Given the regression model y = β₀ + β₁x₁ + β₂x₂ + β₃x₁² + β₄x₂² + ε,if we wish to test the significance of higher-order terms (x₁² and x₂²),we would use the following test.

A)Overall F test
B)Durbin-Watson test
C)Partial F test
D)t test
E)Cook's distance measure

Question 73

The primary use of stepwise regression is to identify the most important ___________ that should be included in the multiple regression model.

A)Independent variables
B)Dependent variables
C)Dummy variables
D)Quadratic variables

Question 74

Stepwise regression uses a series of ___________ tests during each iteration in order to determine which independent variables should be brought into the regression model.

A)C
B)Chi-square
C)t or F
D)VIF

Question 75

The graph of the prediction equation obtained from the model is a(n)____________.

A)Line
B)Plane
C)Parabola
D)Exponential curve

Question 76

In the quadratic regression model the β₂ term represents the:

A)Rate of curvature of the parabola.
B)Value of Y when X is zero.
C)Shift parameter of the parabola.
D)Y-intercept of the parabola.

Question 77

In a multiple regression analysis,the current model has three independent variables.The analyst decides to add another (fourth)independent variable while retaining the other three independent variables.As a result of this addition,the value of MSE will ____________ decrease.

A)Always
B)Sometimes
C)Never

Question 78

In a multiple regression model,we can conclude that multicollinearity exists if the average variance inflation factor is substantially greater than _____.

A)100
B)5
C)10
D)1

Question 79

If a multiple regression model has a(n)____________ statistic substantially greater than k + 1,then it can be shown that this model has substantial bias and is undesirable.

A)C
B)F
C)Cook's distance
D)Durbin-Watson

Question 80

A very insignificant independent variable (an independent variable that has a very weak relationship with the dependent variable)is added to a multiple regression equation.As a result of this change,the value of the explained variation (SSR)will _________,the value of the multiple coefficient of determination (R²)will _________,and the calculated value of the F statistic will most likely _________.

A)Decrease,increase,decrease
B)Increase,decrease,decrease
C)Increase,increase,increase
D)Increase,increase,decrease
E)Decrease,decrease,decrease