Exam 15: Multiple Regression Model Building

TABLE 15-4 The superintendent of a school district wanted to predict the percentage of students passing a sixth-grade proficiency test. She obtained the data on percentage of students passing the proficiency test (% Passing), daily average of the percentage of students attending class (% Attendance), average teacher salary in dollars (Salaries), and instructional spending per pupil in dollars (Spending) of 47 schools in the state. Let Y = % Passing as the dependent variable, X₁ = % Attendance, X₂ = Salaries and X₃ = Spending. The coefficient of multiple determination (R_j ²) of each of the 3 predictors with all the other remaining predictors are, respectively, 0.0338, 0.4669, and 0.4743. The output from the best-subset regressions is given below: Following is the residual plot for % Attendance: Following is the output of several multiple regression models: Model (I): Model (II): Model (III): -Referring to Table 15-4, the residual plot suggests that a nonlinear model on % attendance may be a better model.

TABLE 15-5 What are the factors that determine the acceleration time (in sec.) from 0 to 60 miles per hour of a car? Data on the following variables for 171 different vehicle models were collected: Accel Time: Acceleration time in sec. Cargo Vol: Cargo volume in cu. ft. HP: Horsepower MPG: Miles per gallon SUV: 1 if the vehicle model is an SUV with Coupe as the base when SUV and Sedan are both 0 Sedan: 1 if the vehicle model is a sedan with Coupe as the base when SUV and Sedan are both 0 The regression results using acceleration time as the dependent variable and the remaining variables as the independent variables are presented below. ANOVA The various residual plots are as shown below. The coefficient of partial determination ( ) of each of the 5 predictors are, respectively, 0.0380, 0.4376, 0.0248, 0.0188, and 0.0312. The coefficient of multiple determination for the regression model using each of the 5 variables as the dependent variable and all other X variables as independent variables ( ) are, respectively, 0.7461, 0.5676, 0.6764, 0.8582, 0.6632. -Referring to Table 15-5, the error appears to be right-skewed.

TABLE 15-1 A certain type of rare gem serves as a status symbol for many of its owners. In theory, for low prices, the demand increases and it decreases as the price of the gem increases. However, experts hypothesize that when the gem is valued at very high prices, the demand increases with price due to the status owners believe they gain in obtaining the gem. Thus, the model proposed to best explain the demand for the gem by its price is the quadratic model: where Y = demand (in thousands) and X = retail price per carat. This model was fit to data collected for a sample of 12 rare gems of this type. A portion of the computer analysis obtained from Microsoft Excel is shown below: SUMMARY OUTPUT Regression Statistics ANOVA -Referring to Table 15-1, does there appear to be significant upward curvature in the response curve relating the demand (Y) and the price (X) at 10% level of significance?

TABLE 15-5 What are the factors that determine the acceleration time (in sec.) from 0 to 60 miles per hour of a car? Data on the following variables for 171 different vehicle models were collected: Accel Time: Acceleration time in sec. Cargo Vol: Cargo volume in cu. ft. HP: Horsepower MPG: Miles per gallon SUV: 1 if the vehicle model is an SUV with Coupe as the base when SUV and Sedan are both 0 Sedan: 1 if the vehicle model is a sedan with Coupe as the base when SUV and Sedan are both 0 The regression results using acceleration time as the dependent variable and the remaining variables as the independent variables are presented below. ANOVA The various residual plots are as shown below. The coefficient of partial determination ( ) of each of the 5 predictors are, respectively, 0.0380, 0.4376, 0.0248, 0.0188, and 0.0312. The coefficient of multiple determination for the regression model using each of the 5 variables as the dependent variable and all other X variables as independent variables ( ) are, respectively, 0.7461, 0.5676, 0.6764, 0.8582, 0.6632. -Referring to Table 15-5, there is enough evidence to conclude that SUV makes a significant contribution to the regression model in the presence of the other independent variables at a 5% level of significance.

TABLE 15-4 The superintendent of a school district wanted to predict the percentage of students passing a sixth-grade proficiency test. She obtained the data on percentage of students passing the proficiency test (% Passing), daily average of the percentage of students attending class (% Attendance), average teacher salary in dollars (Salaries), and instructional spending per pupil in dollars (Spending) of 47 schools in the state. Let Y = % Passing as the dependent variable, X₁ = % Attendance, X₂ = Salaries and X₃ = Spending. The coefficient of multiple determination (R_j ²) of each of the 3 predictors with all the other remaining predictors are, respectively, 0.0338, 0.4669, and 0.4743. The output from the best-subset regressions is given below: Following is the residual plot for % Attendance: Following is the output of several multiple regression models: Model (I): Model (II): Model (III): -Referring to Table 15-4, what is the p-value of the test statistic to determine whether the quadratic effect of daily average of the percentage of students attending class on percentage of students passing the proficiency test is significant at a 5% level of significance?

TABLE 15-5 What are the factors that determine the acceleration time (in sec.) from 0 to 60 miles per hour of a car? Data on the following variables for 171 different vehicle models were collected: Accel Time: Acceleration time in sec. Cargo Vol: Cargo volume in cu. ft. HP: Horsepower MPG: Miles per gallon SUV: 1 if the vehicle model is an SUV with Coupe as the base when SUV and Sedan are both 0 Sedan: 1 if the vehicle model is a sedan with Coupe as the base when SUV and Sedan are both 0 The regression results using acceleration time as the dependent variable and the remaining variables as the independent variables are presented below. ANOVA The various residual plots are as shown below. The coefficient of partial determination ( ) of each of the 5 predictors are, respectively, 0.0380, 0.4376, 0.0248, 0.0188, and 0.0312. The coefficient of multiple determination for the regression model using each of the 5 variables as the dependent variable and all other X variables as independent variables ( ) are, respectively, 0.7461, 0.5676, 0.6764, 0.8582, 0.6632. -Referring to Table 15-5, there is enough evidence to conclude that HP makes a significant contribution to the regression model in the presence of the other independent variables at a 5% level of significance.

A microeconomist wants to determine how corporate sales are influenced by capital and wage spending by companies. She proceeds to randomly select 26 large corporations and record information in millions of dollars. A statistical analyst discovers that capital spending by corporations has a significant inverse relationship with wage spending. What should the microeconomist who developed this multiple regression model be particularly concerned with?

Collinearity is present if the dependent variable is linearly related to one of the explanatory variables.

TABLE 15-4 The superintendent of a school district wanted to predict the percentage of students passing a sixth-grade proficiency test. She obtained the data on percentage of students passing the proficiency test (% Passing), daily average of the percentage of students attending class (% Attendance), average teacher salary in dollars (Salaries), and instructional spending per pupil in dollars (Spending) of 47 schools in the state. Let Y = % Passing as the dependent variable, X₁ = % Attendance, X₂ = Salaries and X₃ = Spending. The coefficient of multiple determination (R_j ²) of each of the 3 predictors with all the other remaining predictors are, respectively, 0.0338, 0.4669, and 0.4743. The output from the best-subset regressions is given below: Following is the residual plot for % Attendance: Following is the output of several multiple regression models: Model (I): Model (II): Model (III): -Referring to Table 15-4, the better model using a 5% level of significance derived from the "best" model above is

A high value of R² significantly above 0 in multiple regression accompanied by insignificant t-values on all parameter estimates very often indicates a high correlation between independent variables in the model.

TABLE 15-4 The superintendent of a school district wanted to predict the percentage of students passing a sixth-grade proficiency test. She obtained the data on percentage of students passing the proficiency test (% Passing), daily average of the percentage of students attending class (% Attendance), average teacher salary in dollars (Salaries), and instructional spending per pupil in dollars (Spending) of 47 schools in the state. Let Y = % Passing as the dependent variable, X₁ = % Attendance, X₂ = Salaries and X₃ = Spending. The coefficient of multiple determination (R_j ²) of each of the 3 predictors with all the other remaining predictors are, respectively, 0.0338, 0.4669, and 0.4743. The output from the best-subset regressions is given below: Following is the residual plot for % Attendance: Following is the output of several multiple regression models: Model (I): Model (II): Model (III): -Referring to Table 15-4, which of the following models should be taken into consideration using the Mallows' C_p statistic?

The stepwise regression approach takes into consideration all possible models.

TABLE 15-3 A chemist employed by a pharmaceutical firm has developed a muscle relaxant. She took a sample of 14 people suffering from extreme muscle constriction. She gave each a vial containing a dose (X) of the drug and recorded the time to relief (Y) measured in seconds for each. She fit a "centered" curvilinear model to this data. The results obtained by Microsoft Excel follow, where the dose (X) given has been "centered." SUMMARY OUTPUT Regression Statistics ANOVA -Referring to Table 15-3, suppose the chemist decides to use a t test to determine if there is a significant difference between a linear model and a curvilinear model that includes a linear term. If she used a level of significance of 0.02, she would decide that the linear model is sufficient.

Collinearity is present when there is a high degree of correlation between the dependent variable and any of the independent variables.

One of the consequences of collinearity in multiple regression is inflated standard errors in some or all of the estimated slope coefficients.

TABLE 15-5 What are the factors that determine the acceleration time (in sec.) from 0 to 60 miles per hour of a car? Data on the following variables for 171 different vehicle models were collected: Accel Time: Acceleration time in sec. Cargo Vol: Cargo volume in cu. ft. HP: Horsepower MPG: Miles per gallon SUV: 1 if the vehicle model is an SUV with Coupe as the base when SUV and Sedan are both 0 Sedan: 1 if the vehicle model is a sedan with Coupe as the base when SUV and Sedan are both 0 The regression results using acceleration time as the dependent variable and the remaining variables as the independent variables are presented below. ANOVA The various residual plots are as shown below. The coefficient of partial determination ( ) of each of the 5 predictors are, respectively, 0.0380, 0.4376, 0.0248, 0.0188, and 0.0312. The coefficient of multiple determination for the regression model using each of the 5 variables as the dependent variable and all other X variables as independent variables ( ) are, respectively, 0.7461, 0.5676, 0.6764, 0.8582, 0.6632. -Referring to Table 15-5, the 0 to 60 miles per hour acceleration time of a sedan is predicted to be 0.1252 seconds higher than that of an SUV.

Two simple regression models were used to predict a single dependent variable. Both models were highly significant, but when the two independent variables were placed in the same multiple regression model for the dependent variable, R² did not increase substantially and the parameter estimates for the model were not significantly different from 0. This is probably an example of collinearity.

The ________ (larger/smaller) the value of the Variance Inflationary Factor, the higher is the collinearity of the X variables.

TABLE 15-5 What are the factors that determine the acceleration time (in sec.) from 0 to 60 miles per hour of a car? Data on the following variables for 171 different vehicle models were collected: Accel Time: Acceleration time in sec. Cargo Vol: Cargo volume in cu. ft. HP: Horsepower MPG: Miles per gallon SUV: 1 if the vehicle model is an SUV with Coupe as the base when SUV and Sedan are both 0 Sedan: 1 if the vehicle model is a sedan with Coupe as the base when SUV and Sedan are both 0 The regression results using acceleration time as the dependent variable and the remaining variables as the independent variables are presented below. ANOVA The various residual plots are as shown below. The coefficient of partial determination ( ) of each of the 5 predictors are, respectively, 0.0380, 0.4376, 0.0248, 0.0188, and 0.0312. The coefficient of multiple determination for the regression model using each of the 5 variables as the dependent variable and all other X variables as independent variables ( ) are, respectively, 0.7461, 0.5676, 0.6764, 0.8582, 0.6632. -Referring to Table 15-5, the 0 to 60 miles per hour acceleration time of an SUV is predicted to be 0.1252 seconds higher than that of a sedan.

The Variance Inflationary Factor (VIF) measures the correlation of the X variables with the Y variable.