Exam 14: Introduction to Multiple Regression

TABLE 14-5 A microeconomist wants to determine how corporate sales are influenced by capital and wage spending by companies. She proceeds to randomly select 26 large corporations and record information in millions of dollars. The Microsoft Excel output below shows results of this multiple regression. Regression Statistics Multiple R 0.830 R Square 0.689 Adjusted R Square 0.662 Standard Error 17501.643 Observations 26 ANOVA d f S S M S F Significance F Regression 2 15579777040 7789888520 25.432 0.0001 Residual 23 7045072780 306307512 Total 25 22624849820 Coefficients Standard Error t Stat p-value Intercept 15800.0000 6038.2999 2.617 0.0154 C apital 0.1245 0.2045 0.609 0.5485 W ages 7.0762 1.4729 4.804 0.0001 -Referring to Table 14-5, at the 0.01 level of significance, what conclusion should the microeconomist draw regarding the inclusion of Capital in the regression model?

TABLE 14-4 A real estate builder wishes to determine how house size (House) is influenced by family income (Income), family size (Size), and education of the head of household (School). House size is measured in hundreds of square feet, income is measured in thousands of dollars, and education is in years. The builder randomly selected 50 families and ran the multiple regression. Microsoft Excel output is provided below: Regression Stuistics Multiple R 0.865 R Square 0.748 Adjusted R Square 0.726 Standard Error 5.195 Observations 50 ANOVA d f S S M S F Significance F Regression 3605.7736 1201.9245 0.0000 Residual 1214.2264 26.3962 Total 49 4820.0000 Coefficients Standard Error t Stat p -value Intercept -1.6335 5.8078 -0.281 0.7798 Income 0.4485 0.1137 3.9545 0.0003 Size 4.2615 0.8062 5.286 0.0001 School -0.6517 0.4319 -1.509 0.1383 -Referring to Table 14-4, at the 0.01 level of significance, what conclusion should the builder draw regarding the inclusion of School in the regression model?

TABLE 14-3 An economist is interested to see how consumption for an economy (in $ billions) is influenced by gross domestic product ($ billions) and aggregate price (consumer price index). The Microsoft Excel output of this regression is partially reproduced below. $\text {SUMMARY OUTPUT}$ Regression Statistics Multiple R 0.991 R Square 0.982 Adjusted R Square 0.976 Standard Error 0.299 Observations 10 ANOVA d f SS MS F Significance F Regression 2 33.4163 16.7082 186.325 0.0001 Residual 7 0.6277 0.0897 Total 9 34.0440 Coefficients Standard Error t Stat p -value Intercept -0.0861 0.5674 -0.152 0.8837 GDP 0.7654 0.0574 13.340 0.0001 Price -0.0006 0.0028 -0.219 0.8330 -Referring to Table 14-5, what are the predicted sales (in millions of dollars) for a company spending $100 million on capital and $100 million on wages?

TABLE 14-4 A real estate builder wishes to determine how house size (House) is influenced by family income (Income), family size (Size), and education of the head of household (School). House size is measured in hundreds of square feet, income is measured in thousands of dollars, and education is in years. The builder randomly selected 50 families and ran the multiple regression. Microsoft Excel output is provided below: Regression Stuistics Multiple R 0.865 R Square 0.748 Adjusted R Square 0.726 Standard Error 5.195 Observations 50 ANOVA d f S S M S F Significance F Regression 3605.7736 1201.9245 0.0000 Residual 1214.2264 26.3962 Total 49 4820.0000 Coefficients Standard Error t Stat p -value Intercept -1.6335 5.8078 -0.281 0.7798 Income 0.4485 0.1137 3.9545 0.0003 Size 4.2615 0.8062 5.286 0.0001 School -0.6517 0.4319 -1.509 0.1383 -Referring to Table 14-4, what is the value of the calculated F test statistic that is missing from the output for testing whether the whole regression model is significant?

TABLE 14-4 A real estate builder wishes to determine how house size (House) is influenced by family income (Income), family size (Size), and education of the head of household (School). House size is measured in hundreds of square feet, income is measured in thousands of dollars, and education is in years. The builder randomly selected 50 families and ran the multiple regression. Microsoft Excel output is provided below: Regression Stuistics Multiple R 0.865 R Square 0.748 Adjusted R Square 0.726 Standard Error 5.195 Observations 50 ANOVA d f S S M S F Significance F Regression 3605.7736 1201.9245 0.0000 Residual 1214.2264 26.3962 Total 49 4820.0000 Coefficients Standard Error t Stat p -value Intercept -1.6335 5.8078 -0.281 0.7798 Income 0.4485 0.1137 3.9545 0.0003 Size 4.2615 0.8062 5.286 0.0001 School -0.6517 0.4319 -1.509 0.1383 -Referring to Table 14-4, which of the independent variables in the model are significant at the 2% level?

TABLE 14-12 A weight-loss clinic wants to use regression analysis to build a model for weight-loss of a client (measured in pounds). Two variables thought to affect weight-loss are client's length of time on the weight loss program and time of session. These variables are described below: Y = Weight- loss (in pounds) ^X1 ^{= Length of time in weight- loss program (in months) X}2 ^{= 1 if morning session, 0 if not X}3 ^{= 1 if afternoon session, 0 if not (Base level = evening session)} Data for 12 clients on a weight- loss program at the clinic were collected and used to fit the interaction model: $Y=\beta_{0}+\beta_{1} X_{1}+\beta_{2} X_{2}+\beta_{3} X_{3}+\beta_{4} X_{1} X_{2}+\beta_{5} X_{1} X_{3}+\varepsilon$ Partial output from Microsoft Excel follows: Regression Statistics Multiple R 0.73514 R Square 0.540438 Adjusted R Square 0.157469 Standard Error 12.4147 Observations 12 ANOVA $F = 5.41118 \quad\text { Significance } F = 0.040201$ Coefficients Standard Error t Stat p -value Intercept 0.089744 14.127 0.0060 0.9951 Length (X1) 6.22538 2.43473 2.54956 0.0479 Morn Ses (X2) 2.217272 22.1416 0.100141 0.9235 Aft Ses (X3) 11.8233 3.1545 3.558901 0.0165 Length*Morn Ses 0.77058 3.562 0.216334 0.8359 Length * Aft Ses -0.54147 3.35988 -0.161158 0.8773 -Referring to Table 14-12, what is the experimental unit for this analysis?

TABLE 14-7 The department head of the accounting department wanted to see if she could predict the GPA of students using the number of course units (credits) and total SAT scores of each. She takes a sample of students and generates the following Microsoft Excel output: $\text {SUMMARY OUTPUT}$ Regression Statistics Multiple R 0.916 R Square 0.839 Adjusted R Square 0.732 Standard Error 0.24685 Observations 6 ANOVA d f SS M S F Significance F Regression 2 0.95219 0.47610 7.813 0.0646 Residual 3 0.18281 0.06094 Total 5 1.13500 Coefficients Standard Error t Stat p -value Intercept 4.593897 1.13374542 4.052 0.0271 Units -0.247270 0.06268485 -3.945 0.0290 SAT Total 0.001443 0.00101241 1.425 0.2494 -Referring to Table 14-7, the department head wants to test H0 : þ1 = þ2 = 0. At a level of significance of 0.05, the null hypothesis is rejected.

In a particular model, the sum of the squared residuals was 847. If the model had 5 independent variables, and the data set contained 40 points, the value of the standard error of the estimate is 24.911.

TABLE 14-10 You worked as an intern at We Always Win Car Insurance Company last summer. You notice that individual car insurance premiums depend very much on the age of the individual, the number of traffic tickets received by the individual, and the population density of the city in which the individual lives. You performed a regression analysis in EXCEL and obtained the following information: Regression Analysis Regression Statistics Multiple R 0.63 R Square 0.40 Adjusted R Square 0.23 Standard Error 50.00 Observations 15.00 ANOVA d f SS MS F Significance F Regression 3 5994.24 2.40 0.12 Residual 11 27496.82 Total 45479.54 oefficients Standard Error t Stat p-value Lower 99.0\% Upper 99.0 \% Intercept 123.80 48.71 2.54 0.03 -27.47 275.07 AGE -0.82 0.87 -0.95 0.36 -3.51 1.87 TICKETS 21.25 10.66 1.99 0.07 -11.86 54.37 DENSITY -3.14 6.46 -0.49 0.64 -23.19 16.91 -Referring to Table 14-10, to test the significance of the multiple regression model, the null hypothesis should be rejected while allowing for 1% probability of committing a type I error.

TABLE 14-4 A real estate builder wishes to determine how house size (House) is influenced by family income (Income), family size (Size), and education of the head of household (School). House size is measured in hundreds of square feet, income is measured in thousands of dollars, and education is in years. The builder randomly selected 50 families and ran the multiple regression. Microsoft Excel output is provided below: Regression Stuistics Multiple R 0.865 R Square 0.748 Adjusted R Square 0.726 Standard Error 5.195 Observations 50 ANOVA d f S S M S F Significance F Regression 3605.7736 1201.9245 0.0000 Residual 1214.2264 26.3962 Total 49 4820.0000 Coefficients Standard Error t Stat p -value Intercept -1.6335 5.8078 -0.281 0.7798 Income 0.4485 0.1137 3.9545 0.0003 Size 4.2615 0.8062 5.286 0.0001 School -0.6517 0.4319 -1.509 0.1383 -Referring to Table 14-4, what are the regression degrees of freedom that are missing from the output?

TABLE 14-5 A microeconomist wants to determine how corporate sales are influenced by capital and wage spending by companies. She proceeds to randomly select 26 large corporations and record information in millions of dollars. The Microsoft Excel output below shows results of this multiple regression. Regression Statistics Multiple R 0.830 R Square 0.689 Adjusted R Square 0.662 Standard Error 17501.643 Observations 26 ANOVA d f S S M S F Significance F Regression 2 15579777040 7789888520 25.432 0.0001 Residual 23 7045072780 306307512 Total 25 22624849820 Coefficients Standard Error t Stat p-value Intercept 15800.0000 6038.2999 2.617 0.0154 C apital 0.1245 0.2045 0.609 0.5485 W ages 7.0762 1.4729 4.804 0.0001 -Referring to Table 14-5, what is the p-value for testing whether Wages have a negative impact on corporate sales?

TABLE 14-13 As a project for his business statistics class, a student examined the factors that determined parking meter rates throughout the campus area. Data were collected for the price per hour of parking, blocks to the quadrangle, and one of the three jurisdictions: on campus, in downtown and off campus, or outside of downtown and off campus. The population regression model hypothesized is $Y_{i}=\alpha+\beta_{1} X_{1 i}+\beta_{2} X_{2 i}+\beta_{3} X_{3 i}+\varepsilon$ where Y is the meter price; ^X1 ^{is the number of blocks to the quad; X}2 ^{is a dummy variable that takes the value 1 if the meter} is located in downtown and off campus and the value 0 otherwise; ^X3 ^{is a dummy variable that takes the value 1 if the meter} is located outside of downtown and off campus, and the value 0 otherwise. The following Excel results are obtained. Regression Statistics Multiple R 0.9659 R Square 0.9331 Adjusted R Square 0.9294 Standard Error 0.0327 Observations 58 ANOVA d f SS M S F Significance F Regression 3 0.8094 0.2698 251.1995 1.0964-31 Residual 54 0.0580 0.0010 Total 57 0.8675 Coefficients Standard Error t Stat p-value Intercept 0.5118 0.0136 37.4675 2.4904 -0.0045 0.0034 -1.3276 0.1898 -0.2392 0.0123 -19.3942 5.3581-26 -0.0002 0.0123 -0.0214 0.9829 -Referring to Table 14-13, predict the meter rate per hour if one parks outside of downtown and off campus 3 blocks from the quad.

In a multiple regression problem involving two independent variables, if b₁ is computed to be +2.0, it means that

TABLE 14-10 You worked as an intern at We Always Win Car Insurance Company last summer. You notice that individual car insurance premiums depend very much on the age of the individual, the number of traffic tickets received by the individual, and the population density of the city in which the individual lives. You performed a regression analysis in EXCEL and obtained the following information: Regression Analysis Regression Statistics Multiple R 0.63 R Square 0.40 Adjusted R Square 0.23 Standard Error 50.00 Observations 15.00 ANOVA d f SS MS F Significance F Regression 3 5994.24 2.40 0.12 Residual 11 27496.82 Total 45479.54 oefficients Standard Error t Stat p-value Lower 99.0\% Upper 99.0 \% Intercept 123.80 48.71 2.54 0.03 -27.47 275.07 AGE -0.82 0.87 -0.95 0.36 -3.51 1.87 TICKETS 21.25 10.66 1.99 0.07 -11.86 54.37 DENSITY -3.14 6.46 -0.49 0.64 -23.19 16.91 -Referring to Table 14-10, to test the significance of the multiple regression model, the p-value of the test statistic in the sample is ______.

TABLE 14-11 A logistic regression model was estimated in order to predict the probability that a randomly chosen university or college would be a private university using information on average total Scholastic Aptitude Test score (SAT) at the university or college, the room and board expense measured in thousands of dollars (Room/Brd), and whether the TOEFL criterion is at least 550 (Toefl550 = 1 if yes, 0 otherwise.) The dependent variable, Y, is school type (Type = 1 if private and 0 otherwise). The Minitab output is given below: Logistic Regression Table Odds 95: CI Predictor Coef SE Coef Z P Ratio Lower Upper Constant -27.118 6.696 -4.05 0.000 SAT 0.015 0.004666 3.17 0.002 1.01 1.01 1.02 Toefl550 -0.390 0.9538 -0.41 0.682 0.68 0.10 4.39 Room/Brd 2.078 0.5076 4.09 0.000 7.99 2.95 21.60 Log-Likelihood = -21.883 Test that all slopes are zero: G = 62.083, DF = 3, P-Value = 0.000 Goodness-of-Fit Tests Method Chi-Square DF P Pearson 143.551 76 0.000 Deviance 43.767 76 0.999 Hosmer-Lemeshow 15.731 8 0.046 -Referring to Table 14-11, what is the p-value of the test statistic when testing whether Toefl500 makes a significant contribution to the model in the presence of the other independent variables?

TABLE 14-5 A microeconomist wants to determine how corporate sales are influenced by capital and wage spending by companies. She proceeds to randomly select 26 large corporations and record information in millions of dollars. The Microsoft Excel output below shows results of this multiple regression Regression Statistics Multiple R 0.830 R Square 0.689 Adjusted R Square 0.662 Standard Error 17501.643 Observations 26 ANOVA d f S S M S F Significance F Regression 2 15579777040 7789888520 25.432 0.0001 Residual 23 7045072780 306307512 Total 25 22624849820 Coefficients Standard Error t Stat p-value Intercept 15800.0000 6038.2999 2.617 0.0154 C apital 0.1245 0.2045 0.609 0.5485 W ages 7.0762 1.4729 4.804 0.0001 -In a multiple regression model, the adjusted r²

Table 14-16 The superintendent of a school district wanted to predict the percentage of students passing a sixth-grade proficiency test. She obtained the data on percentage of students passing the proficiency test (% Passing), daily average of the percentage of students attending class (% Attendance), average teacher salary in dollars (Salaries), and instructional spending per pupil in dollars (Spending) of 47 schools in the state. Following is the multiple regression output with Y = % Passing as the dependent variable, X₁ = % Attendance, X₂ = Salaries and X₃ = Spending: Model 1 Regression Statistics R Square 0.8080 AdjustedR S quare 0.7568 Observations 20 ANOVA df SS MS F Signuficance F Regression 4 169503.4241 42375.86 15.7874 2.96869E-05 Residual 15 40262.3259 2684.155 Total 19 209765.75 Standard Lower Upper Coefficients Error t Stat p -value 90.0\% 90.0\% Intercept 421.4277 77.8614 5.4125 7.2-05 284.9327 557.9227 X 1 (Temperature) -4.5098 0.8129 -5.5476 5.58-05 -5.9349 -3.0847 X 2 (Insulation) -14.9029 5.0508 -2.9505 0.0099 -23.7573 -6.0485 X 3 (Windows) 0.2151 4.8675 0.0442 0.9653 -8.3181 8.7484 X 4 (Furnace Age) 6.3780 4.1026 1.5546 0.1408 -0.8140 13.5702 Model 2 Regression Statistics R Square 0.7768 Adjusted R Square 0.7506 Observations 20 ANOVA d f SS MS SS Significance F Regression 2 162958.2277 81479.11 29.5923 2.9036-06 Residual 17 46807.5222 2753.384 Total 19 209765.75 Standard Lower Upper Coefficients Error t Stat p -value 95\% 95\% Intercept 489.3227 43.982611.1253 3.17-09 396.5273 582.1180 X 1 (Temperature) -5.1103 0.6951-7.3515 1.13-06 -6.5769 -3.6437 X 2 (Insulation) -14.7195 4.8864-3.0123 0.0078 -25.0290 -4.4099 -Referring to Table 14-16, which of the following is a correct statement?

TABLE 14-5 A microeconomist wants to determine how corporate sales are influenced by capital and wage spending by companies. She proceeds to randomly select 26 large corporations and record information in millions of dollars. The Microsoft Excel output below shows results of this multiple regression. Regression Statistics Multiple R 0.830 R Square 0.689 Adjusted R Square 0.662 Standard Error 17501.643 Observations 26 ANOVA d f S S M S F Significance F Regression 2 15579777040 7789888520 25.432 0.0001 Residual 23 7045072780 306307512 Total 25 22624849820 Coefficients Standard Error t Stat p-value Intercept 15800.0000 6038.2999 2.617 0.0154 C apital 0.1245 0.2045 0.609 0.5485 W ages 7.0762 1.4729 4.804 0.0001 TABLE 14-3 $\text {SUMMARY OUTPUT}$ Regression Statistics Multiple R 0.991 R Square 0.982 Adjusted R Square 0.976 Standard Error 0.299 Observations 10 ANOVA d f SS MS F Significance F Regression 2 33.4163 16.7082 186.325 0.0001 Residual 7 0.6277 0.0897 Total 9 34.0440 Coefficients Standard Error t Stat p -value Intercept -0.0861 0.5674 -0.152 0.8837 GDP 0.7654 0.0574 13.340 0.0001 Price -0.0006 0.0028 -0.219 0.8330 -Referring to Table 14-5, the observed value of the F-statistic is given on the printout as 25.432. What are the degrees of freedom for this F-statistic?

TABLE 14-11 A logistic regression model was estimated in order to predict the probability that a randomly chosen university or college would be a private university using information on average total Scholastic Aptitude Test score (SAT) at the university or college, the room and board expense measured in thousands of dollars (Room/Brd), and whether the TOEFL criterion is at least 550 (Toefl550 = 1 if yes, 0 otherwise.) The dependent variable, Y, is school type (Type = 1 if private and 0 otherwise). Logistic Regression Table Odds 95: CI Predictor Coef SE Coef Z P Ratio Lower Upper Constant -27.118 6.696 -4.05 0.000 SAT 0.015 0.004666 3.17 0.002 1.01 1.01 1.02 Toefl550 -0.390 0.9538 -0.41 0.682 0.68 0.10 4.39 Room/Brd 2.078 0.5076 4.09 0.000 7.99 2.95 21.60 Log-Likelihood = -21.883 Test that all slopes are zero: G = 62.083, DF = 3, P-Value = 0.000 Goodness-of-Fit Tests Method Chi-Square DF P Pearson 143.551 76 0.000 Deviance 43.767 76 0.999 Hosmer-Lemeshow 15.731 8 0.046 -Referring to Table 14-11, which of the following is the correct interpretation for the SAT slope coefficient?

TABLE 14-17 The marketing manager for a nationally franchised lawn service company would like to study the characteristics that differentiate home owners who do and do not have a lawn service. A random sample of 30 home owners located in a suburban area near a large city was selected; 15 did not have a lawn service (code 0) and 15 had a lawn service (code 1). Additional information available concerning these 30 home owners includes family income (Income, in thousands of dollars), lawn size (Lawn Size, in thousands of square feet), attitude toward outdoor recreational activities (Attitude 0 = unfavorable, 1 = favorable), number of teenagers in the household (Teenager), and age of the head of the household (Age). The Minitab output is given below: Odds 95 \% CI Predictor Coef SE Coef Z P Ratio Lower Upper Constant -70.49 47.22 -1.49 0.135 Income 0.2868 0.1523 1.88 0.060 1.33 0.99 1.80 Lawn Size 1.0647 0.7472 1.42 0.154 2.90 0.67 12.54 Attitude -12.744 9.455 -1.35 0.178 0.00 0.00 326.06 Teenager -0.200 1.061 -0.19 0.850 0.82 0.10 6.56 Age 1.0792 0.8783 1.23 0.219 2.94 0.53 16.45 Log-Likelihood = -4.890 Test that all slopes are zero: G = 31.808, DF = 5, P-Value = 0.000 Goodness-of-Fit Tests Method Chi-Square DF P Pearson 9.313 24 0.997 Deviance 9.780 24 0.995 Hosmer-Lemeshow 0.571 8 1.000 -Referring to Table 14-17, what should be the decision ('reject' or 'do not reject') on the null hypothesis when testing whether Income makes a significant contribution to the model in the presence of the other independent variables at a 0.05 level of significance?