Find the Formula That Gives the Least Squares Error for the Points

Multiple Choice

Find the formula that gives the least squares error for the points (-1, 5) , (2, 2) , (5, -1) .

A) $( A - B + 5 ) ^ { 2 }$ + $( 2 A + B - 2 ) ^ { 2 }$ + $( A + B + 1 ) ^ { 2 }$
B) $( - 2 A + B - 5 ) ^ { 2 }$ + $( A + B - 2 ) ^ { 2 }$ + $( 5 \mathrm {~A} + \mathrm { B } + 1 ) ^ { 2 }$
C) $( - A + B - 5 ) ^ { 2 }$ + $( 2 A + B - 2 ) ^ { 2 }$ + $( 5 \mathrm {~A} + \mathrm { B } + 1 ) ^ { 2 }$
D) $( - A + B - 5 ) ^ { 2 }$ + $( 2 A + B - 2 ) ^ { 2 }$ + $( A + B + 5 ) ^ { 2 }$