Unweighted and Weighted Linear Regression
Not what you're looking for?
See the attached fie.
a) Consider the following set of regression equations:
Y1 = βx1 + e1
Y2 = βx2+ e2
..
Yn = βxn + en
Suppose also that w1, w2, ..., wn are a set of positive weights (known constants). Consider the function
f(β) = ∑ wiei2 = ∑ wi (yi - βxi)2
Find the value of β that minimizes f(β). (This value of β is called the weighted least squares estimate of β.)
b) and c) use the following random sample of n = 6 pairs of values of x and Y.
x Y
1 3
6 7
4 12
2 5
1 4
3 5
b) For the regression model in part a), find the (unweighted) least squares estimate of β using this data. Explain the meaning of this value.
c) Suppose that the weights described in part a) are 1,1,1,2,2,3, respectively. For the regression model in part a), find the weighted least squares estimate of β. Does it differ from your answer in b)? Can you explain why?
Purchase this Solution
Solution Summary
The solution computes the slope of the regression line (least squares fit) for a given set of data points. We then recompute the slope by using various weighting factors for each point.
Solution Preview
a) We have
f(beta) = sum[w_i(Y_i - beta x_i)^2].
To find the value of beta which minimizes f(beta), we calculate f'(beta) and set it equal to zero. Thus we have
0 = f'(beta) = sum[-2w_i x_i(Y_i - beta x_i)]
= -2 [sum(w_i x_i Y_i) - beta sum(w_i x_i^2)],
whence
beta = sum(w_i ...
Purchase this Solution
Free BrainMass Quizzes
Know Your Linear Equations
Each question is a choice-summary multiple choice question that will present you with a linear equation and then make 4 statements about that equation. You must determine which of the 4 statements are true (if any) in regards to the equation.
Geometry - Real Life Application Problems
Understanding of how geometry applies to in real-world contexts
Graphs and Functions
This quiz helps you easily identify a function and test your understanding of ranges, domains , function inverses and transformations.
Probability Quiz
Some questions on probability
Multiplying Complex Numbers
This is a short quiz to check your understanding of multiplication of complex numbers in rectangular form.