Purchase Solution

Unweighted and Weighted Linear Regression

Not what you're looking for?

Ask Custom Question

See the attached fie.

a) Consider the following set of regression equations:

Y1 = βx1 + e1
Y2 = βx2+ e2
..
Yn = βxn + en

Suppose also that w1, w2, ..., wn are a set of positive weights (known constants). Consider the function

f(β) = ∑ wiei2 = ∑ wi (yi - βxi)2
Find the value of β that minimizes f(β). (This value of β is called the weighted least squares estimate of β.)

b) and c) use the following random sample of n = 6 pairs of values of x and Y.
x Y
1 3
6 7
4 12
2 5
1 4
3 5

b) For the regression model in part a), find the (unweighted) least squares estimate of β using this data. Explain the meaning of this value.

c) Suppose that the weights described in part a) are 1,1,1,2,2,3, respectively. For the regression model in part a), find the weighted least squares estimate of β. Does it differ from your answer in b)? Can you explain why?

Purchase this Solution

Solution Summary

The solution computes the slope of the regression line (least squares fit) for a given set of data points. We then recompute the slope by using various weighting factors for each point.

Solution Preview

a) We have

f(beta) = sum[w_i(Y_i - beta x_i)^2].

To find the value of beta which minimizes f(beta), we calculate f'(beta) and set it equal to zero. Thus we have

0 = f'(beta) = sum[-2w_i x_i(Y_i - beta x_i)]
= -2 [sum(w_i x_i Y_i) - beta sum(w_i x_i^2)],

whence

beta = sum(w_i ...

Purchase this Solution


Free BrainMass Quizzes
Know Your Linear Equations

Each question is a choice-summary multiple choice question that will present you with a linear equation and then make 4 statements about that equation. You must determine which of the 4 statements are true (if any) in regards to the equation.

Geometry - Real Life Application Problems

Understanding of how geometry applies to in real-world contexts

Graphs and Functions

This quiz helps you easily identify a function and test your understanding of ranges, domains , function inverses and transformations.

Probability Quiz

Some questions on probability

Multiplying Complex Numbers

This is a short quiz to check your understanding of multiplication of complex numbers in rectangular form.