Purchase Solution

Policy Iteration : Probability Distribution and Maximizing Profit

Not what you're looking for?

Ask Custom Question

Please see the attached file for the fully formatted problems.

1. A machine in excellent condition earns $100 profit per week, a machine in good condition earns $70 per week, and a machine in poor condition earns $20 per week. At the beginning of any week a machine can be sent out for repairs at a cost of $90. A machine sent out for repairs returns in excellent condition at the beginning of the next week. If a machine is not repaired the condition of the machine at the beginning of next week follows the following probability distribution.

The company wishes to maximize its expected discounted profit over an infinite horizon with  = 0.9. Use an initial policy,

See work on following page. My answer is (see the attached file)

State Decisions Transition Probabilities Returns

Excellent Good Poor
1.Excellent Condition 1. Repair 1 0 0 10
2. Don't Repair 0.7 0.2 0.1 100
2. Good Condition 1. Repair 1 0 0 -20
2. Don't Repair 0 0.7 0.3 70
3. Poor Condition 1. Repair 1 0 0 -70
2. Don't Repair 0 0.1 0.9 20

For α=0.9 and a policy :

Policy did not change - terminate.

Purchase this Solution

Solution Summary

A policy iteration problem is solved. The probability distribution and maximizing profit is provided. The solution is detailed.

Solution Preview

Please see the attached file for the complete solution.

1. A machine in excellent condition earns $100 profit per week, a machine in good condition earns $70 per week, and a machine in poor condition earns $20 per week. At the beginning of any week a machine can be sent out for repairs at a cost of $90. A machine sent out for repairs returns in excellent condition at the beginning of the next week. If a machine is not repaired the condition of the machine at the beginning of next week follows the following probability distribution.

The company wishes to maximize its expected discounted profit over an infinite horizon with α = 0.9. Use an initial policy,

Solution

I would recommend a little different approach. First of ...

Purchase this Solution


Free BrainMass Quizzes
Multiplying Complex Numbers

This is a short quiz to check your understanding of multiplication of complex numbers in rectangular form.

Geometry - Real Life Application Problems

Understanding of how geometry applies to in real-world contexts

Exponential Expressions

In this quiz, you will have a chance to practice basic terminology of exponential expressions and how to evaluate them.

Know Your Linear Equations

Each question is a choice-summary multiple choice question that will present you with a linear equation and then make 4 statements about that equation. You must determine which of the 4 statements are true (if any) in regards to the equation.

Solving quadratic inequalities

This quiz test you on how well you are familiar with solving quadratic inequalities.