# Markov Chain: Drawing the State Diagram of the Chain

Not what you're looking for?

See attached file for better format.

A particle moves on the states 1, 2, 3, and 4 according to a time-homogeneous Markov chain {Xn ; n ≥ 0 }

with initial distribution p(0) = ( .2, .8, 0, 0 ) and transition matrix : p = [■(.6&.4&0&[email protected]&0&.4&0@0&.6&0&.4@0&0&.6&.4)]

a) Draw the state diagram of the chain. Include the transition probabilities in your diagram. (+4)

b) Give P( X1 = 1| X0 = 2) . (+1)

c) Give P( X4 = 2 | X3 = 1) . (+2)

d) Give P( X5 = 4 | X0 = 1, X1 = 2, X2 = 3, X3 = 4, X4 = 3 ) . (+3)

e) Find the unconditional "path" probability P( X0 = 1, X1 = 1, X2 = 2, X3 = 3 ) . (+5)

f) Find p_11^((2)) = P( X2 = 1| X0 = 1) . (+5)

##### Purchase this Solution

##### Solution Summary

This solution shows how to draw the Markov chain for the given problem.

##### Purchase this Solution

##### Free BrainMass Quizzes

##### Terms and Definitions for Statistics

This quiz covers basic terms and definitions of statistics.

##### Know Your Statistical Concepts

Each question is a choice-summary multiple choice question that presents you with a statistical concept and then 4 numbered statements. You must decide which (if any) of the numbered statements is/are true as they relate to the statistical concept.

##### Measures of Central Tendency

This quiz evaluates the students understanding of the measures of central tendency seen in statistics. This quiz is specifically designed to incorporate the measures of central tendency as they relate to psychological research.

##### Measures of Central Tendency

Tests knowledge of the three main measures of central tendency, including some simple calculation questions.