Category: Statistics > Simple Regression
Subject: birth-death process
Details: Let a Markov chain have transition probabilities Pi,i+1 = 1/(i+1) and Pi,0 = i/(i+1) for i=0,1,2, . . . .
i) Is the chain positive recurrent? Or transient or null recurrent?
ii) Does a stationary distribution exist? If it does, what is it?
See also attachment.
The following outlines the process for answering several questions involving a Markov chain. Specifically, whether or not the chain is recurrent and whether or not a stationary distribution exists.