1) Given the following four Markov chains with 2 3, 4 5 states respectively. identify if the single recurrent class in each Markov chain is periodic or nOt. Directed arrows mean transition probability greater than zero_ (b) (c) 2) Now assume that you are given N-state Markov chain; which each state has bi-directional connections with ItS two neighboring states (i.e-. the neighboring states of S1 ure Sz and Sv; the neighboring states of Sz are S1 and Sz. and the neighboring states of SN-1 is SN-2 and SN) Identify under what conditions (i.e- what values of N) will this N-state Markov chain have periodic recurrent class and justily your answer'



Answer :