Optimal control of the two-state Markov process in discrete time

详细

Using the control problem of a two-state Markov process in discrete time as an example, we consider the basic stages concerning the application of theory of conditional Markov processes to synthesize optimal algorithms of the control of stochastic systems. It is assumed that the control changes the statistical properties of the states of a controlled plant. The numerical method for solving the problem and the results of solving particular example are presented. The special features of the solution of this problem compared to the well-known problem in continuous time are discussed.