Journal of Applied Sciences ›› 2011, Vol. 29 ›› Issue (5): 500-507.doi: 10.3969/j.issn.0255-8297.2011.05.010

• Signal and Information Processing • Previous Articles     Next Articles

Algorithms of Third-Order Hidden Markov Model and Its Relationship with First-Order Hidden Markov Model

  

  1. 1. Department of Mathematics, Shanghai University, Shanghai 200444, China
    2. Department of Mathematics and Computer Science, Tongling University, Tongling 244000,
    Anhui Province, China
  • Received:2011-01-09 Revised:2011-05-25 Online:2011-09-28 Published:2011-09-30

Abstract:

In order to consider more statistical characteristics, a class of third-order hidden Markov model is proposed. In this model, both state transition and output observation depend on the current state and on the two preceding states as well. Three algorithms of the third-order hidden Markov model are studied and derived, including the forward-backward algorithm for observation sequence evaluation, the Viterbi algorithm for determining the optimal state sequence, and the Baum-Welch algorithm for training the third-order hidden Markov model. A first-order hidden Markov model equivalent to the third-order hidden Markov model is constructed. A theorem of their equivalence is proposed and proved. This study contributes to the algorithmic
theory of the hidden Markov model, and provides a better method to practical applications.

Key words: first-order hidden Markov model, third-order hidden Markov model, forward-backward algorithm, Viterbi algorithm, Baum-Welch algorithm

CLC Number: