Journal of Electrical Engineering and Technology

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

Training HMM Structure and Parameters with Genetic Algorithm and Harmony Search Algorithm

  • Ko, Kwang-Eun (School of Electrical and Electronics Engineering, Chung-Ang University) ;
  • Park, Seung-Min (School of Electrical and Electronics Engineering, Chung-Ang University) ;
  • Park, Jun-Heong (School of Electrical and Electronics Engineering, Chung-Ang University) ;
  • Sim, Kwee-Bo (School of Electrical and Electronics Engineering, Chung-Ang University)
  • Received : 2011.06.13
  • Accepted : 2011.08.17
  • Published : 2012.01.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we utilize training strategy of hidden Markov model (HMM) to use in versatile issues such as classification of time-series sequential data such as electric transient disturbance problem in power system. For this, an automatic means of optimizing HMMs would be highly desirable, but it raises important issues: model interpretation and complexity control. With this in mind, we explore the possibility of using genetic algorithm (GA) and harmony search (HS) algorithm for optimizing the HMM. GA is flexible to allow incorporating other methods, such as Baum-Welch, within their cycle. Furthermore, operators that alter the structure of HMMs can be designed to simple structures. HS algorithm with parameter-setting free technique is proper for optimizing the parameters of HMM. HS algorithm is flexible so as to allow the elimination of requiring tedious parameter assigning efforts. In this paper, a sequential data analysis simulation is illustrated, and the optimized-HMMs are evaluated. The optimized HMM was capable of classifying a sequential data set for testing compared with the normal HMM.

Keywords

References

  1. A. Santoso, E. J. Powers and W. M. Grady, "Power Quality Disturbance Identification using Wavelet Transform and Artificial Neural Network," Proc. Int. Conf. Harmonics and Quality of Power, pp.615-618, 1996
  2. J. Chung, E. J. Powers, W. M. Grady, and S. C. Bhatt, "Electric Power Transient Disturbance Classification using Wavelet-based Hidden Markov Models", Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 6, pp.3662-3665, 2000
  3. W. Min, A. V. Mamishev, "Classification of Power Quality Events using Optimal Time-Frequency Representations-Part 1: Theory," IEEE Transactions on Power Deliver, vol. 19, Issue 3, pp.1488-1495, 2004 https://doi.org/10.1109/TPWRD.2004.829940
  4. M. Negnevitsky, M. Ringrose, "A Neuro-Fuzzy System for Recognition of Power Quality Disturbances," IEEE Power Engineering Society General Meeting, vol. 3, pp.2295-2300, 2005
  5. M. C. G. Silveira, A. D. P. Lotufo, C. R. Minussi, "Transient Stability Analysis of Electrical Power Systems using a Neural Network based on Fuzzy ARTMAP," Proc. IEEE Bologna PowerTech Conference, 2003
  6. A.W. Noor Izzri, A. Mohamed, I. Yahya, "A New Method of Transient Stability Assessment in Power Systems using LS-SVM," The 5th Student Conference on Research and Development, 2007
  7. M. Azab, "Harmonic Elimination in Three-Phase Voltage Source Inverters by Particle Swarm Optimization," Journal of Electrical Engineering & Technology, vol. 6, no. 3, pp. 334-341, 2011 https://doi.org/10.5370/JEET.2011.6.3.334
  8. D. Whitley, "A Genetic Algorithm Tutorial", Statist. Comput., vol. 4, pp. 65-85, 1994
  9. Z. W. Geem, "State-of-the-Art in the Structure of Harmony Search Algorithm," Recent Advances in Harmony Search Algorithm, Studies in Computational Intelligence, vol. 270, pp. 1-10, 2010 https://doi.org/10.1007/978-3-642-04317-8_1
  10. L. R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proceedings of IEEE, Vol. 77, pp. 257-286, 1989 https://doi.org/10.1109/5.18626
  11. H. K. Lee, S. J. Choi, "PCA+HMM+SVM for EEG pattern classification," Proceedings of seventh international symposium on signal processing and its applications, vol. 1, pp. 541-544, 2003
  12. C. W. Chau, S. Kwong, C. K. Diu, W. R., Fahrner, "Optimization of HMM by a Genetic Algorithm," IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 3, pp. 1727-1730, 1997
  13. Z. W. Geem and K. B. Sim, "Parameter-Setting-Free Harmony Search Algorithm," Applied Mathematics and Computation, vol. 217, no. 8, pp.3881-3889, 2010 https://doi.org/10.1016/j.amc.2010.09.049
  14. K. -J. Won, A. Pruger-Bennett and A. Krogh, "Training HMM Structure with Genetic Algorithm for Biological Sequence Analysis," Bioinformatic, vol. 20, no. 18, pp. 3613-3619, 2004 https://doi.org/10.1093/bioinformatics/bth454
  15. D. T. Nguyen and T. A. Hoang, "Analysis of Power Transient Disturbances using Wavelet Transform Modulus Maxima Technique," Proceedings of the Australasian Universities Power Engineering Conference, Brisbane, pp. 190-195, 2000
  16. N. Perera, A. D. Rajapakse, "Power System Transient Classification for Protection Relaying," The 13th Int. Conf. Harmonics and Quality of Power, pp. 1-6, 2008
  17. C. W. Chau, S. Kwong, C. K. Diu and W. R. Fahrner, "Optimization of HMM by a Genetic Algorithm," Proc. ICASSP, pp.1727-1730, 1997
  18. F. Yang and C. Zhang, "An Effective Hybrid Optimization Algorithm for HMM," Proc. Fourth International Conference on Natural Computation, pp.80-84, 2008

Cited by

  1. The mechanical arm control based on harmony search genetic algorithm vol.20, pp.4, 2017, https://doi.org/10.1007/s10586-017-1053-7
  2. The Reputation Evaluation Based on Optimized Hidden Markov Model in E-Commerce vol.2013, 2013, https://doi.org/10.1155/2013/391720