Video Summarization Using Hidden Markov Model

은닉 마르코브 모델을 이용한 비디오 요약 시스템

  • Published : 2004.10.01


This paper proposes a system to analyze and summarize the video shots of baseball game TV program into fifteen categories. Our System consists of three modules: feature extraction, Hidden Markov Model (HMM) training, and video shot categorization. Video Shots belongs to the same class are not necessarily similar, so we require that the training set is large enough to include video shot with all possible variations to create a robust Hidden Markov Model. In the experiments, we have illustrated that our system can recognize the 15 different shot classes with a success ratio of 84.72%.


  1. E. Ardizzone, M. L.Casia, and D. Monlinelli. 'Motion and color based Video Indexing'. lCPR, Vienna, Austria, Aug. 1996
  2. R. W. Picard. 'A Society of Models for Video and Image Libraries'. Per. Camp. Sec Technical 1996
  3. S. W SmoIiar and Ⅱ. Zhang. 'Content-Based Video Indexing and Retrieval'. IEEE Multimedia, 1(2): 62-72, 1994
  4. M. Das, E. Riseman, and B. Draper. 'FORCUS: Searching for multi-colored objects in a Diverse Image Database,' IEEE CVPR, pp.756-761, 1997
  5. Y. Deng, D. Mukherjee, 'Object-based Video Representation,' SPIE: Storage and Retrieval for Image and Video Databases Ⅵ, pp.203-213, 1998
  6. A. Ilampapur et al., 'Mirage Video Engine,' SPIE: Storage and Retrieval for Image and Video Databases V, pp.188-197, 1997
  7. J. IIung, S. R. Kumar, M. mitra, W. Zhu, and R. Zabih, Image Indexing Using Color Corrlograms, CVPR, pp.762-768, 1997
  8. W. Niblack et al., 'The QBIC Project: Querying Images By Content Using Color, Texture, and Shape,' SPIE: Storage and Retrieval for Image and Video Databases, pp.173-181, 1993
  9. E. Petrakis and C. Faloutsos, 'Similarity Searching in Medical Image Databases,' IEEE Transactions on Knowledge and Data Engineering 9(3) pp.435-447, 1997
  10. B. IIom and B. G. Shunck, 'Determining optical flow', Artif. Intelli., vol.17, pp.185-203, 1981
  11. Rabiner, L. R., 'A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition,' Proceedings of the IEEE, vol.77, No.2, pp.257-285, February 1989
  12. M. M. Yeung and B. L. Yeo, 'Time constrained Clustering for segmentation of Video into Story Units.' IEEE ICPR, pp.375-380, 1996
  13. M. M. Yeung and B. Liu. 'Efficient matching and clustering of video shots.' IEEE ICIP Vol. I, pp.338-341, 1995
  14. Y. Linde, A. Buzo, and R. Gray, 'An Algorithm for Vector Quantizer Design'. IEEE Transaction on Communications, Vol. COM-28, No.1, pp.84-85, January, 1980