The KIPS Transactions:PartB (정보처리학회논문지B)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Automatic Genre Classification of Sports News Video Using Features of Playfield and Motion Vector

필드와 모션벡터의 특징정보를 이용한 스포츠 뉴스 비디오의 장르 분류

  • 송미영 (수원여대 멀티미디어통신과) ;
  • 장상현 (한국교육학술정보원 기획혁신팀) ;
  • 조형제 (동국대학교 컴퓨터.멀티미디어공학과)
  • Published : 2007.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

For browsing, searching, and manipulating video documents, an indexing technique to describe video contents is required. Until now, the indexing process is mostly carried out by specialists who manually assign a few keywords to the video contents and thereby this work becomes an expensive and time consuming task. Therefore, automatic classification of video content is necessary. We propose a fully automatic and computationally efficient method for analysis and summarization of spots news video for 5 spots news video such as soccer, golf, baseball, basketball and volleyball. First of all, spots news videos are classified as anchor-person Shots, and the other shots are classified as news reports shots. Shot classification is based on image preprocessing and color features of the anchor-person shots. We then use the dominant color of the field and motion features for analysis of sports shots, Finally, sports shots are classified into five genre type. We achieved an overall average classification accuracy of 75% on sports news videos with 241 scenes. Therefore, the proposed method can be further used to search news video for individual sports news and sports highlights.

비디오와 브라우징, 검색, 조작을 위해서 비디오 내용을 기술하는 색인이 요구된다. 지금까지 색인의 구성은 대부분 비디오 내용에 제한된 키워드를 수작업으로 할당하는 전문가에 의해 수행되었는데 이는 비용과 시간을 소비하는 사업이므로 비디오 내용을 자동으로 분류하는 것이 필요하다. 이 연구는 축구, 골프, 야구, 농구, 배구 등 5종의 스포츠 뉴스 비디오의 분석과 요약을 위해서 자동적이고 효율적인 방법을 제안한다. 우선, 스포츠 뉴스 비디오를 앵커 장면과 스포츠 기사 장면으로 분류한다. 장면 분류는 앵커 장면의 영상 전처리와 색상 특정을 기반으로 한다. 그리고 필드의 우세색상과 모션 방향을 특징으로 이용하여 스포츠 장면을 5개의 장르로 분류한다. 241개의 스포츠 뉴스 장면에 대한 실험에서 75%의 정확도를 얻었다. 따라서 제안된 기법은 향후 개별 스포츠 뉴스와 스포츠 하이라이트를 위한 뉴스 비디오를 검색하는데 이용될 수 있을 것이다.

Keywords

References

  1. J. Calic and E. Izquierdo, 'Efficient Key Frame Extraction and Video Analysis', Proc. IEEE Int. Conf. on Image Processing (ICIP2002), Sep. 2002 https://doi.org/10.1109/ITCC.2002.1000355
  2. Yueting Zhuang, Ruogui Xiao and Fei Wu, 'Key Issues in Video Summarization and It's Application', Proc. IEEE Int. Conf. Information, Communications and Signal Processing. 2003 https://doi.org/10.1109/ICICS.2003.1292492
  3. By H. J. Zhang, C. Y. Low, S. W. Smoliar and J. H. Wu, 'Video Parsing, Retrieval and Browsing : An Integrated and Content-Based Solution', International Multimedia Conference, 1995, ACM https://doi.org/10.1145/217279.215068
  4. N. Babaguchi, Y. Kawai and T. Kitahashi, 'Event Based Indexing of Broadcasted Sports Video by lntermodal Collaboration', IEEE Trans. on Multimedia, 4(1) pp.68-75, 2002 https://doi.org/10.1109/6046.985555
  5. L. Duan, M. Xu, T. S. Chua. Q. Tian and C. Xu, 'A Mid Level Representation Framework for Semantic sports Video Analysis', ACM Multimedia 2003, pp.33-44 https://doi.org/10.1145/957013.957020
  6. A. Ekin, A.M. Tekalp and R. Mehrotra, 'Automatic Soccer Video Analysis and Summarization'. IEEE Trans. on Image Processing, Vol. 12:7(2003), pp.796-807 https://doi.org/10.1109/TIP.2003.812758
  7. W.-N. Lie and S. H. Shia. 'Combining Caption and Visual Features for Semantic Event Classification of Baseball Video', ICME 2005 https://doi.org/10.1109/ICME.2005.1521656
  8. S. Nepal, V. Srinivasan and G. Reynolds, 'Automatic Detection of 'Goal' Segments in Basketball Videos', ACMMM01, pp.261-269, 2001 https://doi.org/10.1145/500141.500181
  9. Z. Xiong, R. Radhakrishnan, A. Divakaran and T. S. Huang. 'Highlights Extraction from Sports Video Based on an Audio Visual Marker Detection Framework', ICME 2005 https://doi.org/10.1109/ICME.2005.1521352
  10. H. Xu, T. H. Fong and T. S. Chua, 'Fusion of Multiple Asynchronous Information Sources for Event Detection in Team Sports Video', ICME 2005 https://doi.org/10.1109/ICME.2005.1521653
  11. Sportvision Inc., 'System for Enhancing a Video Presentation of a Live Event', U.S. Patent 6,597,406, January 26, 2001
  12. J. Assfalg, M. Bertini, C. Colombo and A. Del-Bimbo, 'Semantic Annotation of Sports Videos', IEEE Multimedia, vol.9, p.52-60, April 2002 https://doi.org/10.1109/93.998060
  13. Y. Rui, A. Gupta and A. Acero, 'Automatically Extracting Highlights for TV Baseball Programs', ACM MM00, pp.105-115, Oct. 2000 https://doi.org/10.1145/354384.354443
  14. K. W. Wan, X. Yan and C. Xu, 'Automatic Mobile Sports Highlights', ICME 2005 https://doi.org/10.1109/ICME.2005.1521504
  15. M. Xu, N. C. Maddage, C. Xu, M. Kankanhalli and Q. Tian, 'Creating Audio Keywords for Event Detection in Soccer Video', ICME 2003 Vol II, 281-284 https://doi.org/10.1109/ICME.2003.1221608
  16. T. D'Orazio, C. Guarangnella, M. Leo and A. Distante, 'A New Algorithm for Ball Recognition Using Circle Hough Transform and Neural Classifier, Pattern Recognition', vol. 37, pp.393-408, 2004 https://doi.org/10.1016/S0031-3203(03)00228-0
  17. D. Farin, J. Han and P.H.N. de With, 'Fast Camera Calibration for the Analysis of Sport Sequence', ICME 2005 https://doi.org/10.1109/ICME.2005.1521465
  18. D. Farin, S. Krabbe, W. Effelsberg and P.H.N. de With, 'Robust Camera Calibration for Sport Videos Using Court Models', SPIE, vol, 5307, pp.80-91, 2004 https://doi.org/10.1117/12.526813
  19. X. Yu, C. Xu, H. W. Leong, Q. Tian, Q. Tang and K. W. Wan, 'Trajectory Based Ball Detection and Tracking with Applications to Semantic Analysis of Broadcast Soccer Video', ACM MM03, pp.11-20, 2003 https://doi.org/10.1145/957013.957018
  20. X. Yu, H. W. Leong, J. H. Lim, Q. Tian and Z. Jiang, 'Team Possession Analysis for Broadcast Soccer Video Based on Ball Trajectory', PCM 03. pp.1811-1815, 2003 https://doi.org/10.1109/ICICS.2003.1292779
  21. X. Yu, T. S. Hay, Xin Yan and E. Chua, 'A Player Possession Acquisition System for Broadcast Soccer Video', ICME 2005 https://doi.org/10.1109/ICME.2005.1521475
  22. Y. Gong, T. S. Lim and H. C. Chua, H. J. Zhang, and M. Sakauchi, 'Automatic Parsing of TV Soccer Programs', 2nd Int. C. on Multimedia Comp. and Sys., pp.167-174, 1995 https://doi.org/10.1109/MMCS.1995.484921
  23. L. Xie, P. Xu and S. F. Chang, A. Divakaran, and H. Sun, 'Structure Analysis of Soccer Video with Domain Knowledge and Hidden Markov Models', P.R. Letter, vol 25, pp.767-775, 2004 https://doi.org/10.1016/j.patrec.2004.01.005
  24. T. Koyama, I. Kitahara and Y. Ohta, 'Live 3D Video in Soccer Stadium', 2rd IEEE & ACM Int. Symp. on. Mixed and Aug. Reality, pp.178-186. 7-10 Oct. 2003, Japan
  25. L. Duan. M. Xu and Q. Tian, 'Semantic Shot Classification in Sports Video', SPIE: (SRMD) 03, pp.300-313, 2003 https://doi.org/10.1117/12.476259
  26. I. Reid and A. Zisserman, 'Goal Directed Video Metrology', ECCV 96 (vol II), LNCS 1065. pp.647-658, 1996 https://doi.org/10.1007/3-540-61123-1_178
  27. Wang, D H. tain.Q. Gao, S. Sung and W. K., 'News Sports Video Shot Classification with Sports Play Field and Motion Features', ICIP'04 International Conference, Oct. 2004. Vol.4, pp.2247-2250 https://doi.org/10.1109/ICIP.2004.1421545
  28. X. Gibert, H. Li and D. Doermann, 'Sports Video Classification using HMMs', Multimedia and Expo, 2003. ICME'03. Proceedings. 2003 International Conference on. Volume: 2. 6-9 July 2003. pp345-348 https://doi.org/10.1109/ICME.2003.1221624
  29. E. Sahouria and A. Zakhor, 'Content Analysis of Video Using Principal Components', IEEE Trans. on Circuits and Systems for Video Technology', Vol. 9, No. 8, Dec 1999 https://doi.org/10.1109/76.809163
  30. Hong Lu, Yap-Peng and Tan, 'Content Based Sports Video Analysis and Modeling', in Proceedings of 7th International Conference on Control, Automation, Robotics and Vision (ICARCV '02), pp.1198-1203
  31. Assfalg, J. Bertini, M. Colombo and C. Bimbo, 'Semantic Annotation of Sports Videos', Multimedia, IEEE Publication. Apr-Jun 2002, Volume: 9, pp.52-60 https://doi.org/10.1109/93.998060
  32. Assfalg, J. Bertini, M. Colombo, and C. Bimbo, Extracting Semantic Information from News and Sport Video', Image and Signal Processing and Analysis, 2001. ISPA 2001. pp.4-11, 2001 https://doi.org/10.1109/ISPA.2001.938597
  33. Ekin, A. Tekalp and A.M., 'Shot Type Classification by Dominant Color for Sports Video Segmentation and Summarization', Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). April 2003, Volume 3, pp. 173-176 https://doi.org/10.1109/ICASSP.2003.1199135