Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

The Implementing a Color, Edge, Optical Flow based on Mixed Algorithm for Shot Boundary Improvement

샷 경계검출 개선을 위한 칼라, 엣지, 옵티컬플로우 기반의 혼합형 알고리즘 구현

  • Park, Seo Rin (Dept. of IT Media Engineering, Duksung Women's University) ;
  • Lim, Yang Mi (Dept. of IT Media Engineering, Duksung Women's University)
  • Received : 2018.07.15
  • Accepted : 2018.07.24
  • Published : 2018.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study attempts to detect a shot boundary in films(or dramas) based on the length of a sequence. As films or dramas use scene change effects a lot, the issues regarding the effects are more diverse than those used in surveillance cameras, sports videos, medical care and security. Visual techniques used in films are focused on the human sense of aesthetic therefore, it is difficult to solve the errors in shot boundary detection with the method employed in surveillance cameras. In order to define the errors arisen from the scene change effects between the images and resolve those issues, the mixed algorithm based upon color histogram, edge histogram, and optical flow was implemented. The shot boundary data from this study will be used when analysing the configuration of meaningful shots in sequences in the future.

Keywords

References

  1. S.Y. Kim, A Study on Scene Change Detection Using Frame Similarity in Video, Master's Thesis of Yonsei University, 2003.
  2. H.W. Yoo, D.S. Jang, and Y.K. Na, "Video Shot Boundary Detection Using Correlation of Luminance and Edge Information," Journal of Institute of Control, Robotics and Systems, Vol. 7, No. 4, pp. 304-308, 2001.
  3. J.E. Eom, S.R. Park, and Y.M. Lim, "The System Design and Implementation for Detecting the Types of Shot Size," Proceeding of International Conference of the Korea Multimedia Society, Vol. 21, No. 1, pp. 968-969, 2018.
  4. Y.M. Lim, "The Climax Expression Analysis Based on the Shot-List Data of Movies," Journal of Broadcast Engineering, Vol. 21, No. 6, pp. 965-976, 2016. https://doi.org/10.5909/JBE.2016.21.6.965
  5. M.O. Huy, K.M. Kim and B.T. Jang, "Deep Learning based Video Story Learning Technology," Journal of Korea Multimedia Society, Vol. 20, No. 3, pp. 23-40, 2016.
  6. G. Pal, D. Rudrapaul, S. Acharjee, R. Ray, S. Chakraborty, and N. Dey, "Video Shot Boundary Detection: A Review," Emerging ICT for Bridging the Future-Proceedings of the 49th Annual Convention of the Computer Society of India CSI, Vol. 2, pp. 119-127, 2015.
  7. A. Nagasaka and Y. Tanaka, "Automatic Video Indexing and Full-Video Search for Object Appearances," Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II , pp. 113-127, 1991.
  8. S.Y. Shin and P.S. Bae, "Video Browsing Using An Efficient Scene Change Detection in Telematics," Journal of Korea Society of Computer Information, Vol. 11, No. 4, pp. 147-154, 2006.
  9. S.Y. Shin, "New Shot Boundary Detection Using Local $X^2$-Histogram and Normalization," Journal of the Korea Society of Computer and Information, Vol. 12, No. 2, pp. 103-109, 2007.
  10. S.H. Yoen and J.M. Kim, "Robust Illumination Change Detection Using Image Intensity and Texture," Journal of Korea Multimedia Society, Vol. 16, No. 2, pp. 169-179, 2013. https://doi.org/10.9717/kmms.2013.16.2.169
  11. H.J. Zhang, A. Kankanhalli, and S.W. Smoliar, "Automatic Partitioning of Full-motion Video," Journal of Multimedia Systems, Vol. 1, No. 1, pp. 10-28, 1993. https://doi.org/10.1007/BF01210504
  12. A.M. Alattar, "Detecting and Compressing Dissolve Regions in Video Sequences with DVI Multimedia Image Compression Algorithm," Proceeding of International Symposium on Circuits and Systems, pp. 13-16, 1993.
  13. J.H. Song, R. Sakong, and J.H. Nang, "A Video Shot Boundary Detection Method Based on Video Partition and Convolutional Neural Network," Proceeding of Korea Information Science Society, pp. 865-867. 2017.
  14. J.S. Lee, M.H. Tak, S.K. Kim, B.J. Uoo and Y.H. Joo, "Identification and Tracking of Moving Objects Using Optical Flow Algorithm And Histogram," Journal of The Korean Institute of Electrical Engineers, Vol. 7. pp. 1436-1437, 2014.
  15. The GitHub, https://github.com/uoip/KCFpy. (accessed Aug., 30 2018)

Cited by

  1. 장르 특성 패턴을 활용한 매칭시스템 기반의 자동영상편집 기술 vol.25, pp.6, 2020, https://doi.org/10.5909/jbe.2020.25.6.861