Journal of the Korea Institute of Military Science and Technology (한국군사과학기술학회지)

The Korea Institute of Military Science and Technology (한국군사과학기술학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on the Latest Trends of Video Bit-Rate Control Technology and Prospects for the Development of Bit-Rate Control Technology in Defense and Aerospace Imaging Systems

비디오 비트율 제어 기술의 최신 동향 분석과 국방 및 항공우주 영상시스템의 비트율 제어 기술 발전 방향 전망

  • Myunghan Hyun (Control and Robot Engineering, Gyeongsang National University)
  • 현명한 (경상국립대학교 제어로봇공학과)
  • Received : 2024.08.19
  • Accepted : 2024.11.04
  • Published : 2024.12.05
Download PDF
⟨ Previous Next ⟩

Abstract

Video bit-rate control techniques are essential for efficiently transmitting videos over communication networks. These techniques have been pivotal in broadcasting and internet streaming services, and they could significantly enhance defense capabilities if applied to defense and aerospace imaging systems. Therefore, this paper first reviews the history and standard technologies of video coding, then describes the standard trends of the latest video coding technologies. Finally, it outlines the features of the latest video bit-rate control techniques and discusses their applicability in the defense and aerospace fields.

Keywords

References

  1. Use cases and requirements for Video Coding for Machines, ISO/IEC JTC1/SC29/WG2 N190, 2022.04 
  2. B. Bross, J. Chen, S. Liu, and Y. Wang, "Versatile video coding editorial refinements on draft 10," in Proc. 20th Meeting, Teleconference, pp. 1-114, 2020. 
  3. MPEG-2 Test Model 5, ISO/IEC JTC1/SC29 WG11/93-400, 1993. 
  4. T. Wiegand, G. J. Sullivan, G. BjOntegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., Vol. 13, No. 7, pp. 560-576, Jul. 2003.  https://doi.org/10.1109/TCSVT.2003.815165
  5. G. J. Sullivan, J.-R. Ohm, W.-J. Han, and T. Wiegand, "Overview of the high efficiency video coding(HEVC) standard," IEEE Trans. Circuits Syst. Video Technol., Vol. 22, No. 12, pp. 1649-1668, Dec. 2012.  https://doi.org/10.1109/TCSVT.2012.2221191
  6. B. Bross et al., "Overview of the versatile video coding(VVC) standard and its applications," IEEE Trans. Circuits Syst. Video Technol., Vol. 31, No. 10, pp. 3736-3764, Oct. 2021.  https://doi.org/10.1109/TCSVT.2021.3101953
  7. M. H. Hyun, "A study on particle filtering based prediction for rates and distortions of video coding and an application to rate control," Ph.D. dissertation, Dept. of Elec. Engine., KAIST, Daejeon, Republic of Korea, 2021. 
  8. J. Balle, V. Laparra, and E. P. Simoncelli, "End-to-end optimized image compression," arXiv:1611.01704v3. 2017. 
  9. G. Lu, W. Ouyang, D. Xu, X. Zhang, C. Cai, and Z. Gao, "Dvc: An end-to-end deep video compression framework," Proceedings of the IEEE/CVF CVPR, 2019. 
  10. G. Bang, "Neural network video representation technology and MPEG-INVR standardization trends," Broadcast and Media Magazine, Vol. 28, No. 3, pp. 45-54, 2023. 
  11. W. Bailer, et al., "Text of ISO/IEC FDIS 15938-17 Compression of neural networks for multimedia content description and analysis," ISO/IEC JTC1/SC29/WG4, N20331, Jun. 2021. 
  12. T. Chiang and Y.-Q. Zhang, "A new rate control scheme using quadratic rate distortion model," IEEE Trans. Circuits Syst. Video Technol., Vol. 7, No. 1, pp. 246-250, Feb. 1997.  https://doi.org/10.1109/76.554439
  13. Y. Chang and M. Kim, "Hybrid codec-based intraframe joint rate control for stereoscopic video," IEEE Signal Process. Lett., Vol. 18, No. 10, pp. 543-546, Oct. 2011.  https://doi.org/10.1109/LSP.2011.2162504
  14. X. Jing, L. P. Chau, and W. C. Siu, "Frame complexity-based rate-quantization model for H.264/AVC intraframe rate control," IEEE Signal Process. Lett., vol. 15, pp. 373-376, Mar. 2008.  https://doi.org/10.1109/LSP.2008.920010
  15. M. H. Wang, K. N. Ngan, and H. L. Li, "An efficient frame-content based intra frame rate control for high efficiency video coding," IEEE Signal Process. Lett., Vol. 22, No. 7, pp. 896-900, Jul. 2015.  https://doi.org/10.1109/LSP.2014.2377032
  16. M. Karczewicz and X. Wang, "Intra frame rate control based on SATD," JCTVC-M0257, 13th meeting, Incheon, KR, 2013. 
  17. B. Yan and M. H. Wang, "Adaptive distortion-based intra-rate estimation for H.264/AVC rate control," IEEE Signal Procss. Lett., Vol. 16, No. 1-3, pp. 145-148, Mar. 2009.  https://doi.org/10.1109/LSP.2008.2010813
  18. E. Y. Lam and J. W. Goodman, "A mathematical analysis of the DCT coefficient distribution for images," IEEE Trans. Image Process., Vol. 9, No. 10, pp. 1661-1666, Oct. 2000.  https://doi.org/10.1109/83.869177
  19. N. Kamaci, Y. Altunbasak, and R. Mersereau, "Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion models," IEEE Trans. Circuits Syst. Video Technol., Vol. 15, No. 8, pp. 994-1006, Aug. 2005.  https://doi.org/10.1109/TCSVT.2005.852400
  20. Z. He and S. K. Mitra, "Optimum bit allocation and accurate rate control for video coding via ρ-domain source modeling," IEEE Trans. Circuits Syst. Video Technol., Vol. 12, No. 10, pp.840-849, Oct. 2002.  https://doi.org/10.1109/TCSVT.2002.804883
  21. H. Choi, J. Yoo, J. Nam, D. Sim, and I. V. Bajic, "Pixel-wise unified rate-quantization model for multi-level rate control," IEEE J. Sel. Topics Signal Process., Vol. 7, No. 6, pp. 1112-1123, Dec. 2013.  https://doi.org/10.1109/JSTSP.2013.2272241
  22. B. Lee and M. Kim, "Modeling rates and distortions based on a mixture of Laplacian distributions for inter-predicted residues in quadtree coding of HEVC," IEEE Signal Process. Lett., Vol. 18, No. 10, pp. 571-574, Oct. 2011.  https://doi.org/10.1109/LSP.2011.2163935
  23. B. Lee, M. Kim, T. Q. Nguyen, "A frame level rate control scheme based on texture and nontexture rate models for high efficiency video coding," IEEE Trans. Circuits Syst. Video Technol., Vol. 24, No. 3, pp. 465-479, Mar. 2014.  https://doi.org/10.1109/TCSVT.2013.2276880
  24. C. W. Seo, J. H. Moon, and J. K. Han, "Rate control for consistent objective quality in high efficiency video coding," IEEE Trans. Image Process., Vol. 22, No. 6, pp. 2442-2454, Jun. 2013.  https://doi.org/10.1109/TIP.2013.2251647
  25. Z. W. Zhang, T. Jing, J. N. Han, Y. W. Xu, and F. Zhang, "A new rate control scheme for video coding based on region of interest," IEEE Access, Vol. 5, pp. 13677-13688, Mar. 2017.  https://doi.org/10.1109/ACCESS.2017.2676125
  26. W. Gao, S. Kwong, H. Yuan, and X. Wang, "DCT coefficient distribution modeling and quality dependency analysis based frame-level bit allocation for HEVC," IEEE Trans. Circuits Syst. Video Technol., Vol. 26, No. 1, pp. 139-153, Jan. 2016.  https://doi.org/10.1109/TCSVT.2015.2444671
  27. B. Li, H. Li, L. Li, and J. Zhang, "λ domain rate control algorithm for high efficiency video coding," IEEE Trans. Image Process., Vol. 23, No. 9, pp. 3841-3854, Sep. 2014.  https://doi.org/10.1109/TIP.2014.2336550
  28. B. Li, D. Zhang, H. Li, and J. Xu, QP determination by lambda value, document JCTVC-I0426, Geneva, CH, May 2012. 
  29. B. Li, H. Li, L. Li, and J. Zhang, rate control by R-lambda model for HEVC, document JCTVC-K0103, Shanghai, China, Oct. 2012. 
  30. G. J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Process. Magazine, Vol. 15, No. 6, pp. 74-90, Nov. 1998.  https://doi.org/10.1109/79.733497
  31. S. Boyd and L. Vandenberghe, "Unconstrained minimization," in Convex Optimization, 7th ed., NY, USA: Cambridge University Press, pp. 457-520, 2009. 
  32. S. Mallat and F. Falzon, "Analysis of low bit rate image transform coding," IEEE Trans. Signal Process., Vol. 46, No. 4, pp. 1027-1042, Apr. 1998.  https://doi.org/10.1109/78.668554
  33. M. H. Hyun, B. Lee, and M. Kim, "A VVC intra rate control with small bit fluctuations using a Lagrange multiplier adjustment," IEEE Trans. Multimedia, Vol. 26, pp. 6811-6821, Jan. 2024.  https://doi.org/10.1109/TMM.2024.3355633
  34. A. Browne, Y. Ye, and S. Kim, "Algorithm description for versatile video coding and test model 16(VTM16)," in Proc. 25th Meeting, Teleconference, pp. 1-256, 2022. 
  35. M. H. Hyun, B. Lee, and M. Kim, "A frame-level constant bit-rate control using recursive bayesian estimation for versatile video coding," IEEE Access, Vol. 8, pp. 227255-227269, 2020.  https://doi.org/10.1109/ACCESS.2020.3046043
  36. Y. Chen et al., "Intra frame rate control for versatile video coding with quadratic rate-distortion modelling," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., pp. 4422-4426, 2020.