DOI QR코드

DOI QR Code

Multilayer VVC와 SHVC의 성능 평가

The Performance Evaluation of Multilayer VVC and SHVC

  • 투고 : 2021.02.04
  • 심사 : 2021.03.09
  • 발행 : 2021.03.30

초록

본 논문은 multilayer VVC와 SHVC의 성능을 평가한다. Multilayer VVC는 다-계층 부호화 방식을 지원하며, SHVC와 비교하여 많은 기술이 추가 및 확장되었다. 이러한 이유로 VVC의 다-계층 부호화 성능과 계층 간 참조(Inter-layer reference) 예측에 대한 부호화 성능 평가가 필요하다. Multilayer VVC는 SHVC 대비 AI, RA, LDB, LDP 환경에서 각각 평균 24.4%, 29.4%, 29.4%, 32.6%의 BD-rate가 감소하는 실험 결과를 보였으며, 더 효율적으로 scalability를 제공할 수 있다는 것을 보인다. 반면 부호화 시간 복잡도는 평균 14배, 복호화 시간 복잡도는 평균 1.8배 증가하여 시간 복잡도를 줄이는 노력이 필요하다.

This paper evaluates the performance of multilayer VVC and SHVC. Multilayer VVC supports a multi-layer coding and many coding technologies have been added and extended compared to SHVC. For this reason, it is necessary to evaluate the multi-layer coding performance of VVC and the coding performance for inter-layer reference prediction. Multilayer VVC provides significant BD-rate improvement of AI 24.4%, RA 29.4%, LDB 29.4%, LDP 32.6% on average when compared to SHVC, so that it is shown that VVC can provide scalability more efficiently. On the other hand, the complexity of the encoding time increases by an average of 14 times and decoding time by an average of 1.8 times, which requires efforts to reduce the complexity.

키워드

참고문헌

  1. S. Park and D. Sim, "Prospects for the development of ultra-high efficiency video coding technology", The Korea Institute of Information and Communication Engineering, Vol.34, No.7, pp.3-9, June 2017.
  2. G. Sullivan, J. Ohm, W. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) Standard", IEEE Transactions on Circuits and Systems for Video Technology, Vol.22, No.12, pp.1649-1668, December 2012. https://doi.org/10.1109/TCSVT.2012.2221191
  3. G. Kim, H. Jo, D. Sim, and Y. Jang, "Scalable HEVC standard technology trend", The Korea Institute of Information and Communication Engineering, Vol.30, No.9, pp.49-57, August 2013.
  4. H. Choi, K. Lee, J. Kang, S. Bae, and J. Yoo, "Overview and Performance Analysis of the Emerging Scalable Video Coding", Journal of Broadcast Engineering, Vol.12, No.6, pp.542-554, November 2007. https://doi.org/10.5909/JBE.2007.12.6.542
  5. H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the Scalable Video Coding Extension of the H.264/AVC Standard", IEEE Transactions on Circuits and Systems for Video Technology, Vol.17, No.9, pp.1103-1120, September 2007. https://doi.org/10.1109/TCSVT.2007.905532
  6. J. M. Boyce. Y. Ye, J. Chen, and A. K. Ramasubramonian, "Overview of SHVC: Scalable Extensions of the High Efficiency Video Coding Standard", IEEE Transactions on Circuits and Systems for Video Technology, Vol.26, No.1, pp.20-34, July 2016. https://doi.org/10.1109/TCSVT.2015.2461951
  7. J. Lee, J. Park, H. Choi, J. Byeon, and D. Sim, "Overview of VVC", Broadcasting and Media Magazine, Vol.24, No.4, pp.10-25, October 2019.
  8. B. Bross, J. Chen, S. Liu, and Y.-K. Wang, JVET-S2001, "Versatile Video Coding (Draft 10)", Jul. 2020.
  9. C. Helmrich, B. Bross, J. Pfaff, H. Schwarz, D. Marpe, and T. Wiegand, JVET-T0103, "Information on and analysis of the VVC encoders in the SDR UHD verification test", Oct. 2020.
  10. Hendry, Y.-K. Wang, J. Chen, T. Davies, A. Fuldseth, Y. C. Chang, and J. Lou, JVET-M0135, "On adaptive resolution change (ARC) for VVC", Jan. 2019.
  11. B. Choi, S. Wenger, and S. Liu, JVET-O0332, "AHG8: Signaling and Filtering for Reference Picture Resampling", Jul. 2019.
  12. S. Wenger, B. Choi, S.-C. Han, X. Li, and S. Liu, JVET-O0045, "AHG8: Spatial Scalability using Reference Picture Resampling", Jul. 2019.
  13. M. Karczewicz, L. Zhang, W.-J. Chien, and X. Li, JVET-B0060, "Improvements on adaptive loop filter", Feb. 2016.
  14. F. Pu, S. McCarthy, T. Lu, P. Yin, W. Husak, and T. Chen, JVET-O0432, "AHG10: LMCS encoder improvement", Jul. 2019.
  15. X. Xu, X. Li, and S. Liu, JVET-M0407, "CE8: CPR reference memory reuse without increasing memory requirement (CE8.1.2a and CE8.1.2d)", Jan. 2019.
  16. F. Racape, G. Rath, F. Urban, L. Zhao, S. Liu, X. Zhao, and X. Li, JVET-K0500, "CE3-related: Wide-angle intra prediction for non-square blocks", Jul. 2018.
  17. P-H. Lin, P. Sung, C.-C. Lin, and C.-L. Lin, JVET-J0070, "Multiple reference line intra prediction based on JEM7.0", Apr. 2018.
  18. G. Laroche, J. Taquet, C. Gisquet, and P. Onno, JVET-K0204, "Non-CE3: On cross-component linear model simplification", Jul. 2018.
  19. X. Zhao, V. Seregin, A. Said, and M. Karczewicz, JVET-H0057, "EE1 related: Simplification and extension of PDPC", Oct. 2017.
  20. S. De-Luxan-Hernandez, V. George, J. Ma, T. Nguyen, H. Schwarz, D. Marpe, and T. Wiegand, JVET-M0102, "CE3: Intra Sub-Partitions Coding Mode (Tests 1.1.1 and 1.1.2)", Jul. 2019.
  21. J. Pfaff, T. Hinz, P. Helle, P. Merkle, B. Stallenberger, M. Schafer, H. Schwarz, D. Marpe, and T. Wiegand, JVET-O0084, "8-bit implementation and simplification of MIP", Jul. 2019.
  22. H. Jang, J. Nam, S.-H. Kim, and J. Lim, JVET-K0079, "[CE4-2.6] Simplified ATMVP", Jul. 2018.
  23. L. Zhang, K. Zhang, H. Liu, J. Xu, Y. Wang, P. Zhao, and D. Hong, JVET-M0273, "CE2-related: Early awareness of accessing temporal blocks in sub-block merge list construction", Jan. 2019.
  24. S. Jeong, M. W. Park, Y. Piao, M. Park, and K. Choi, JVET-L0054, "Proposed WD for CE4 Ultimate motion vector expression (Test 4.5.4)", Oct. 2018.
  25. S. Esenlik, H. Gao, A. Filippov, V. Rufitskiy, A. M. Kotra, B. Wang, Z. Zhao, E. Alshina, M. Blaser, and J. Sauer, JVETO0489, "Non-CE4: Geometrical partitioning for inter blocks", Jul. 2019.
  26. N. Park, H. Jang, J. Nam, J. Lee, J. Lim, and S. H. Kim, JVET-L0158, "CE4-related: History-based Motion Vector Prediction", Oct. 2018.
  27. Y.-L. Hsiao, T.-D. Chuang, C.-Y. Chen, C.-W. Hsu, Y.-W. Huang, and S.-M. Lei, JVET-L0090, "CE4.4.12: Pairwise average candidates", Oct. 2018.
  28. M.-S. Chiang, C.-W. Hsu, Y.-W. Huang, and S.-M. Lei, JVET-L0100, "CE10.1.1: Multi-hypothesis prediction for improving AMVP mode, skip or merge mode, and intra mode", Oct. 2018.
  29. Y. Zhang, Y. Han, C.-C. Chen, C.-H. Hung, W.-J. Chien, and M. Karczewicz, JVET-K0357, "CE4.3.3: Locally adaptive motion vector resolution and MVD coding", Jul. 2018.
  30. X. Xiu, Y. He, and Y. Ye, JVET-L0256, "CE9-related: Complexity reduction and bit-width control for bi-directional optical flow (BIO)", Oct. 2018.
  31. Y.-C. Su, C.-Y. Chen, Y.-W. Huang, and S.-M. Lei, JVET-L0646, "CE4-related: Generalized bi-prediction improvements combined from JVET-L0197 and JVET-L0296", Oct. 2018.
  32. Y. Zhao, H. Gao, H. Yang, and J. Chen, JVET-M0140, "CE6: Sub-block transform for inter blocks (CE6.4.1)", Jan. 2019.
  33. M. Koo and J. Lim, JVET-N0193, "CE6: Reduced Secondary Transform (RST) (CE6-3.1)", Mar. 2019.
  34. H. Schwarz, T. Nguyen, D. Marpe, and T.Wiegand, JVET-K0072, "Non-CE7: Alternative entropy coding for dependent quantization", Jul. 2018.
  35. F. Bossen, JVET-M0453, "CE5 on arithmetic coding: experiments 5.1.1, 5.1.2, 5.1.3, 5.1.4, 5.1.5, 5.1.6, 5.1.7, 5.1.8, 5.1.10, 5.1.11, 5.1.12, 5.1.13, 5.2, and more", Jan. 2019.
  36. J. Samuelsson, S. Deshpande, and A. Segall, JVET-P0088, "CE1-1: RPR downsampling filter", Oct. 2019.
  37. G. Barroux, J. Chen, J. Boyce, Y. Ye, and M. M. Hannuksela, JCTVC-V1007, "SHVC Test Model 11 (SHM 11) Introduction and Encoder Description", Feb. 2015.
  38. J. Chen, Y. Ye, and S. H. Kim, JVET-S2002, "Algorithm description for Versatile Video Coding and Test Model 10 (VTM 10)", Jul. 2020.
  39. V. Seregin and Y. He, JCTVC-Q1009, "Common SHM test conditions and software reference configurations", Apr. 2014.
  40. G. Bjontegaard, VCEG-AI11, "Improvements of the BD-PSNR model", Jul. 2008.