The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on the Application of Zero Copy Technology to Improve the Transmission Efficiency and Recording Performance of Massive Data

대용량 데이터의 전송 효율 및 기록 성능 향상을 위한 Zero Copy 기술 적용에 관한 연구

  • Received : 2021.10.18
  • Accepted : 2021.12.17
  • Published : 2021.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Zero-copy is a technology that is also called no-memory copy, and through its use, context switching between the user space and the kernel space can be reduced to minimize the load on the CPU. However, this technology is only used to transmit small random files, and has not yet been widely used for large file transfers. This paper intends to discuss the practical application of zero-copy in processing large files via a network. To this end, we first developed a small test bed and program that can transmit and store data based on zero-copy. Afterwards, we intend to verify the usefulness of the applied technology in detail through detailed performance evaluation

Zero-copy는 메모리 무복사로도 불리는 기술로서 이에 대한 사용을 통해 사용자 영역과 커널 영역 간 컨텍스트 스위칭을 줄여 CPU의 부하를 최소화할 수 있다. 하지만 이 기술은 소규모의 랜덤한 파일을 전송하는 용도에 그치고, 대용량 파일 전송에는 아직 널리 활용되지 못하고 있다. 본 논문은 네트워크를 경유한 대용량 파일 처리에 있어서 Zero-copy의 실질적인 적용 방안에 대해 논의하고자 한다. 이를 위해 먼저 Zero-copy 기반으로 데이터를 전송, 저장할 수 있는 소규모 테스트베드 구축 및 프로그램을 개발하였다. 이후 세부 성능 평가를 통해 적용된 기술의 유용성을 세부 검증하고자 한다.

Keywords

References

  1. D. Reinsel, J. Gantz, and J. Rydning, The Digitization of the World From Edge to Core. Framingham: IDC, 2018.
  2. M. Song, H. Kim, Y. Kang, D. Je, S. Wi, and S. Lee, "Implementation of Ring Buffer based Massive VLBI Data Stream Input/Output over the Wide Area Network," J. of the Korea Institute of Electronic Communication Sciences, vol. 14, no. 6, 2019, pp. 1109-1120. https://doi.org/10.13067/JKIECS.2019.14.6.1109
  3. W. Allcock, J. Bresnahan, R. Kettimuthu, and M. Link, "The Globus Striped GridFTP Framework and Server," In Proc. IEEE SC'05 ACM/IEEE conference on Supercomputing, Seattle, U.S.A, 2005, pp. 54-54.
  4. Univer of Southcarolina, "NETWORK TOOLS AND PROTOCOLS Lab 9: Enhancing TCP Throughput with Parallel Streams," Technical report, June 2019.
  5. S. Fuller and L. Millett, The Future of Computing Performance: Game Over or Next Level? Washington, D.C.: National Acamedies Press, 2011.
  6. J. Song and J. Foss, "Performance Review of Zero Copy Techniques," International Journal of Computer Science and Security (IJCSS)., vol. 6, no. 4, 2012, pp. 256-268.
  7. D. Stancevic, Zero Copy I: User-Mode Perspective. Houston: Slashdot Media, 2003.
  8. S. Palaniappan and P. Nagaraja, Efficient data transfer through zero copy. New York: IBM Developer, 2008.
  9. H. Kim and M. Song, "Development and Application of HDD I/O Measurement Utility," J. of the Korea Institute of Electronic Communication Sciences, vol. 15, no. 6, 2020, pp. 1151-1158. https://doi.org/10.13067/JKIECS.2020.15.6.1151
  10. B. Tinerney, Experiences with 40G/100G Applications. Berkeley: ESnet, 2014.