Journal of KIISE:Computing Practices and Letters (한국정보과학회논문지:컴퓨팅의 실제 및 레터)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

A Local Buffer Allocation Scheme for Multimedia Data on Linux

리눅스 상에서 멀티미디어 데이타를 고려한 지역 버퍼 할당 기법

  • Published : 2003.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

The buffer cache of general operating systems such as Linux manages file data by using global block replacement policy and read ahead. As a result, multimedia data with a low locality of reference and various consumption rate have low cache hit ratio and consume additional buffers because of read ahead. In this paper we have designed and implemented a new buffer allocation algorithm for multimedia data on Linux. Our approach keeps one read-ahead cache per every opened multimedia file and dynamically changes the read-ahead group size based on the buffer consumption rate of the file. This distributes resources fairly and optimizes the buffer consumption. This paper compares the system performance with that of Linux 2.4.17 in terms of buffer consumption and buffer hit ratio.

리눅스와 같은 범용 운영체제의 버퍼 캐시(buffer cache)는 전역적(global) 블록 교체 및 미리읽기(read ahead) 정책 등을 사용하여 파일 블록을 관리한다. 따라서, 참조의 지역성(locality)을 가지지 않고 다양한 소비율(consumption rate)을 갖고 있는 멀티미디어 데이타의 경우 캐시 시스템의 적중률이 낮을 뿐만 아니라 미리읽기의 특성으로 인하여 필요보다 과도하게 버퍼를 소비하기도 한다. 본 논문에서는 리눅스 상에서 멀티미디어 데이타를 위한 새로운 버퍼 할당 기법을 설계하고 구현하였다. 제안된 방법에서는 멀티미디어 파일마다 독립적인 미리읽기 캐시를 유지하며 미리읽기 그룹의 크기를 소비율에 비례하도록 동적으로 조절한다. 이는 공정한 자원 분배가 이루어지도록 하며, 버퍼의 소비량을 최적화되도록 한다. 본 논문에서는 구현된 시스템과 최신의 리눅스 커널 2.4.17 버전 상에서 각각 소비되는 버퍼 수와 캐시 적중률을 실험을 통하여 비교함으로써 시스템의 성능을 평가한다.

Keywords

References

  1. A. Dan and D. Towsley, 'An approximate analysis of LRU and FIFO buffer replacement schemes,' Proc. of the 1990 ACM SIGMETRICS Conference, pp. 143-149, 1990 https://doi.org/10.1145/98457.98525
  2. E.J. O'Neil, P.E. O'Neil, and Gerhard Weikum, 'The LRU-K page replacement algorithm for database disk buffering,' Proc. of the 1993 ACM SIGMOD International Conferences on Management of Data, pp. 297-306, 1993 https://doi.org/10.1145/170035.170081
  3. Theodore Johnson and Dennis Shasha, '2Q : A Low Overhead High Performance Buffer Management Replacement Algorithm,' Proc. of the 20th VLDB Conference, pp. 439-450, 1994
  4. Donghee Lee, Jongmoo Choi, and Sam H. Noh, 'On the Existence of a Spectrum of Policies that Subsumes the LRU and LFU Policies,' Proc. of the 1999 ACM SIGMETRICS Conference, pp. 134-143, 1999 https://doi.org/10.1145/301464.301487
  5. James Griffioen and Randy Appleton, 'Reducing file system latency using a predictive approach,' Proc. of the 1994 USENIX Technical Conference (Boston, MA), pp. 197-207, 1994
  6. R. Hugo Patternson, 'Informed prefetching and caching,' Proc. of the 15th ACM Symposium on Operating System Principles, pp. 79?95, 1995
  7. Tracy Kimbrel, Andrew Tomkins, R. Hugo Pat terson, and Pei Cao, 'Trace Driven Comparison of Algorithms for parallel prefetching and caching,' Proc. of the second Operating System Design and Implementation(OSDI) Symposium,' 1996 https://doi.org/10.1145/238721.238737
  8. Pei Cao, Edward W. Felten, Anna Karlin, and Kai Li, 'Implementation and Performance of Integrated Application Controlled File Caching, Prefetching and Disk Scheduling,' ACM Transaction on Computer Systems(TOCS), 1996 https://doi.org/10.1145/235543.235544
  9. Hui Lei and Dan Duchamp, 'An analytical approach to file prefetching,' Proc. of the 1997 USENIX Annual Technical Conference, 1997
  10. H. Seok Jeon and Sam H. Noh, 'Dynamic Buffer Cache Management Scheme based on Simple and Aggressive Prefetching,' Proc. of the 2000 USENIX Annual Technical Conference, 2000
  11. D.P. Anderson, U. Osawa, and R. Govindan, 'A file system for continuous media,' Proc. of the 1992 ACM Transaction Computer System, pp. 311-337, 1992
  12. S.R. Yeon and K. Koh, 'A dynamic buffer management technique for minimizing the necessary buffer space in a continuous media server,' Proc. of the International Conference on Multimedia Computing and System, IEEE, pp. 181-185, 1996 https://doi.org/10.1109/MMCS.1996.534972
  13. Kun-Lung Wu and Philp S. Yu, 'Consumption-Based Buffer Management for Maximizing System Throughput of a Multimedia System,' Proc. of the International Conference on Multimedia Computing and System, IEEE, 1996 https://doi.org/10.1109/MMCS.1996.534970
  14. I.H. Kim, J.W. Kim, S.W. Lee, and K.D. Chung, 'VBR Video Data Scheduling using Window-Based Prefetching,' Proc. of the International Conference on Multimedia Computing and System, IEEE, pp. 159-164, 1999 https://doi.org/10.1109/MMCS.1999.779140
  15. Milind M. Buddhikot, Xin Jane Chen, and Dakang Wu, 'Enhancements to 4.4 BSD UNIX for Efficient Networked Multimedia in Project MARS,' Proc. of the International Conference on Multimedia Computing and System, IEEE, 1998 https://doi.org/10.1109/MMCS.1998.693661
  16. Jongho Nang and Sungkwan Heo, 'An Efficient Buffer Management Scheme for Multimedia File System,' Proc. of the IEICE Transaction information and system, vol. E83~D, No 6, 2000
  17. P.J. Shenoy, P. Goyal, S. Rao, and H.M. Vin 'Symphony: An Integrated Multimedia File System,' Proc. of ACM/SPIE Multimedia Computing and Networking, pp. 124-138, 1998
  18. B. Ozden, R. Rastogi, and A. Silberschatz, 'Buffer Replacement Algorithms for Multimedia Storage Systems,' Proc. of IEEE International Conference on Multimedia Computing and Systems, pp. 172?180, 1996 https://doi.org/10.1109/MMCS.1996.534971
  19. 최종무 등, '적응력있는 블록 교체 기법을 위한 효율적인 버퍼 할당 정책', 정보과학회논문지: 시스템 및 이론, 제27권 제3호, 2000