• Title/Summary/Keyword: delta compression

Search Result 77, Processing Time 0.027 seconds

Improving the Lifetime of NAND Flash-based Storages by Min-hash Assisted Delta Compression Engine (MADE (Minhash-Assisted Delta Compression Engine) : 델타 압축 기반의 낸드 플래시 저장장치 내구성 향상 기법)

  • Kwon, Hyoukjun;Kim, Dohyun;Park, Jisung;Kim, Jihong
    • Journal of KIISE
    • /
    • v.42 no.9
    • /
    • pp.1078-1089
    • /
    • 2015
  • In this paper, we propose the Min-hash Assisted Delta-compression Engine(MADE) to improve the lifetime of NAND flash-based storages at the device level. MADE effectively reduces the write traffic to NAND flash through the use of a novel delta compression scheme. The delta compression performance was optimized by introducing min-hash based LSH(Locality Sensitive Hash) and efficiently combining it with our delta compression method. We also developed a delta encoding technique that has functionality equivalent to deduplication and lossless compression. The results of our experiment show that MADE reduces the amount of data written on NAND flash by up to 90%, which is better than a simple combination of deduplication and lossless compression schemes by 12% on average.

A Study of Big Time Series Data Compression based on CNN Algorithm (CNN 기반 대용량 시계열 데이터 압축 기법연구)

  • Sang-Ho Hwang;Sungho Kim;Sung Jae Kim;Tae Geun Kim
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.18 no.1
    • /
    • pp.1-7
    • /
    • 2023
  • In this paper, we implement a lossless compression technique for time-series data generated by IoT (Internet of Things) devices to reduce the disk spaces. The proposed compression technique reduces the size of the encoded data by selectively applying CNN (Convolutional Neural Networks) or Delta encoding depending on the situation in the Forecasting algorithm that performs prediction on time series data. In addition, the proposed technique sequentially performs zigzag encoding, splitting, and bit packing to increase the compression ratio. We showed that the proposed compression method has a compression ratio of up to 1.60 for the original data.

Anisotropy in Strength and Deformation Properties of a Variety of Sands by Plane Strain Compression Tests(I) Strength Anisotropy (평면변형률 압축시험에 의한 각종 모래의 강도.변형특성의 이방성(I) -강도 이방성-)

  • 박춘식
    • Geotechnical Engineering
    • /
    • v.13 no.5
    • /
    • pp.5-18
    • /
    • 1997
  • Anisotropy in strength and deformation characteristics of isotropically consolidated sande prepared by pluviating through air was studied by plane strain compression tests. Seven types of sand of the world-wide origins were tested, which have been extensively used for research purposes. The strains for direction of bmazimum principal stress and direction of minimum principal strews were measured continuously from $10^{-6}\; to 10^{-2}$. The following results were obtained for all sands. The behaviour at strains leas than about 0.001% was elastic and isotropic regardless of the angle $\delta\; of\; the\;\sigma$ direction relative to the bedding plane. However, the sands became gradually more anisotropic as the strain increased to the extent exceeding the elastic limit. The peak strength was noticeably anisotropic with a similar trend. Thus, the angle of internal friction $\phi\; decreased \;as\;\delta$ decreased from $90^{\circ}$, and the ratio of the smallest to largest values of was between 0.82 and 0.90. The l has a minimum at $\delta=0^{\circ}~30^{\circ}$ depending on the hypes of sand. The residual strength became isotropic again.

  • PDF

Prediction of Compression Index of Busan and Inchon Clays Considering Sedimentation State (부산과 인천점토의 퇴적상태를 고려한 압축지수 추정)

  • Hong, Sung-Jin;Kim, Dong-Hee;Choi, Young-Min;Lee, Woo-Jin
    • Journal of the Korean Geotechnical Society
    • /
    • v.27 no.9
    • /
    • pp.37-46
    • /
    • 2011
  • The compression index, which represents the compressibility of clay, is generally obtained from the consolidation test, or has been predicted by empirical correlations with soil properties. In this study, the results of consolidation tests on natural and reconstituted Busan and Inchon clays are analyzed to figure out the sedimentation state and its effect on empirical correlations. Results of analysis show that the void index of Busan clay is higher than SCL while the void index of Inchon clay is lower than SCL. By comparing prediction errors with ${\Delta}e_r$, which represents the sedimentation state of clay, it is shown that errors predicting the compressibility based on the liquid limit and plasticity index decrease as ${\Delta}e_r$ increases. Supplemented correlations predicting the compression index of Busan and Inchon clays are suggested using these relationships.

The Synthesis of 2-Methyl-5,5'-gem-Disubstituted-${\Delta}^2$-Thiazolines (2-Methyl-5,5'-gem-Disubstituted-${\Delta}^2$-Thiazoline系 化合物의 合成)

  • Chi Sun Hahn
    • Journal of the Korean Chemical Society
    • /
    • v.7 no.4
    • /
    • pp.230-237
    • /
    • 1963
  • The synthesis of 2-methyl-5,5'-gem-disubstituted-$\Delta^2$-thiazolines has been undertaken by two methods. The first involves the preparation of gem-disubstituted N-or S-acetylamino mercaptan intermediates by ring opening of the corresponding thiiranes with ammonia. The second consists of the ring opening of gem-disubstituted ethylene imines using thiolacetic acid. The thiirane rings have never been opened under conditions as vigorous as that of using sodium amide in liquid ammonia. This is probably due to retardation by the gem-disubstituents. In contrast to this, the corresponding ethylene imine ring opens easily, in spite of the same stereochemical situation. The stabilization of gem-disubstituted cyclic compounds has been discussed from a stereochemical point of view. It has been concluded from the results of this work that the compression effect of gem-disubstitution is not due to bond angle deformation, which was observed by Thorpe and Ingold, but mostly to an electronic bond interaction of the gem-disubstituents and to the hetero atom(s), if any.

  • PDF

Moving Picture Compression for the Probability Entropy in 3D-DCT Frames. (3D -DCT 프레임간 확률 엔트로피에 의한 동영상 압축)

  • 박동춘;최재윤서경호김태효
    • Proceedings of the IEEK Conference
    • /
    • 1998.10a
    • /
    • pp.863-866
    • /
    • 1998
  • In this paper, we proposes Moving Picture Compression reducing bit numbers within the block by probability in 3D-DCT considered of temporal axis. From Delta Modification theory for frequency components, bit numbers within the block(4$\times$4) were properly compressed by using the Probability Entropy. At the result for the proposed algorithm, we could find that the values of PSNR for resolution and the compression rate were better than existing methods.

  • PDF

Latent Shifting and Compensation for Learned Video Compression (신경망 기반 비디오 압축을 위한 레이턴트 정보의 방향 이동 및 보상)

  • Kim, Yeongwoong;Kim, Donghyun;Jeong, Se Yoon;Choi, Jin Soo;Kim, Hui Yong
    • Journal of Broadcast Engineering
    • /
    • v.27 no.1
    • /
    • pp.31-43
    • /
    • 2022
  • Traditional video compression has developed so far based on hybrid compression methods through motion prediction, residual coding, and quantization. With the rapid development of technology through artificial neural networks in recent years, research on image compression and video compression based on artificial neural networks is also progressing rapidly, showing competitiveness compared to the performance of traditional video compression codecs. In this paper, a new method capable of improving the performance of such an artificial neural network-based video compression model is presented. Basically, we take the rate-distortion optimization method using the auto-encoder and entropy model adopted by the existing learned video compression model and shifts some components of the latent information that are difficult for entropy model to estimate when transmitting compressed latent representation to the decoder side from the encoder side, and finally compensates the distortion of lost information. In this way, the existing neural network based video compression framework, MFVC (Motion Free Video Compression) is improved and the BDBR (Bjøntegaard Delta-Rate) calculated based on H.264 is nearly twice the amount of bits (-27%) of MFVC (-14%). The proposed method has the advantage of being widely applicable to neural network based image or video compression technologies, not only to MFVC, but also to models using latent information and entropy model.

Cure Behavior, Compression Set and Dynamic Mechanical Properties of EPDM/NBR Blend Vulcanizates (EPDM/NBR 블렌드 가황체의 가교 거동, 영구 압축 줄음율 및 동적 기계적 성질)

  • 박찬영
    • Polymer(Korea)
    • /
    • v.25 no.2
    • /
    • pp.233-239
    • /
    • 2001
  • The ethylene propylene diene terpolymer (EPDM) blends with acrylonitrile butadiene rubber (NBR) were prepared by mechanical mixing method. Mooney viscosity, cure behaviors, compression set and dynamic mechanical properties were subsequently examined. Dynamic characteristics of the entire blends determined from a Rheovibron generally showed two glass transitions (T'$_{g}$s), -43$^{\circ}C$ and -4$^{\circ}C$ for NBR and EPDM, respectively. The tan $\delta$ peak monotonically shifted toward the higher temperature with increasing NBR content. It was also found that the optimum cure time was significantly decreased with loading of NBR.

  • PDF

On Speech Digitization and Bandwidth Compression Techniques[II]-Vocoding (음성신호의 디지탈화와 대역폭축소의 방법에 관하여[II]-Vocoding)

  • 은종관
    • Journal of the Korean Institute of Telematics and Electronics
    • /
    • v.15 no.6
    • /
    • pp.1-7
    • /
    • 1978
  • This paper deals with speech digitization and bandwidth compression techniques, particularly two predictive coding methods-namely, adaptive differential pulse code modulation(ADPCM) and adaptive delta modulation(ADM). The principle of a typical adaptive quantizer that is used in ADPCM is explained, and discussed. Also, three companding methods(instantaueous, syllabic, and hybrid companding) that are used in ADM are explained in detail, and their performances are compared. In addition, the performances of ADPCM and ADM as speech coders are compared, and the inerits of each coder are discussed.

  • PDF

On Speech Digitization and Bandwidth Compression Techniques[I]-ADPCM and ADM (음성신호의 디지탈화와 대역폭축소의 방법에 관하여[I]-ADPCM과 ADM)

  • 은종관
    • Journal of the Korean Institute of Telematics and Electronics
    • /
    • v.15 no.3
    • /
    • pp.1-6
    • /
    • 1978
  • This paper deals with speech digitization and bandwidth compression techniques, particularly two predictive coding methods-namely, adaptive diferentia1 pulse code modulation(ADPCM) and adaptive delta modulation (ADM). The principle of a typical adoptive quantizer that is used in ADPCM is explained, and two analysis methods for the adaptive predictor coefficents, block and sequential analyses, are discussed. Also, three companding methods (instantaneous, syllabic, and hybrid companding) that are used in ADM are explained in detail, and their performances are compared. In addition, the performances of ADPCM and ADM as speech coders are compared, and the merits of each coder are discussed.

  • PDF