| 한글제목(Korean Title) |
An Optimized Iterative Semantic Compression Algorithm And Parallel Processing for Large Scale Data |
| 영문제목(English Title) |
An Optimized Iterative Semantic Compression Algorithm And Parallel Processing for Large Scale Data |
| 저자(Author) |
Ran Jin
Gang Chen
Anthony K. H. Tung
Lidan Shou
Beng Chin Ooi
|
| 원문수록처(Citation) |
VOL 12 NO. 06 PP. 2761 ~ 2781 (2018. 06) |
한글내용
(Korean Abstract) |
|
영문내용
(English Abstract) |
With the continuous growth of data size and the use of compression technology, data reduction has great research value and practical significance. Aiming at the shortcomings of the existing semantic compression algorithm, this paper is based on the analysis of ItCompress algorithm, and designs a method of bidirectional order selection based on interval partitioning, which named An Optimized Iterative Semantic Compression Algorithm (Optimized ItCompress Algorithm). In order to further improve the speed of the algorithm, we propose a parallel optimization iterative semantic compression algorithm using GPU (POICAG) and an optimized iterative semantic compression algorithm using Spark (DOICAS). A lot of valid experiments are carried out on four kinds of datasets, which fully verified the efficiency of the proposed algorithm.
|
| 키워드(Keyword) |
Semantic Compression
Spark Computing Framework
GPU
Parallel Processing
Interval Partition
|
| 파일첨부 |
PDF 다운로드
|
