Design and Implementation of Various File Deduplication Schemes on Storage Devices

作者：Su Kuan Wu; Leu Jenq Shiou^*; Yu Min Chieh; Wu Yong Ting; Lee Eau Chung; Song Tian

来源：Mobile Networks and Applications, 2017, 22(1): 40-50.

DOI：10.1007/s11036-016-0677-9

• File deduplication
• Cloud system
• Storage devices

As smart devices are revolutionized in recent years, people may generate enormous amount of various sized data and store them in the local or remote file system in their daily lives. With cheaper and easy to use private cloud storage appliances helping to handle the increasing demand of storing and sharing big volume of data, effective file deduplication schemes can greatly increase the space efficiency in private cloud storage systems as well as preserve network bandwidth. In the paper, we aim at designing and implementing several file deduplication schemes built in the private cloud storage appliance, based on different duplication checking rules, including file name, file size, and file partial/full content hash value. Experiment results show using partial content hashing based file deduplication scheme achieves a reasonably balanced performance without overutilized limited local computational resources.

• 出版日期2017-2