| 注册
首页|期刊导航|计算机工程与应用|一种改进的基于缓存池机制的小文件I/O策略

一种改进的基于缓存池机制的小文件I/O策略

聂瑞华 谢文君 梁军

计算机工程与应用2016,Vol.52Issue(16):210-215,6.
计算机工程与应用2016,Vol.52Issue(16):210-215,6.DOI:10.3778/j.issn.1002-8331.1409-0269

一种改进的基于缓存池机制的小文件I/O策略

Improved I/O policy of small files based on cache pool

聂瑞华 1谢文君 1梁军2

作者信息

  • 1. 华南师范大学 计算机学院,广州 510631
  • 2. 华南师范大学 网络中心,广州 510631
  • 折叠

摘要

Abstract

The I/O performance is excellent for the large files on Lustre file system, but is poor for the small files. To solve the problem, this paper proposes a small file cache pool mechanism based on MDS node, the frequently accessed small files are put in the pool. In this mechanism, the pool uses a fully associative mapping to correspond with OST file cache, and uses look through style and write through strategy to ensure the file consistency. The cache pool updating strategy considers some factors that include the file access time and number, and uses a modified Least Recently Used algorithm (LRU). Experimental results show that the improved Lustre file system reduces the network transmission overhead and saves access time of small files, and I/O performance has been significantly improved on accessing small files. Although I/O performance has been reduced on accessing large files, the improved Lustre file system still has some practical value within an acceptable range.

关键词

Lustre文件系统/全相联映射/近期最少使用算法(LRU)/I/O性能

Key words

Lustre file system/fully associative mapping/Least Recently Used(LRU)/I/O performance

分类

信息技术与安全科学

引用本文复制引用

聂瑞华,谢文君,梁军..一种改进的基于缓存池机制的小文件I/O策略[J].计算机工程与应用,2016,52(16):210-215,6.

基金项目

教育部-中移动基金项目(No.MCM20130651);广州市科技和信息化局基金项目(No.2014Y2-00006);华南师范大学青年教师科研培育基金(No.2012KJ006)。 ()

计算机工程与应用

OA北大核心CSCDCSTPCD

1002-8331

访问量0
|
下载量0
段落导航相关论文