计算机工程与应用2016,Vol.52Issue(16):210-215,6.DOI:10.3778/j.issn.1002-8331.1409-0269
一种改进的基于缓存池机制的小文件I/O策略
Improved I/O policy of small files based on cache pool
摘要
Abstract
The I/O performance is excellent for the large files on Lustre file system, but is poor for the small files. To solve the problem, this paper proposes a small file cache pool mechanism based on MDS node, the frequently accessed small files are put in the pool. In this mechanism, the pool uses a fully associative mapping to correspond with OST file cache, and uses look through style and write through strategy to ensure the file consistency. The cache pool updating strategy considers some factors that include the file access time and number, and uses a modified Least Recently Used algorithm (LRU). Experimental results show that the improved Lustre file system reduces the network transmission overhead and saves access time of small files, and I/O performance has been significantly improved on accessing small files. Although I/O performance has been reduced on accessing large files, the improved Lustre file system still has some practical value within an acceptable range.关键词
Lustre文件系统/全相联映射/近期最少使用算法(LRU)/I/O性能Key words
Lustre file system/fully associative mapping/Least Recently Used(LRU)/I/O performance分类
信息技术与安全科学引用本文复制引用
聂瑞华,谢文君,梁军..一种改进的基于缓存池机制的小文件I/O策略[J].计算机工程与应用,2016,52(16):210-215,6.基金项目
教育部-中移动基金项目(No.MCM20130651);广州市科技和信息化局基金项目(No.2014Y2-00006);华南师范大学青年教师科研培育基金(No.2012KJ006)。 ()