数据与计算发展前沿2026，Vol.8Issue(3)：29-39,11.DOI:10.11871/jfdc.issn.2096-742X.2026.03.003
基于深度学习的Lustre文件系统异常行为智能检测方法
A Deep Learning-Based Intelligent Anomaly Detection Method for the Lustre File System
摘要
Abstract
[Background]The Lustre file system is a crucial foundation for scientific computing.With the continuous expansion of storage capacity and user workload,the load on storage systems is con-stantly increasing.Abnormal read and write requests from a single user often lead to storage cluster lag,affecting the overall user experience.Traditional anomaly handling typically in-volves maintainers browsing logs,identifying and locating abnormal users or read/write re-quests,and finally implementing troubleshooting strategies to restore system access speed.[Purpose]To improve the efficiency of anomaly diagnosis and replace the inefficient mode of relying on manual screening of logs by maintainers,this study introduces deep learning into the operation and maintenance process to achieve intelligent diagnosis of abnormal read and write behavior.[Method]This study builds an intelligent abnormal behavior de-tection system for Lustre file systems,involving user behavior data collection,time-series data processing,model construction,training,and deployment verification.The system converts user read and write information into time series data,builds a long short-term memory network and trains the model using unsupervised learning.[Conclusions]This study successfully trained and validated the model on Lustre's MDT and OST data.Experi-mental results show that the proposed method can significantly improve the accuracy of anomaly detection and ef-fectively reduce the false alarm rate.The proposed method can reduce the time cost for error localization for maintainers and improve the efficiency of anomaly handling in file systems within scientific computing environ-ments.关键词
智能运维/存储系统/时序数据处理Key words
AIOps/storage system/time-series data processing引用本文复制引用
侯思琦,程垚松,程耀东,李海波,毕玉江,姚秋玲..基于深度学习的Lustre文件系统异常行为智能检测方法[J].数据与计算发展前沿,2026,8(3):29-39,11.基金项目
国家重点研发计划2023YFC2206401原初引力波望远镜智能数据传输与运行监控系统 （）
浪潮存储青蓝基金广域网分布式文件系统与基于SPDK高性能文件系统 （）
中国科学院青年创新促进会(2023013) （2023013）
