结合博弈论与强化学习的态势感知与路径预测OA北大核心
Situational awareness and path prediction combining game theory and reinforcement learning
网络安全态势感知技术对评估网络安全状况及预测攻击行为路径,辅助管理员做出有效防御有重要意义.传统的网络态势评估方法大多偏重在理论层面进行静态分析,难以实际运用,传感器收集到的数据庞大繁杂,易造成存储空间负载过大.针对上述问题,结合博弈论算法与强化学习算法,提出一种结合博弈论与强化学习的网络攻防动态感知模型以分析网络态势安全及预测攻击路径.首先,设计带有优先级关系矩阵的层次分析法计算系统损失及安全态势;其次,引入Boltzmann概率分布法计算混合策略纳什均衡;最后,改进Q-Learning与博弈论算法对网络状态转移进行动态分析,达到准确预测攻击路径、选择最优防御策略的目的.通过网络仿真实验,验证模型的有效性和可行性.
Cybersecurity situational awareness technology plays a critical role in assessing network security status,predicting potential attack paths,and assisting administrators in implementing effective defenses.Traditional methods for network situation assessment mostly rely on theoretical analysis,limiting their practicality in real-world networks.Additionally,the complexity of sensor-collected data often results in excessive storage demands.To address these challenges,this paper proposes a dynamic network attack-defense perception model that integrates reinforcement learning and game theory to enhance situational awareness and predict potential attack paths.The approach begins with the design of a hierarchical analytic process using a priority relation matrix to calculate system losses and assess security posture.Next,the Boltzmann probability distribution is employed to calculate the mixed-strategy Nash equilibrium,identifying optimal strategic responses.Finally,an improved Q-learning algorithm,in combination with game-theoretic principles,is used to dynamically model network state transitions,enabling accurate prediction of attack paths and supporting defenders in selecting optimal defense strategies.Simulation results validate the model's effectiveness and practicality in complex network environments.
杨云;梁花;魏兴慎;李洋;刘俊
国网重庆市电力公司 重庆 400014国网重庆电力公司电力科学研究院 重庆 401123国网电力科学研究院有限公司 南京 211106||南瑞集团有限公司 南京南瑞信息通信科技有限公司 南京 211106国网重庆电力公司电力科学研究院 重庆 401123重庆邮电大学 软件工程学院 重庆 400000
计算机与自动化
强化学习Q-learning博弈论态势感知层次分析法纳什均衡
reinforcement learningQ-learninggame modelsituational awarenessanalytic hierarchy processNash equilibrium
《重庆大学学报》 2025 (6)
84-97,14
重庆市电力公司科技项目(520626190067).Supported by Science and Technology Projects of State Grid Chongqing Electric Power Company(520626190067).
评论