基于Stacking集成和偏探索贝叶斯优化的特征选择OACSTPCD
Feature Selection Using Stacking Integration and Partial Exploration Bayesian Optimization
针对高维基因数据集的最优特征子集不易确定,以及传统的贝叶斯优化算法容易陷入局部最优,导致无法快速筛选出最优参数等问题,本文提出了一种基于Stacking集成和偏探索贝叶斯优化的基因选择方法.首先,使用卡方过滤法剔除原始特征空间中的冗余基因,获得相关性较高的基因,通过贝叶斯优化算法的采集函数进行改进,引入跳出系数,使得贝叶斯优化算法能够自适应地跳出局部最优,降低开销并加快寻优的效率;然后,使用偏探索贝叶斯优化寻找随机森林的最优参数,使用优化后随机森林模型筛选最优基因子集;最后,设计了一种Stacking集成模型框架来构建分类器,并对最优基因子集进行分类,进而构建了基于Stacking集成和偏探索贝叶斯优化的基因选择算法.在9个公开的基因表达谱数据集上进行仿真实验,结果表明所提算法可以快速筛选出最优的基因子集,且具有较高的分类精度.
To address the problems that the optimal feature subset of high-dimensional gene datasets is not easy to be determined and the traditional Bayesian optimization algorithm is prone to falling into local optimum,which cannot quickly select the optimal pa-rameters,in this paper,we propose a gene selection method based on the Stacking integration and partial exploration Bayesian opti-mization.Firstly,the Chi-square filtering scheme is used to eliminate the redundant genes in the original feature space,so as to ob-tain the genes with high correlation.The acquisition function of the Bayesian optimization algorithm is improved,and the jump out coefficient is introduced,so that the Bayesian optimization algorithm can adaptively jump out of the local optimum.The cost can be reduced and the efficiency of optimization will be speeded up.Secondly,the partial exploration Bayesian optimization is used to find the optimal parameters of random forest.Then,the optimized random forest model is employed to screen the optimal feature subset.Finally,a framework of the Stacking integration model is designed to construct classifier and classify the optimal feature subset,and then a gene selection algorithm based on the Stacking integration and partial exploration Bayesian optimization is constructed.The experimental results on nine public gene expression profile datasets show that the proposed algorithm can quickly select the optimal gene subset with higher classification accuracy.
孙林;郭嘉琪;朱雨晨;陈森
天津科技大学 人工智能学院,天津 300457河南师范大学 计算机与信息工程学院,河南 新乡 453007
计算机与自动化
基因选择Stacking算法贝叶斯优化算法随机森林模型
gene selectionstacking algorithmbayesian optimization algorithmrandom forest model
《山西大学学报(自然科学版)》 2024 (001)
93-102 / 10
国家自然科学基金(61772176);河南省科技攻关项目(212102210136)
评论