基于改进Mask R-CNN的小麦在穗籽粒表型参数测试方法OA北大核心CSTPCD
A Method for Testing Phenotype Parameters of Wheat Grains on Spike Based on Improved Mask R-CNN
[目的]针对小麦籽粒性状参数获取需要脱粒后测量,测量程序繁杂、费时费力的缺点,提出基于深度学习的小麦在穗籽粒表型参数测试方法.[方法]采集镇麦25、宁麦13和农麦88这3个品种小麦穗两侧正视图像,利用小麦穗正视图像构建图像增强数据集,提出深度学习与形态学处理相结合的小麦在穗籽粒表型参数测试方法.首先,建立基于改进MaskR-CNN网络的麦穗颖壳分割模型,模型以ResNet和FNP为特征提取网络并引入坐标注意力(CA)模块、聚合模块和半卷积模块,实现麦穗图像中颖壳的准确定位、分割和籽粒计数.其次,利用分割的麦穗颖壳掩膜图经形态学处理方法提取麦穗颖壳的5个表型参数,并建立麦穗颖壳表型参数与颖壳内籽粒表型参数之间的线性相关关系.最后,利用麦穗颖壳表型参数与籽粒表型参数之间的线性相关关系预测籽粒表型参数.[结果](1)基于改进Mask R-CNN网络的麦穗颖壳分割模型的平均精确率AP为94.13%,F1值为91.12%,召回率为88.30%,单幅图像平均检测耗时97 ms,可以快速、精准地识别单粒麦穗颖壳.模型的籽粒计数的均方根误差和平均相对误差分别为0.94个和0.65%,可见模型分割籽粒的精度较高.(2)麦穗颖壳与籽粒之间的表型参数粒长、粒厚、面积、周长、长径比线性相关关系式为:y=0.7258x,y=0.5166x、y=0.3748x、y=0.6756x、y=1.4085x,其决定系数(R2)均在0.85以上.(3)利用图像获取的麦穗颖壳参数数据对上述相关性模型进行验证并预测籽粒表型参数,粒长、粒厚、面积、周长、长径比5个参数的均方根误差和平均相对误差分别为 0.17 mm、0.08 mm、0.46 mm2、0.33 mm、0.12 和 0.02%、0.02%、0.02%、0.02%、0.03%,每个参数的预测数据与实际数据之间的决定系数(R2)均在0.85 以上,说明本文提出的籽粒表型预测方法可行.[结论]基于深度学习的小麦在穗籽粒表型测试方法能够通过麦穗颖壳表型参数精确预测小麦在穗籽粒的表型参数,为快速简便提取小麦籽粒表型参数提供了新的方法.
[Objective]Wheat grain phenotype parameters were tested after grains only must been threshed by combine,this process was time-consuming,laborious and complicate.Therefore,a method to test morphological parameters of wheat grains on spike based on improved Mask R-CNN was proposed in this research.[Method]Two sides front images of three varieties wheat spikes,including Zhenmai 25,Ningmai 13 and Longmai 88(Early maturity variety),were collected,and then the image enhancement data set was constructed by using Gaussian filter,salt and pepper noise,and vertical flip image enhancement method.A method combined with deep learning and morphological processing for testing phenotype parameters of wheat grains on spike was proposed.Firstly,the improved Mask R-CNN network model for segmenting spike glume was constructed,which was based on feature extraction networks of ResNet and FNP,and the innovative components Coordinate Attention(CA)module,Aggregation module,and Halfconv module were integrated into it.And the glumes on spike image were accurately detected,located,segmented and counted by the improved Mask R-CNN network model.Secondly,five phenotype parameters of the glumes on spike were extracted by using morphologic processing method from the segmented mask image of wheat spike glume,and the linear correlation equations between the phenotype parameters of the glumes and the phenotype parameters of grains were established.Finally,the linear correlation equations between the phenotype parameters of glume and the phenotypic parameters of grain were used to predict the phenotype parameters of grain.[Result](1)F1 score,average precision(AP)and recall rate of the optimal model for separating spike glume based on the improved Mask R-CNN network model were 91.12%,94.13%and 88.30%,respectively,and the average consuming time for detecting a single image was 97 milliseconds,so the improved Mask R-CNN'network model could quickly and accurately identify the glumes on the single wheat spike.The root-mean-square error and average relative error for segmenting spike grain by the model were 0.94 piece and 0.65%,respectively,so this showed that spike glumes were segmented precisely by the model.(2)The established linear correlation equations for length,thickness,area,circumference,and length-thickness ratio between wheat spike glume and actual grain were y=0.7258x,y=0.5166x,y=0.3748x,y=0.6756x and y=1.4085x,respectively,and the determination coeffiicient(R2)of the linear correlation equations all were greater than 0.85.(3)The above correlation equations were verified and phenotype parameters of grain were predicted by using the extracted phenotype parameter data of wheat spike glume,the root-mean-square errors and average relative error for length,thickness,area,circumference and length-thickness ratio between predicted values and actual values of wheat grains were 0.17 mm,0.08 mm,0.46 mm2,0.33 mm,0.12,and 0.02%,0.02%,0.02%,0.03%,respectively.The determination coefficient(R2)for each phenotype parameter between the predicted data and the actual data was above 0.85,research results indicated that the proposed method in this study was feasible.[Conclusion]The method for testing phenotype parameters of wheat grains on spike based on improved Mask R-CNN was proposed in this research,and the phenotype parameters of wheat grain on spike could be predicted accurately and effectively by the phenotype parameters of wheat spike glume.This research provided a new method to extract rapidly and simply wheat grain phenotype parameters on spike.
王赟赟;李毅念;陈玉仑;丁启朔;何瑞银
南京农业大学工学院,南京 210031
麦穗籽粒表型深度学习坐标注意力
wheat spikegrain phenotypedeep learningCoordinate Attention
《中国农业科学》 2024 (012)
2322-2335 / 14
国家重点研发计划(2022YFD2300703、2022YFD2300304)、中央高校基本科研业务费专项资金资助项目(KYYJ202106)
评论