基于改进SlowFast模型的设施黄瓜农事行为识别方法OACSTPCD
Recognition Method of Facility Cucumber Farming Behaviours Based on Improved SlowFast Model
[目的/意义]农事行为活动识别对设施蔬菜生产精准化调控有着重要意义,在一定程度上可以通过查看农事操作的时间、操作过程是否合理来减少因农事行为不当导致产量下降.为了解决农事行为识别方法中由于黄瓜叶片和设施遮挡导致识别准确率不高的问题,提出一种名为SlowFast-SMC-ECA(SlowFast-Spatio-Temporal Ex-citation、Channel Excitation、Motion Excitation-Efficient Channel Attention)的农事活动行为识别算法.[方法]该算法主要基于SlowFast模型,通过改进Fast Pathway和Slow Pathway中的网络结构来提高对于农事活动中手部动作特征和关键特征的提取能力.在Fast Pathway中,引入多路径激励残差网络的概念,通过在信道之间插入卷积操作来增强它们在时域上的相互关联性,从而更好地捕捉快速运动信息的细微时间变化.在Slow Pathway中,将传统的Residual Block替换为ECA-Res结构,以提高对通道信息的捕获能力.这两项改进有效地加强了通道之间的联系,提升了特征之间的语义信息传递,进而显著提升了农事行为识别的准确率.此外,为了解决数据集中类别不均衡的问题,设计了平衡损失函数(Smoothing Loss),通过引入正则化系数,平衡损失函数可以有效地处理数据集中的类别不均衡情况,提高模型在各个类别上的表现.[结果和讨论]改进的SlowFast-SMC-ECA模型在农事行为识别中表现出良好的性能,各类行为的平均识别精度达到80.47%,相较于原始的SlowFast模型有约3.5%的提升.[结论]本研究在农事行为识别中展现出良好的性能.这对农业生产的智能化管理和决策具有重要意义.
[Objective]The identification of agricultural activities plays a crucial role for greenhouse vegetables production,particularly in the pre-cise management of cucumber cultivation.By monitoring and analyzing the timing and procedures of agricultural operations,effective guidance can be provided for agricultural production,leading to increased crop yield and quality.However,in practical applications,the recognition of agricultural activities in cucumber cultivation faces significant challenges.The complex and ever-changing growing environment of cucumbers,including dense foliage and internal facility structures that may obstruct visibility,poses difficulties in rec-ognizing agricultural activities.Additionally,agricultural tasks involve various stages such as planting,irrigation,fertilization,and pruning,each with specific operational intricacies and skill requirements.This requires the recognition system to accurately capture the characteristics of various complex movements to ensure the accuracy and reliability of the entire recognition process.To address the complex challenges,an innovative algorithm:SlowFast-SMC-ECA(SlowFast-Spatio-Temporal Excitation,Channel Excitation,Motion Excitation-Efficient Channel Attention)was proposed for the recognition of agricultural activity behaviors in cucumber culti-vation within facilities. [Methods]This algorithm represents a significant enhancement to the traditional SlowFast model,with the goal of more accurately capturing hand motion features and crucial dynamic information in agricultural activities.The fundamental concept of the SlowFast model involved processing video streams through two distinct pathways:the Slow Pathway concentrated on capturing spatial detail in-formation,while the Fast Pathway emphasized capturing temporal changes in rapid movements.To further improve information ex-change between the Slow and Fast pathways,lateral connections were incorporated at each stage.Building upon this foundation,the study introduced innovative enhancements to both pathways,improving the overall performance of the model.In the Fast Pathway,a multi-path residual network(SMC)concept was introduced,incorporating convolutional layers between different channels to strength-en temporal interconnectivity.This design enabled the algorithm to sensitively detect subtle temporal variations in rapid movements,thereby enhancing the recognition capability for swift agricultural actions.Meanwhile,in the Slow Pathway,the traditional residual block was replaced with the ECA-Res structure,integrating an effective channel attention mechanism(ECA)to improve the model's capacity to capture channel information.The adaptive adjustment of channel weights by the ECA-Res structure enriched feature ex-pression and differentiation,enhancing the model's understanding and grasp of key spatial information in agricultural activities.Fur-thermore,to address the challenge of class imbalance in practical scenarios,a balanced loss function(Smoothing Loss)was devel-oped.By introducing regularization coefficients,this loss function could automatically adjust the weights of different categories dur-ing training,effectively mitigating the impact of class imbalance and ensuring improved recognition performance across all categories. [Results and Discussions]The experimental results significantly demonstrated the outstanding performance of the improved SlowFast-SMC-ECA model on a specially constructed agricultural activity dataset.Specifically,the model achieved an average recognition accu-racy of 80.47%,representing an improvement of approximately 3.5%compared to the original SlowFast model.This achievement highlighted the effectiveness of the proposed improvements.Further ablation studies revealed that replacing traditional residual blocks with the multi-path residual network(SMC)and ECA-Res structures in the second and third stages of the SlowFast model leads to su-perior results.This highlighted that the improvements made to the Fast Pathway and Slow Pathway played a crucial role in enhancing the model's ability to capture details of agricultural activities.Additional ablation studies also confirmed the significant impact of these two improvements on improving the accuracy of agricultural activity recognition.Compared to existing algorithms,the improved SlowFast-SMC-ECA model exhibited a clear advantage in prediction accuracy.This not only validated the potential application of the proposed model in agricultural activity recognition but also provided strong technical support for the advancement of precision agri-culture technology.In conclusion,through careful refinement and optimization of the SlowFast model,it was successfully enhanced the model's recognition capabilities in complex agricultural scenarios,contributing valuable technological advancements to precision management in greenhouse cucumber cultivation. [Conclusions]By introducing advanced recognition technologies and intelligent algorithms,this study enhances the accuracy and effi-ciency of monitoring agricultural activities,assists farmers and agricultural experts in managing and guiding the operational processes within planting facilities more efficiently.Moreover,the research outcomes are of immense value in improving the traceability system for agricultural product quality and safety,ensuring the reliability and transparency of agricultural product quality.
何峰;吴华瑞;史扬明;朱华吉
江苏大学 计算机科学与通信工程学院,江苏镇江 212013,中国||国家农业信息化工程技术研究中心,北京 100097,中国江苏大学 计算机科学与通信工程学院,江苏镇江 212013,中国||国家农业信息化工程技术研究中心,北京 100097,中国||北京市农林科学院信息技术研究中心,北京 100097,中国||农业农村部数字乡村技术重点实验室,北京 100097,中国
计算机与自动化
农事活动行为SlowFast模型多路径激励残差网络ECA-Res平衡损失函数
farming activity behaviourSlowFast modelmulti-path incentive residual networkECA-Resequilibrium loss function
《智慧农业(中英文)》 2024 (003)
118-127 / 10
中央引导地方科技发展资金项目(2023ZY1-CGZY-01);财政部和农业农村部:国家现代农业产业技术体系资助(CARS-23-D07) Central Guided Local Science and Technology Development Funds Project(2023ZY1-CGZY-01);Ministry of Fi-nance and Ministry of Agriculture and Rural Development:Funding for the National Modern Agricultural Industrial Technology Sys-tem(CARS-23-D07)
评论