羊场自动导航喷药机器人设计与实验OACSTPCD
Automatic Navigation and Spraying Robot in Sheep Farm
[目的/意义]大规模肉羊畜舍人工消毒存在费时费力、覆盖不全和消毒不彻底的问题,为保持畜舍卫生和肉羊健康,本研究提出一种羊场自动导航喷药机器人.[方法]从硬件、语义分割模型和控制算法3个方面设计了自动导航喷药机器人.硬件部分包括履带底盘、摄像头和折叠式喷药装置.语义分割模型部分通过引入压缩通道网络注意力(Squeeze-and-Excitation Network,SENet)和基于场景改进的十字交叉注意力(Criss-Cross Attention,CCA)模块,提出一种双注意力ENet语义分割模型(Double Attention ENet,DAENet).在控制算法方面,针对机器人在面对岔路时无法控制行进方向的问题,利用模拟真实道路的方法,在羊舍外的道路上绘出车道线,提出了道路中心点识别和车道线中心点识别两种算法来计算机器人行进过程中的导航点.为了实现上述两种算法,使用了两台摄像头并设计了摄像头切换算法,依靠此算法实现两台摄像头的切换,并控制喷药装置的开关;提出了一种偏移量与速度计算算法控制机器人履带左右轮速度,实现对于机器人行走的控制.[结果和讨论]DAENet模型在图像分割任务中的平均交并比(Mean Intersection over Union,mIoU)达到了0.945 3;摄像头切换算法测试结果表明摄像头的切换时间在15 s以内,机器人能正确、快速地带动喷药装置的开关;中心点与偏移量计算算法测试的结果表明,在处理多帧视频流时,算法平均处理一帧图片所用的时间为0.04~0.055 s,帧率为20~24 f/s,满足实际工作的实时性要求;羊场实地的整体测试结果表明,机器人完成了两个羊舍的自动导航和消毒任务,并且未碰撞路边料槽,行进轨迹偏移量未超过0.3 m.在0.2 m/s的行进速度下,药箱里的药液能够满足两个羊舍的消毒任务.机器人处理图像的平均帧率为22.4 f/s,对于信息处理的准确性和实时性能够满足实验指标要求.喷药覆盖圈舍地面超过90%,满足实验指标要求.[结论]本研究提出的羊舍自动导航喷药机器人以语义分割模型DAENet为基础,中心点识别算法为核心,通过与硬件设计和控制算法的相互配合,能够在确保安全性和实时性的前提下,实现在羊舍内的自动导航和全覆盖喷药.
[Objective]Manual disinfection in large-scale sheep farm is laborious,time-consuming,and often results in incomplete coverage and inadequate disinfection.With the rapid development of the application of artificial intelligence and automation technology,the auto-matic navigation and spraying robot for livestock and poultry breeding,has become a research hotspot.To maintain shed hygiene and ensure sheep health,an automatic navigation and spraying robot was proposed for sheep sheds. [Methods]The automatic navigation and spraying robot was designed with a focus on three aspects:hardware,semantic segmentation model,and control algorithm.In terms of hardware,it consisted of a tracked chassis,cameras,and a collapsible spraying device.For the semantic segmentation model,enhancements were made to the lightweight semantic segmentation model ENet,including the addi-tion of residual structures to prevent network degradation and the incorporation of a squeeze-and-excitation network(SENet)attention mechanism in the initialization module.This helped to capture global features when feature map resolution was high,addressing preci-sion issues.The original 6-layer ENet network was reduced to 5 layers to balance the encoder and decoder.Drawing inspiration from dilated spatial pyramid pooling,a context convolution module(CCM)was introduced to improve scene understanding.A criss-cross attention(CCA)mechanism was adapted to acquire context global features of different scales without cascading,reducing information loss.This led to the development of a double attention enet(DAENet)semantic segmentation model was proposed to achieve real-time and accurate segmentation of sheep shed surfaces.Regarding control algorithms,a method was devised to address the robot's dif-ficulty in controlling its direction at junctions.Lane recognition and lane center point identification algorithms were proposed to iden-tify and mark navigation points during the robot's movement outside the sheep shed by simulating real roads.Two cameras were em-ployed,and a camera switching algorithm was developed to enable seamless switching between them while also controlling the spray-ing device.Additionally,a novel offset and velocity calculation algorithm was proposed to control the speeds of the robot's left and right tracks,enabling control over the robot's movement,stopping,and turning. [Results and Discussions]The DAENet model achieved a mean intersection over union(mIoU)of 0.945 3 in image segmentation tasks,meeting the required segmentation accuracy.During testing of the camera switching algorithm,it was observed that the time taken for the complete transition from camera to spraying device action does not exceed 15 seconds when road conditions changed.Testing of the center point and offset calculation algorithm revealed that,when processing multiple frames of video streams,the algorithm aver-ages 0.04 to 0.055 per frame,achieving frame rates of 20 to 24 frames per second,meeting real-time operational requirements.In field experiments conducted in sheep farm,the robot successfully completed automatic navigation and spraying tasks in two sheds without colliding with roadside troughs.The deviation from the road and lane centerlines did not exceed 0.3 meters.Operating at a travel speed of 0.2 m/s,the liquid in the medicine tank was adequate to complete the spraying tasks for two sheds.Additionally,the time tak-en for the complete transition from camera to spraying device action did not exceed 15 when road conditions changed.The robot main-tained an average frame rate of 22.4 frames per second during operation,meeting the experimental requirements for accurate and real-time information processing.Observation indicated that the spraying coverage rate of the robot exceeds 90%,meeting the experimen-tal coverage requirements. [Conclusions]The proposed automatic navigation and spraying robot,based on the DAENet semantic segmentation model and center point recognition algorithm,combined with hardware design and control algorithms,achieves comprehensive disinfection within sheep sheds while ensuring safety and real-time operation.
范铭铄;周平;李淼;李华龙;刘先旺;麻之润
中国科学技术大学 研究生院科学岛分院,安徽合肥 230026,中国||中国科学院合肥物质科学研究院 智能机械研究所,安徽合肥 230031,中国中国科学院合肥物质科学研究院 智能机械研究所,安徽合肥 230031,中国
计算机与自动化
自动导航喷药机器人计算机视觉语义分割注意力模块中心点计算DAENet
automatic navigationspraying robotcomputer visionsemantic segmentationattention modulecenterpoint calculationDAENet
《智慧农业(中英文)》 2024 (004)
103-115 / 13
"十四五"国家重点研发计划项目(2022YFD2002104) The 14th National Key Research and Development Plan Project(2022YFD2002104)
评论