农业机械学报2026，Vol.57Issue(15)：103-115,13.DOI:10.6041/j.issn.1000-1298.2026.15.010
基于面部关键点轨迹的鱼骨式挤奶厅奶牛异常行为检测方法
Method for Detecting Abnormal Cow Behavior in Fishbone-style Milking Parlors Based on Facial Landmark Trajectories
摘要
Abstract
The milking process is a high-risk phase for stress responses and animal welfare issues in dairy cows;automated monitoring of abnormal behaviors is crucial for improving milking management and ensuring cow welfare.Aiming to address the challenges in herringbone milking parlors,such as limited space,multiple cows entering the field of view simultaneously,frequent occlusions,and erratic individual trajectories,the detection of abnormal cow behaviors was investigated based on facial landmark trajectories,specifically tailored to the unique environment of herringbone milking parlors.Using DeepLabCut as the keypoint detection module,stall position constraints and cow-face orientation constraints were introduced to correct multi-cow trajectories,and combined scenario-specific behavioral features with rule-based classification to achieve event-level anomaly detection.Experimental results showed that the dual-constraint fusion correction based on stall position and cow face orientation reduced the number of keypoint ID changes for multiple cows from 18.500 to 0.125,while increasing accuracy from 93.83%to 99.96%.In event-level detection of abnormal behavior,the precision,recall,false negative rate,and false positive rate for single-cow abnormal behavior events were 96.55%,96.55%,3.45%,and 3.45%,respectively.For multi-cow interactive abnormal behavior event-level detection,the precision,recall,false negative rate,and false positive rate were 85.71%,100%,0,and 14.29%,respectively.The keypoint detection module achieved a precision of 98.69%,a recall of 98.61%,a mean average precision of 97.22%,and a standardized mean error of 5.31%.This method can provide a viable solution for the automatic detection of abnormal behaviors in fixed-view milking scenarios,offering good interpretability and engineering applicability.关键词
华西牛/鱼骨式挤奶厅/面部关键点/异常行为检测/轨迹修正/规则驱动Key words
Huaxi cattle/fishbone-style milking parlor/facial landmarks/abnormal behavior detection/trajectory correction/rule-driven分类
信息技术与安全科学引用本文复制引用
叶文昊,孔令森,秦雨,李国亮,韩猛立,赵文娟,李嘉位,钟发钢..基于面部关键点轨迹的鱼骨式挤奶厅奶牛异常行为检测方法[J].农业机械学报,2026,57(15):103-115,13.基金项目
国家自然科学基金项目(32402825)、多模态人工智能系统全国重点实验室开放课题(MAIS2025062)和兵团科技创新工程资金项目(NCG202503) （32402825）
