农业机械学报2026，Vol.57Issue(15)：36-45,10.DOI:10.6041/j.issn.1000-1298.2026.15.003
追踪提示结合视觉大模型微调的猪只实例分割方法
Pig Instance Segmentation Based on Tracking Prompts and Fine-tuned Large Vision Models
摘要
Abstract
Aiming to address the challenges of lack of coordination between tracking and segmentation tasks and reliance on costly manual annotation in current mainstream pig perception algorithms,a novel end-to-end framework was proposed.Specifically,the proposed method ingeniously leveraged the bounding boxes output by the multi-object tracking algorithm as dynamic spatial prompts for the segment anything model(SAM).This integration facilitated the generation of temporally coherent and identity-consistent individual mask sequences across video frames,bridging the gap between localization and pixel-level segmentation.To adapt the vision foundation model to the specific agricultural domain,the low-rank adaptation(LoRA)was combined with a custom-designed pig multi-scale feature adapter(PF Adapter).The model required only a minimal number of annotated samples to achieve robust feature extraction,ultimately surpassing the performance of traditional fully supervised learning algorithms and effectively overcoming the bottleneck of expensive data annotation.Comprehensive experimental results demonstrated the superiority of the proposed framework.Evaluated across two distinct datasets,the fine-tuned SAM achieved impressive performance metrics,with pixel accuracy(PA)of 91.24%,an intersection over union(IoU)of 85.06%,and a dice similarity coefficient of 86.18%.Remarkably,this significant performance enhancement was achieved with merely a 3%increase in number of parameters compared with the baseline SAM architecture.Furthermore,the pig body posture and movement trajectory information output by the improved model can be used for pig evaluation and sow farrowing warning,providing technical support for smart farming.关键词
猪只/实例分割/追踪提示/视觉大模型(SAM)/LoRA/PF AdapterKey words
pig/instance segmentation/tracking prompts/large vision model(SAM)/LoRA/PF Adapter分类
信息技术与安全科学引用本文复制引用
孙立博,张泽昀,秦文虎..追踪提示结合视觉大模型微调的猪只实例分割方法[J].农业机械学报,2026,57(15):36-45,10.基金项目
江苏现代农业产业单项技术研发项目(CX(23)3120) （CX(23）
