测试技术学报2026，Vol.40Issue(4)：423-434,12.DOI:10.62756/csjs.1671-7449.2026060
基于DINOv2到EfficientViT的多损失蒸馏Patch特征少样本异常检测
Multi-Loss Distillation of Patch Features from DINOv2 to EfficientViT for Few-Shot Anomaly Detection
摘要
Abstract
To address the problem in few-shot industrial anomaly detection where large-scale models are difficult to deploy and lightweight models show limited performance,a lightweight anomaly detection method based on knowledge distillation is proposed.DINOv2 as the teacher model and EfficientViT as the student model,transferring knowledge are used to achieve high detection performance under resource constraints.A feature alignment adapter is designed to reduce the representation gap between the two models,and a multi-objective distillation loss combining Huber loss,cosine similarity loss,and Gram matrix loss guides the student from multiple dimensions of magnitude,direction,and spatial correlation.Experiments on the MVTec AD dataset show that the student model,trained only with normal samples,achieves a 0.170 improvement in image-level AUROC over the baseline model without distillation,while maintaining comparable performance to the teacher model with about 23%fewer parameters and 4 times faster inference.The effectiveness of the proposed framework is confirmed by ablation and visualization studies.关键词
异常检测/知识蒸馏/轻量化模型/视觉Transformer/少样本学习Key words
anomaly detection/knowledge distillation/lightweight model/vision Transformer/few-shot learning分类
信息技术与安全科学引用本文复制引用
韩信,邵星灵,李秀源,闫佳乐,邓瑞祥..基于DINOv2到EfficientViT的多损失蒸馏Patch特征少样本异常检测[J].测试技术学报,2026,40(4):423-434,12.基金项目
国家自然科学基金资助项目(62203404) （62203404）
