湖南农业大学学报（自然科学版）2024，Vol.50Issue(5)：119-124,6.DOI:10.13331/j.cnki.jhau.2024.05.017
基于多层记忆增强和残差时空变换器的鱼类异常运动行为检测
Abnormal fish movement behavior detection based on multilayer memory enhancement and residual spatio-temporal transformer
摘要
Abstract
The manual method of extracting abstract features to capture video anomalies was no longer applicable to large-scale aquaculture due to the problems of insufficient feature learning,difficult feature selection and poor generalization.In this study,computer vision technology was introduced into the study of fish movement behavior anomaly detection,and an unsupervised learning approach was used to propose a fish movement behavior anomaly detection method that combined multilayer memory enhancement and residual spatio-temporal transformer to effectively extract the motion correlation and appearance characteristics of fish.Firstly,based on U-Net network,its encoder and decoder were used to implement encoding and decoding of video frames,and behavior anomaly detection was achieved based on the difference between predicted and real frames.In order to strengthen the connection of spatio-temporal information features between consecutive video frames,the residual temporal transformer module and the residual spatial transformer module were proposed to enhance the network's ability to model temporal and spatial information.Since the convolutional neural network had certain generalization ability,the memory enhancement module was used instead of the jump connection in the U-Net network to alleviate the ability of the encoder to represent the anomalous frames.In addition,Generative Adversarial Networks was used to generate more realistic prediction frames,thereby improving the detection accuracy of the network.The results indicated that this method could effectively extract the motion and appearance characteristics of fish.On two self-made fish datasets,the area under the curve(AUC)reached 0.916 and 0.921,respectively,achieving fish movement behavior anomaly detection.关键词
鱼类异常行为检测/计算机视觉/无监督学习/U-Net/时空变换器Key words
fish behavior anomaly detection/computer vision/unsupervised learning/U-Net/spatio-temporal transformer分类
农业科技引用本文复制引用
袁红春,陈香枝..基于多层记忆增强和残差时空变换器的鱼类异常运动行为检测[J].湖南农业大学学报（自然科学版）,2024,50(5):119-124,6.基金项目
国家自然科学基金项目(41776142) （41776142）
