四川大学学报（自然科学版）2024，Vol.61Issue(1)：107-118,12.DOI:10.19907/j.0490-6756.2024.013003
基于多尺度特征深度神经网络的不同产地山楂细粒度图像识别
Fine-grained image recognition of Cratargi Fructus from different origin based on multi-scale feature deep neural network
摘要
Abstract
Traditional Chinese medicine(TCM)is the primary approach for treating diseases and is also the he foundation for the development and innovation of TCM,the authenticity of TCM directly impacts the clinical efficacy.Therefore,scientific,reasonable,and efficient quality detection of TCM is a press-ing research topic.Cratargi Fructus(CF)as a well-known edible food in China,which has been widely used for the ability of protecting cardiovascular and lowering blood pressure in cooking and treatment.However,it is reported that the difference in natural environment and cultivation conditions affects the CF's quality and CF from different origins are easily confused,thus,the species authentication is neces-sary.Although physicochemical,biological,and manual identification methods are widely used,they have a high professional threshold and are inefficient.Image processing methods are easily affected by environmental factors,which reduces their reliability.Thus,there is an urgent need to study fast and accurate methods for the identification of CF.Inspired by CoAtNet and Swin-Transformer networks,we have proposed a hybrid neural network model with multi-scale features,combining the local information of the deep separable convolution network in MBConv and the non-local loss of the multi-level structure in Swin Transformer.By acquiring different features,the superficial features including shape,color and texture as prior knowledge have fused the high-level semantic information.A fast and effective recogni-tion method is developed to realize the effective identification of CF from different origin.Furthermore,a new global spatial attention mechanism is introduced,which can focus and learn the fine-grained fea-tures of images by forming a new structure of channel attention module and spatial attention module.Our experimental results demonstrate that our proposed method has the highest identification accuracy of 89.306％,which outperforms other baseline models.This study highlights the potential for impro-ving the scientific and technological level of TCM identification and broadening research on TCM.关键词
多尺度特征/神经网络/山楂/细粒度识别Key words
Multi-scale features/Neural network/Cratargi Fructus/Fine-grained recognition分类
信息技术与安全科学引用本文复制引用
谭超群,秦中翰,黄欣然,陈虎,黄永亮,吴纯洁,游志胜..基于多尺度特征深度神经网络的不同产地山楂细粒度图像识别[J].四川大学学报（自然科学版）,2024,61(1):107-118,12.基金项目
四川省科技厅应用基础研究课题(2018JY0435) （2018JY0435）
四川省中医药管理局科学技术研究专项课题(2021MS012) （2021MS012）
成都中医药大学"杏林学者"学科人才科研提升计划人才项目(QNXZ2019018) （QNXZ2019018）
