农业机械学报2025，Vol.56Issue(1)：92-101,10.DOI:10.6041/j.issn.1000-1298.2025.01.010
基于多模态信息融合的皮蛋溏心沙心分类方法
Classification Methods for Soft-yolk and Hard-yolk Preserved Eggs Based on Multimodal Information Fusion
摘要
Abstract
The soft-yolk preserved eggs(SYP eggs)and hard-yolk preserved eggs(HYP eggs)each possess distinct textures and flavors,captivating their respective discerning consumers.Presently,artisans can only discern whether an egg is a soft-yolk or hard-yolk preserved egg based on the duration of the brining process,a method that not only demands their extensive expertise but also entails a high rate of misjudgment.To address this issue,the design of infrared imaging and visible/near-infrared spectroscopy acquisition devices was introduced,alongside a classification model for SYP eggs and HYP eggs.Utilizing gathered infrared image data,an enhanced model,ResNet_MLCA,was crafted by incorporating a mixed local channel attention(MLCA)module into the ResNet18 framework,achieving a noteworthy classification accuracy of 95.0％in distinguishing SYP eggs from HYP eggs.Furthermore,leveraging visible/near-infrared spectroscopy data,a one-dimensional residual module was designed,and through its stacking,the 1D_ResNet model for feature extraction and classification of visible/near-infrared spectroscopy data was developed,yielding an identical accuracy of 95.0％in discriminating SYP eggs from HYP eggs.In a bid to further augment detection accuracy,the infrared image features extracted by the ResNet_MLCA model and the visible/near-infrared spectroscopy features extracted by the 1D_ResNet were amalgamated.The resultant fusion model,ResNet_OP,achieved an outstanding classification accuracy of 98.3％in distinguishing SYP eggs from HYP eggs.In summary,this research can offer a novel,cost-effective,and high-precision classification model for SYP eggs and HYP eggs,which held significant implications for guiding preserved egg production and enhancing its quality.Additionally,the proposed method offered a theoretical reference for enhancing the performance of classification models for other agricultural products,aiming to further increase their accuracy and reduce the number of parameters in the fusion model.关键词
皮蛋/多模态信息融合/ResNet/红外图像/可见/近红外光谱/溏心沙心Key words
preserved egg/multimodal information fusion/ResNet/infrared imaging/visible/near-infrared spectroscopy/soft-yolk and hard-yolk分类
轻工业引用本文复制引用
汤文权,王巧华,张浩,杨烝,范维..基于多模态信息融合的皮蛋溏心沙心分类方法[J].农业机械学报,2025,56(1):92-101,10.基金项目
国家自然科学基金面上项目(32072302)、湖北省重点研发计划项目(20230611)和重庆市技术创新与应用发展专项乡村振兴(对口帮扶)项目(CSTB2023TIAD-ZXX0011) （32072302）
