天津科技大学学报2026，Vol.41Issue(3)：10-17,8.DOI:10.13364/j.issn.1672-6510.20250017
基于图文模型和对比学习的水稻病害识别方法
A Method for Rice Disease Recognition Based on Image-Text Model and Contrastive Learning
摘要
Abstract
To address the issues of low recognition accuracy and over-reliance on labeled data in traditional rice disease recognition methods based solely on rice images,this article proposes a rice disease recognition method based on an image-text model and contrastive learning.The text modality complements image information,partially mitigating the problem of insufficient image training samples.Contrastive learning,an unsupervised learning approach,improves the current problem of over-reliance on labeled data in training deep learning models for rice leaf disease recognition.Firstly,a rice image-text pair dataset is constructed using the text generation from image technology of large models,GPT-3.5.Then,within the image-text model for rice disease recognition,the text encoder module is optimized to reduce training time.Additionally,a rice disease recognition method based on contrastive learning employs a hard negative sampling strategy within the image encoder of the image-text model.This allows it to effectively learn feature representations of various categories,thereby enhancing model robustness.Experimental results demonstrate that the proposed model outperforms other models in recogni-tion accuracy for rice disease tasks.关键词
水稻病害识别/对比学习/图文模型/无监督学习Key words
rice disease recognition/contrastive learning/image-text model/unsupervised learning分类
信息技术与安全科学引用本文复制引用
杨巨成,沈杰,刘建征,吴超..基于图文模型和对比学习的水稻病害识别方法[J].天津科技大学学报,2026,41(3):10-17,8.基金项目
天津市自然科学基金重点项目(18JCZDJC32100) （18JCZDJC32100）
