计算机工程与应用2024，Vol.60Issue(5)：62-75,14.DOI:10.3778/j.issn.1002-8331.2305-0294
多模态检索研究综述
Review of Research on Multimodal Retrieval
摘要
Abstract
With the increasing of multimodal data,multimodal retrieval technology has received a lot of attention.With the introduction of computer and big data technology in automobile,medical and other industries,a large amount of indus-try data itself are presented in a multi-modal form.With the rapid development of the industry,people's demand for infor-mation is constantly increasing,and single modal data retrieval can no longer meet people's demand for information.In order to solve these problems and meet the needs of data retrieval from one mode and other modes,this paper studies multi-modal retrieval methods through literature review,analyzes different research methods such as common subspace,deep learning and multi-modal Hash algorithm,and sorts out the multi-modal retrieval techniques proposed by researchers in recent years to solve these problems.Finally,the multimodal retrieval methods proposed in recent years are evaluated and compared according to the accuracy,efficiency and characteristics of the retrieval.This paper analyzes the challenges encountered in multimodal retrieval and looks forward to the future application prospects of multimodal retrieval.关键词
多模态检索/公共子空间/深度学习/哈希算法Key words
multimodal retrieval/public subspace/deep learning/Hash algorithm分类
信息技术与安全科学引用本文复制引用
金涛,金冉,侯腾达,袁杰,顾骁哲..多模态检索研究综述[J].计算机工程与应用,2024,60(5):62-75,14.基金项目
国家自然科学基金(61472348,61672455) （61472348,61672455）
教育部人文社科项目(17YJCZH076) （17YJCZH076）
浙江省基础公益研究计划(LGF18F020001,LGF21F020022) （LGF18F020001,LGF21F020022）
宁波市重大科技攻关暨"揭榜挂帅"项目(20211ZDYF020218). （20211ZDYF020218）
