华中科技大学学报（自然科学版）2017，Vol.45Issue(10)：111-116,6.DOI:10.13245/j.hust.171021
基于自然语言表达的目标检测算法
Object detection algorithm based on natural language expression
摘要
Abstract
To help the robotics localize a target object based on a natural language expression about the target ,a fast and end-to-end object detection algorithm based on natural language expression was proposed as follow :a convolution neural network and a recurrent neural network was jointly trained to learn visual and linguistic information .Recurrent neural network was used to encode the natural language expression into a vector representation ,and convolution neural network was used to extract the feature of image regions .Comparing those region features to language feature ,region with high similarity was the target object .Model was trained in UNC-Ref and G-ref dataset ,and showed out-performance in speed and precision .关键词
目标检测/自然语言处理/卷积神经网络/循环神经网络/人机交互Key words
object detection/natural language processing/convolution neural network (CNN)/recur-rent neural network (RNN)/man-machine interaction分类
信息技术与安全科学引用本文复制引用
田国会,刘浩鹏,部俊峰..基于自然语言表达的目标检测算法[J].华中科技大学学报（自然科学版）,2017,45(10):111-116,6.基金项目
国家自然科学基金资助项目 (61773239) （61773239）
山东省自然科学基金资助项目 (ZR2015FM007) （ZR2015FM007）
山东省泰山学者工程资助项目 . （）
