中国工程科学2024，Vol.26Issue(1)：160-177,18.DOI:10.15302/J-SSCAE-2024.01.012
面向自动驾驶场景的脉冲视觉研究
Spike-Based Vision for Autonomous Driving Scenarios
摘要
Abstract
Autonomous driving is an important research direction in computer vision which has broad application prospects.Pure vision perception schemes have significant research value in autonomous driving scenarios.Different from traditional cameras,spike vision sensor offers imaging speeds over a thousand times faster than traditional cameras,possess advantages such as high temporal resolution,high dynamic range,low data redundancy,and low power consumption.This study focuses on autonomous driving scenarios,introducing the imaging principles,perception capabilities,and advantages of the spike camera.Besides,focusing on visual tasks related to autonomous driving,this study elaborates on the principles and methods of spike-based image/video reconstruction,discusses the approach to image enhancement based on sensor fusion with spike cameras,and provides a detailed description of the algorithms and technical routes for motion optical flow estimation,object recognition,detection,segmentation,and tracking,and deep estimation of three-dimensional scenes based on spike cameras.It also summarizes the development of the spike camera data and systems.At last,it analyzes the challenges,potential solutions,and future directions for spike vision research.Spike cameras and their algorithms and systems hold great potentials in the field of autonomous driving and represent one of the future research directions in computer vision.关键词
脉冲视觉/脉冲相机/自动驾驶/人工智能Key words
spike-based vision/spike camera/autonomous driving/artificial intelligence分类
信息技术与安全科学引用本文复制引用
张济远,郑雅菁,余肇飞,黄铁军..面向自动驾驶场景的脉冲视觉研究[J].中国工程科学,2024,26(1):160-177,18.基金项目
中国工程院咨询项目"新一代人工智能及产业集群发展战略研究"(2022-PP-07) Chinese Academy of Engineering project"Strategic Research on New Generation of Artificial Intelligence and Industrial Clusters"(2022-PP-07) （2022-PP-07）
