| 注册
首页|期刊导航|集成电路与嵌入式系统|神经辐射场硬件加速器设计研究综述

神经辐射场硬件加速器设计研究综述

吴立舟 朱浩哲 陈迟晓

集成电路与嵌入式系统2024,Vol.24Issue(11):41-50,10.
集成电路与嵌入式系统2024,Vol.24Issue(11):41-50,10.DOI:10.20193/j.ices2097-4191.2024.0020

神经辐射场硬件加速器设计研究综述

Review on hardware accelerators design for neural radiation field

吴立舟 1朱浩哲 1陈迟晓1

作者信息

  • 1. 复旦大学芯片与系统前沿技术研究院,上海 200438
  • 折叠

摘要

Abstract

Neural Radiance Fields(NeRF)is an emerging method for reconstructing 3D scenes,garnering significant attention for its po-tential applications in the field of robotics.NeRF uses Multi-Layer Perceptrons(MLPs)to learn 3D scene features,achieving high-fidelity image rendering and providing a foundation for navigation,localization,and perception in complex environments.Its core processes,in-cluding ray sampling,feature extraction,and volumetric rendering,are computationally intensive and involve irregular memory access patterns,which limits deployment on existing hardware platforms,especially edge devices.To advance the practical application of NeRF technology,new hardware architectures and solutions for co-optimization of hardware and software are necessary.This review systemat-ically elucidates the principles and evolution of NeRF technology,exploring the performance bottlenecks encountered during its hardware execution.The review provides a detailed review of classic NeRF hardware accelerators,summarizing three main optimization direc-tions:image similarity optimization,spatial sparsity optimization,and memory access optimization,and analyzes the commonalities and differences among various techniques.Additionally,the review examines the technical limitations and challenges of current NeRF accel-erators in handling open scene tasks,considering applications such as SLAM and AIGC,particularly in terms of scalability and storage constraints.Finally,the review offers suggestions for future development to inspire further applications and optimization of NeRF hard-ware accelerators.

关键词

神经辐射场/3D重建/图像渲染/加速器/TensoRF

Key words

NeRF/3D reconstruction/graphic rendering/accelerator/TensoRF

分类

信息技术与安全科学

引用本文复制引用

吴立舟,朱浩哲,陈迟晓..神经辐射场硬件加速器设计研究综述[J].集成电路与嵌入式系统,2024,24(11):41-50,10.

集成电路与嵌入式系统

OACSTPCD

1009-623X

访问量0
|
下载量0
段落导航相关论文