光学精密工程2024，Vol.32Issue(20)：2987-2998,12.DOI:10.37188/OPE.20243220.2987
基于稀疏自注意力的偏振表面法线估计
Shape from polarization based on sparse self-attention
摘要
Abstract
Accurate estimation of surface normal plays a vital role in various computer vision tasks.Physi-cally-based shape from polarization methods have limitations restricting their applications.Conversely,learning-based shape from polarization methods outperform physical methods in both accuracy and applica-bility.To further improve the accuracy of shape from polarization and make it applicable to a broader range of practical tasks,we proposed a novel method.First,we introduced a new polarization information repre-sentation combining Stokes vectors,enhancing the model's ability to extract polarization physical prior in-formation.Then,we integrated a bi-level routing sparse self-attention mechanism to improve the model's perception of global contextual information,enabling better disambiguation of local polarization informa-tion.Testing on the DeepSfP dataset and out test data,experimental results demonstrate our proposed method achieves an average angular error of 13.37° on the DeepSfP dataset,outperforming existing meth-ods in all tested metrics including accuracy and angular error.This indicates a significant improvement in normal estimation effectiveness with our proposed method.By introducing a novel polarization information representation and sparse self-attention mechanism,our approach enhances the accuracy and applicability of polar surface normal estimation,providing stronger support for practical task applications.关键词
偏振信息表达/稀疏自注意力机制/偏振表面法线估计Key words
polarization information representation/sparse self-attention mechanism/shape from polar-ization分类
计算机与自动化引用本文复制引用
于智超,万振华,赵开春..基于稀疏自注意力的偏振表面法线估计[J].光学精密工程,2024,32(20):2987-2998,12.基金项目
教育部联合基金资助项目(No.6141A02022606) （No.6141A02022606）
