自动化学报2017，Vol.43Issue(10)：1759-1772,14.DOI:10.16383/j.aas.2017.c160584
基于运动目标三维轨迹重建的视频序列同步算法
Synchronization of Video Sequences Through 3D Trajectory Reconstruction
摘要
Abstract
We present an algorithm for synchronization of an arbitrary number of videos captured by cameras independently moving in a dynamic 3D scene.Assuming the 3D spatial poses of the cameras are known for each frame,we first reconstruct the 3D trajectory of a moving point using the trajectory basis-based method.The trajectory coefficients are computed for each sequence separately.Point correspondences across sequences are not required,or even it is possible to track different points in different sequences,only if every 3D point tracked in the second sequence is a linear combination of subsets of the 3D points tracked in the first sequence.Then we propose use a robust rank constraint of the coefficient matrices to measure the spatio-temporal alignment quality for every feasible pair of video fragments.Finally,the optimal temporal mapping is found using a graph-based approach.Our algorithm can use both short and long feature trajectories,and it is robust to mild outliers.We verify the robustness and performance of the proposed approach on synthetic data as well as on challenging real video sequences.关键词
视频同步/独立运动相机/运动恢复非刚性结构/轨迹基/秩约束Key words
Video synchronization/independently-moving cameras/non-rigid structure from motion/trajectory basis/rank constraint引用本文复制引用
王雪,SHI Jian-Bo,PARK Hyun-Soo,王庆..基于运动目标三维轨迹重建的视频序列同步算法[J].自动化学报,2017,43(10):1759-1772,14.基金项目
国家自然科学基金(61531014)资助 （61531014）
Supported by National Natural Science Foundation of China(61531014) （61531014）
