控制理论与应用2026,Vol.43Issue(5):989-1000,12.DOI:10.7641/CTA.2025.40139
条件变分自编码器生成潜在空间特征的模仿学习算法
Imitation learning with latent space features generated by conditional variational autoencoders
摘要
Abstract
The tasks in the high-dimensional environment are common in complex tasks.The characteristics of this type of task are the information data of the task environment and the control data of the robot containing many types,with high characteristic dimensions.The existing imitation learning method makes it difficult to learn better strategies because of the complicated distribution of teaching data by experts.In this paper,an imitation learning algorithm for generating latent space features using conditional variational autoencoders is designed to address the problem of long training time and limited application of imitation learning algorithms due to high-dimensional environment space and complex data distribution.By actively reducing the dimensionality of the environment space,the complexity of the neural network is reduced to speed up the training speed,and by utilizing the action loss prediction network and the perturbation layer,feedback is obtained from the output to improve the training accuracy.This paper verifies the effectiveness of the proposed algorithm through D4RL benchmark testing,simulated tests of continuous control tasks for the Microsoft MoCapAct humanoid robot,and complex manipulation tasks for the humanoid five-fingered robot.The results show that the method proposed in this paper has faster training speed,higher accuracy and more stable strategy.关键词
机器人学习/离线模仿学习/潜在空间/行为克隆/条件变分自编码器Key words
robot learning/offline imitation learning/latent space/behavioral cloning/conditional variational autoen-coders引用本文复制引用
左国玉,何流远,吴启飞,于双悦,李建更..条件变分自编码器生成潜在空间特征的模仿学习算法[J].控制理论与应用,2026,43(5):989-1000,12.基金项目
国家自然科学基金项目(62373016),多模态人工智能国家重点实验室开放项目(MAIS-2023-22)资助.Supported by the National Natural Science Foundation of China(62373016)and the Open Projects Program of State Key Laboratory of Multimodal Artificial Intelligence System(MAIS-2023-22). (62373016)