现代电影技术Issue(7):44-51,8.DOI:10.3969/j.issn.1673-3215.2026.07.006
多模态理解与生成统一模型在影视制作中的应用研究
Application of unified multimodal understanding and generation models in film and television production
摘要
Abstract
Unified multimodal understanding and generation models employ a single model architecture to comprehend se-mantic information across multiple modalities such as text,images,audio,and video,which can perform both understand-ing and generation tasks.Their core principles lie in the alignment and integration of cross-modal semantic information.In recent years,with the development of large-scale pre-training methods,large language models,and diffusion models,the performance of unified multimodal understanding and generation models has improved significantly,demonstrating promis-ing application potential in the film and television industry.Based on this context,this paper provides a comprehensive re-view of unified multimodal understanding and generation models used in film and television production.We introduce the core principles and dataset construction efforts of these models,survey representative works along the film and television production pipeline,and analyze the technical challenges and ethical issues faced in their practical applications.Research suggests that such models can serve as production tools to improve the efficiency of film and television content creation,and also serve as a foundation for future research on the industrialization of film and television.关键词
多模态大语言模型/扩散模型/人工智能/影视制作Key words
Multimodal Large Language Model/Diffusion Model/Artificial Intelligence/Film and Television Production分类
信息技术与安全科学引用本文复制引用
冯大蕗,陈姿涵,陈军..多模态理解与生成统一模型在影视制作中的应用研究[J].现代电影技术,2026,(7):44-51,8.基金项目
2025年度北京市数字教育研究课题一般课题"'艺工融合'理念下面向影视类专业的人工智能通识课构建与实践研究"(BDEC2025619134) (BDEC2025619134)
2025年度北京市教育委员会新进教师资助计划项目"人工智能赋能虚拟现实电影创作的路径与方法研究"(JWG202521). (JWG202521)