计算机科学与探索2026，Vol.20Issue(9)：2612-2622,11.DOI:10.3778/j.issn.1673-9418.2509039
视觉自适应分割对比增强的领域多模态神经机器翻译方法
Domain Multimodal Neural Machine Translation Method with Visual Adaptive Segmentation Contrastive Enhancement
摘要
Abstract
Domain-specific multimodal neural machine translation(DMNMT)incorporates images as an additional modality input to achieve accurate translation from the source language to the target language within specific domains,thereby enhancing translation accuracy and robustness.Since visual information contains rich domain-specific details,its integration can strengthen the domain representation capabilities of model and further optimize the translation of domain-specific terminology.Most existing MNMT approaches enhance text with visual information through fine-grained cross-modal architectures,but they fail to selectively mine and filter domain-related and non-domain information.This results in insufficient capability of the image-text fusion architecture to screen and integrate domain visual features,leading to target translations lack of strong domain relevance.To address the challenge of filtering and integrating visual information at different domain levels,this paper proposes a text-image fusion method based on visually adaptive segmentation and contrastive enhancement.This method progressively disentangles domain-related visual information from non-domain visual information associated with the text,improving the capture of domain information.Additionally,it introduces a source language-domain visual-non-domain visual cross-modal and cross-lingual triplet constraint that pulls domain information closer to the source language while pushing non-domain information farther away.This effectively boosts the performance of domain-specific multimodal machine translation.Experimental results on the Fashion-MMT and EMMT domain datasets,as well as the general-domain Multi30K dataset,demonstrate the effectiveness of the proposed method.Further ablation studies and visualizations confirm the efficacy and robustness of model.关键词
多模态神经机器翻译/视觉自适应分割/三元组约束/对比增强Key words
multimodal neural machine translation/visual adaptive segmentation/triple constraint/contrast enhancement分类
信息技术与安全科学引用本文复制引用
张凯丽,郭军军..视觉自适应分割对比增强的领域多模态神经机器翻译方法[J].计算机科学与探索,2026,20(9):2612-2622,11.基金项目
国家自然科学基金(62366025) （62366025）
云南省科学技术厅自然科学基金(202301AT070444,202301AT070393) （202301AT070444,202301AT070393）
云南省重大科技专项计划项目(202202AE090008-3,202402AG050007-3). This work was supported by the National Natural Science Foundation of China(62366025),the Natural Science Foundation of Yunnan Science and Technology Department(202301AT070444,202301AT070393),and the Yunnan Provincial Major Science and Technology Special Plan Projects(202202AE090008-3,202402AG050007-3). （202202AE090008-3,202402AG050007-3）
