佛山科学技术学院学报（自然科学版）2026，Vol.44Issue(3)：41-50,10.
面向多主体语义解耦的图像生成框架研究
Research on an image generation framework for multi-entity semantic disentanglement
摘要
Abstract
To address issues such as semantic confusion,attribute mismatch,and insufficient consistency in multi-subject and multi-attribute text-guided generation image with diffusion models,this paper proposes a semantic-guided multi-subject image generation method.First,a text-image preprocessing mechanism is designed,which enhances the model's ability to disentangle multiple entities and their attributes through part-of-speech segmentation and fusion with latent representations of reference images.Second,a hierarchical cross-attention mechanism is introduced,combining regional masks with entity-specific text to achieve precise semantic and spatial alignment.Finally,a dual-branch parallel denoising architecture is constructed,integrating structural priors from layout maps with textual semantics to improve structural consistency and semantic stability in the generated images.Experiments are conducted on the color,texture,and shape subsets of the T2I-CompBench benchmark using Stable Diffusion XL.Semantic consistency is evaluated using BLIP-VQA and VQAScore metrics,achieving scores of 69.79%,58.43%,52.97%,and 80.74%,respectively—representing improvements of 1.40%,1.09%,2.05%,and 2.04%over existing methods—demonstrating the effectiveness of the proposed approach in generating consistent and controllable images under complex text-image conditions.关键词
扩散模型/语义属性绑定/交叉注意力/图像生成Key words
diffusion model/semantic attribute binding/cross-attention/image generation分类
信息技术与安全科学引用本文复制引用
彭俊轩,周燕,陈维德,刘翔宇,周月霞..面向多主体语义解耦的图像生成框架研究[J].佛山科学技术学院学报（自然科学版）,2026,44(3):41-50,10.基金项目
国家自然科学基金资助项目(61972091) （61972091）
