丝绸2025，Vol.62Issue(7)：12-23,12.DOI:10.3969/j.issn.1001-7003.2025.07.002
基于多模态的服务型虚拟数字人服装情景适配度情感效应研究
Research on the emotional effect of service-oriented virtual digital human apparel scenario adaptation based on multimodal approaches
摘要
Abstract
Under the macro background of the rapid development of the metaverse industry,service-oriented virtual digital humans constitute a core component of human-computer interaction environments.Their production demonstrates a trend toward convenience,refinement,and intellectualization.Service-oriented virtual digital humans focus on user needs and maintain clearly defined social and professional functions.They increasingly penetrate service scenarios that require high levels of emotional connection,such as virtual customer service agents,virtual assistant doctors,and virtual assistant lawyers.In these contexts,clothing serves as a critical symbol of identity and professionalism for the interactive entity.It directly shapes users' cognition,trust,and emotional responses.However,with the proliferation of diverse application scenarios,service-oriented virtual digital humans encounter the dual challenge of conveying professional authority while establishing user affinity through design elements.Clothing thus emerges as a pivotal factor in regulating the human-computer relationship.Therefore,the present study aims to investigate the impact of clothing-scene congruence on the emotional responses elicited by service-oriented virtual digital humans.This study provides theoretical guidance for the design of attire in virtual digital human applications.To realize this aim,the study develops a situational fitness evaluation system tailored for service-oriented contexts and selects virtual images with varying degrees of clothing-scene congruence.The study employs multimodal measurement methods to quantitatively assess the influence of clothing-scene fit on users'emotional experiences.It systematically elucidates the relationship between the degree of clothing-scene fitness and user emotion,thereby uncovering the underlying mechanisms that mediate this interaction. Based on the above objectives,this study draws upon international professional dress codes as well as theoretical and practical advancements in relevant domains.The research establishes a systematic evaluation system for assessing the suitability of clothing within different scenarios,and both volunteers and experts score the appropriateness of each clothing style.Clothing with high,medium,and low levels of scene congruence is quantitatively selected as experimental stimuli.Subsequently,the study adopts a female virtual host-a typical service-oriented figure-as the experimental prototype.The research simulates news programs,entertainment programs,and emergency broadcasts,and recruits forty-eight participants for the experiment.The study designs the entire experimental process in a highly controlled and detailed manner,encompassing the measurement of participants' emotional baselines,the presentation of the stimulus materials,multimodal synchronous data collection,and retrospective interviews.All procedures serve to enhance the rigor and representativeness of the research. In terms of specific methodology,this study combines subjective emotion self-rating scales,eye-tracking technology,and physiological indicators such as skin conductance response.Based on these methods,the research constructs a multi-modal system for measuring affective effects.All data undergo systematic collection and normalization.The analysis employs variance analysis,multivariate statistical techniques,and cross-validation to ensure scientific rigor and effectiveness of the results.In addition,the study utilizes the Unified Theory of Acceptance and Use of Technology(UTAUT)model to further assess participants' acceptance and behavioral intentions regarding the clothing-scene congruence of service-oriented virtual humans. The results indicate that enhancements in the situational congruence of clothing produce significant effects across all measured modalities.Clothing with high adaptability substantially increases users' positive affect and arousal levels,and it further enhances their behavioral intention and technology acceptance.Eye-tracking and physiological activity data reveal that,under conditions of high clothing-scene congruence,users demonstrate greater attentional focus and higher levels of cognitive engagement,while their emotional involvement becomes more pronounced.The strong alignment among multimodal datasets further elucidates the positive relationship linking clothing-scene congruence to user emotional responses. Through the emotional effect experiment focusing on the degree of clothing-scene congruence for service-oriented virtual digital humans,this paper constructs and verifies an evaluation system for assessing garment-scene fit.The study introduces a multi-modal measurement approach to achieve comprehensive quantification of the emotional impact exerted by clothing-scene adaptation on users.This method not only presents a multidimensional description of the influence that scene-adaptive clothing exerts on users' emotional experience,but also offers strong empirical support for the implementation of clothing design in service-oriented virtual digital humans to enhance user experience. Although this study conducts an innovative exploration of the emotional effects of clothing-scene congruence in service-oriented virtual digital humans based on multi-modal measurement methods,its research scope and methodology still require further improvement.Firstly,the research should expand its scope to include entertainment-oriented and other diversified occupational types of virtual digital humans,in order to conduct in-depth comparisons of the differential effects of clothing adaptability on users' emotional experience across various social functions and scenarios.Secondly,it is necessary to introduce participant samples of multiple age groups and different social backgrounds,especially a greater proportion of middle-aged and elderly individuals,so as to enhance the universality and practical significance of the research findings.Finally,it is advisable to integrate interactive virtual digital human platforms to simulate more realistic human-computer interaction situations.This approach can facilitate the capture of more accurate and dynamic emotional expressions and cognitive changes of users,so as to provide more precise references for the development and design of virtual digital humans.关键词
服务型虚拟数字人/服装情景适配度/多模态情感计算/生理数据/眼动追踪/人机交互设计Key words
service-oriented virtual digital human/clothing scenario congruence/multimodal affective computing/physiological data/eye-tracking/human-computer interaction design分类
轻工纺织引用本文复制引用
张旭升,燕耀,张寒诺,雷桐,张宝山,蔡欣华..基于多模态的服务型虚拟数字人服装情景适配度情感效应研究[J].丝绸,2025,62(7):12-23,12.基金项目
陕西省社会科学基金专项项目(2024HZ0647) （2024HZ0647）
