计算机与现代化Issue(12)：87-93,7.DOI:10.3969/j.issn.1006-2475.2023.12.015
基于多源动作信息的手卫生动作质量评估
Hand Hygiene Action Quality Assessment Based on Multi-source Action Information
摘要
Abstract
The research on hand hygiene action quality assessment plays a crucial role in the intervention and improvement of hand hygiene behaviors.To address this task,this paper takes two different types of hand hygiene action information from video data and differential image data as inputs,creating a hand hygiene action quality assessment method based on multi-source ac-tion information.The algorithm consists of an action segmentation module and an evaluation module.In the action segmentation module,the feature segments associated with each step are divided by the position index.In the evaluation module,the differen-tial image features obtained by the inter-frame difference method and ResNet50 feature extractor are introduced to combine with the past method(combining the optical flow and the I3D feature information of RGB)to capture the subtle hand motion informa-tion.The feature segments obtained by borrowing the segmentation module are processed and input to the hand hygiene informa-tion decoder based on the cross-attention mechanism,and the comprehensive features that fuse the details of hand motion are ob-tained.Next,these features are used to calculate the evaluation score of each step,and finally the evaluation score of each step is added to obtain the final evaluation result.The algorithm is verified by using the public data set HHA300.In the evaluation task,the evaluation index ρ and R-ℓ2(×100)achieves 0.86 and 0.95 respectively,which fully proves that the algorithm can accu-rately evaluate the motion quality of hand hygiene.关键词
手卫生/动作质量评估/差分图像/帧间差分法/动作分割/交叉注意力Key words
hand hygiene/action quality assessment/difference images/frame difference method/action segmentation/cross-attention分类
信息技术与安全科学引用本文复制引用
李德康,汤进,王福田,涂子健..基于多源动作信息的手卫生动作质量评估[J].计算机与现代化,2023,(12):87-93,7.基金项目
国家自然科学基金资助项目(62076003) （62076003）
合肥市自然科学基金资助项目(HZ22ZK001) （HZ22ZK001）
