南京大学学报（自然科学版）2024，Vol.60Issue(1)：26-37,12.DOI:10.13232/j.cnki.jnju.2024.01.004
基于乳腺超声视频流和自监督对比学习的肿瘤良恶性分类系统
Breast tumor classification based on video stream and self-supervised contrastive learning
摘要
Abstract
Abstact:Breast ultrasound is widely used in the diagnosis of breast tumors.Deep learning-based tumor benign-malignant classification models effectively assist doctors in diagnosis,improving efficiency and reducing misdiagnosis rates,among other benefits.However,the high cost of annotated data limits the development and application of such models.In this study,we construct an unlabeled pretraining dataset from breast ultrasound videos,which includes 11805 target samples and dynamical-ly generated positive and negative sample datasets(with sample sizes of 188880 and 1310355,respectively).Based on this dataset,we build a triplet network and conduct self-supervised contrastive learning.Additionally,we develope Hard Negative Mining and Hard Positive Mining methods to select challenging positive and negative samples for constructing the contrastive loss function,accelerating model convergence.After parameter transfer,the triplet network is fine-tuned and tested on the SYU dataset.Experimental results demonstrate that the triplet network model developed in this study exhibits stronger gen-eralization capability and better classification performance compared to several state-of-the-art models pretrained on ImageNet and previous multi-view contrastive models for breast ultrasound.Furthermore,we test the minimum requirement of annotat-ed data for the model and find that using only 96 annotated data points achieves a performance with an AUC=0.901 and sen-sitivity of 0.835.关键词
乳腺超声/深度学习/自监督学习/对比学习/预训练模型/三胞胎网络Key words
breast ultrasound/deep learning/self-supervised learning/contrastive learning/pre-trained model/Triplet Network分类
计算机与自动化引用本文复制引用
唐蕴芯,廖梅,张艳玲,张建,陈皓,王炜..基于乳腺超声视频流和自监督对比学习的肿瘤良恶性分类系统[J].南京大学学报（自然科学版）,2024,60(1):26-37,12.基金项目
国家自然科学基金(11774158) （11774158）
