南京信息工程大学学报2024，Vol.16Issue(1)：66-75,10.DOI:10.13878/j.cnki.jnuist.20220521001
基于Transformer与距离图谱的泛癌细胞核图像分割
Segmentation of nuclei in pan-cancer images via Transformer and distance map
摘要
Abstract
Indices such as tumor cell density,nucleocytoplasmic ratio,and average size have important implications for cancer grading and prognosis.Therefore,segmentation of nuclei is the fundamental prerequisite for tumor micro-environment analysis in computational pathology.Additionally,the exploration of new tumor markers is of great sig-nificance through statistical analysis of segmentation results.However,the morphology of nuclei in the background of pathological images is irregular,the staining of nuclei is uneven,and adhesion occurs between the edges of nuclei.While the segmentation error of the edge will make no difference on the overall loss as long as the main body of the nucl is correctly segmented,so the adhering nuclei can easily be regarded as the same segmentation target by exist-ing deep learning algorithms.To address the overlapping nuclei,a new segmentation algorithm based on the Trans-former and distance map,abbreviated as TDM-Net,is proposed,which integrates the core of multi-head self-attention mechanism in Transformer with contextual information to fully explore the proximity relationship and enhances the learning ability of image details by introducing distance map to emphasize the interior of nuclei and weaken the boundary of nuclei.The algorithm's Dice coefficient,precision,Aggregated Jaccard Index(AJI)and Hausdorff dis-tance are 0.797 9,0.756 1,0.667 2,and 10.11,respectively.The results show that the proposed TDM-Net outper-forms other segmentation algorithms,effectively improves nuclei segmentation accuracy and solves overlapping of dif-ferent nuclei.关键词
深度学习/病理图像/细胞核分割/Transformer/多头自注意力/距离图谱Key words
deep learning/pathological image/nuclei segmentation/Transformer/multi-head self-attention/distance map分类
信息技术与安全科学引用本文复制引用
鲁浩达,梁实,顾松,王向学,徐军..基于Transformer与距离图谱的泛癌细胞核图像分割[J].南京信息工程大学学报,2024,16(1):66-75,10.基金项目
国家自然科学基金(U1809205,62171230,92159301,62101365,61771249,91959207,81871352) （U1809205,62171230,92159301,62101365,61771249,91959207,81871352）
