|国家科技期刊平台
首页|期刊导航|智能科学与技术学报|OrthoGPT:面向精准诊疗的多模态骨科大模型

OrthoGPT:面向精准诊疗的多模态骨科大模型OACSTPCD

OrthoGPT:multimodal generative pre-trained transformer models for precise diagnosis and treatment of orthopedics

中文摘要英文摘要

针对骨科疾病诊疗面临的非医院场景下应急处理困难、手术规划复杂且风险高以及康复治疗个性化需求强等诸多挑战,提出了面向骨科精准诊疗的多模态骨科大模型——OrthoGPT.该模型充分利用多模态特征对齐与融合技术和多场景个性化诊疗方案生成技术,结合基于平行理论的骨科世界模型和多Agent智能交互方法,为非医院场景提供初步诊断和应急指导,模拟和预测个性化术后治疗效果,辅助医生进行手术规划,并提供个性化康复治疗建议.该模型旨在探讨OrthoGPT在骨科疾病诊疗中的应用潜力,以期提高诊疗效率和提升效果,改善患者体验,推动人工智能技术在骨科疾病诊疗的发展和应用.

This paper proposes OrthoGPT,a multimodal generative pre-trained transformer model designed for precise di-agnosis and treatment of orthopedic diseases.It addresses several challenges in orthopedic care,such as the difficulties in emergency management outside hospital settings,the complexity and high risks associated with surgical planning,and the strong demand for personalized rehabilitation therapy.The model leverages multimodal feature alignment and fusion tech-nology,multi-scenario personalized diagnosis and treatment plan generation technology,combined with an orthopedic world model based on parallel theory and multi-agent methods.It aims to provide preliminary diagnosis and emergency guidance in non-hospital scenarios,simulate and predict personalized postoperative treatment outcomes,assist doctors in surgical planning,and offer personalized rehabilitation treatment suggestions.The purpose of this paper is to explore the potential applications of OrthoGPT in improving the efficiency and effectiveness of orthopedic diagnosis and treatment,enhancing the patient experience,and advancing the development and application of artificial intelligence in the field of orthopedics.

张志成;王静;张阳;田永林;张濛濛;吕宜生;王飞跃

中国人民解放军总医院第七医学中心,北京 100010中国科学院自动化研究所多模态人工智能系统全国重点实验室,北京 100190||澳门科技大学创新工程学院,澳门 999078中国科学院自动化研究所多模态人工智能系统全国重点实验室,北京 100190中国科学院自动化研究所多模态人工智能系统全国重点实验室,北京 100190||中国科学院大学,北京 100049中国科学院自动化研究所多模态人工智能系统全国重点实验室,北京 100190||澳门科技大学创新工程学院,澳门 999078||中国科学院大学,北京 100049

计算机与自动化

骨科大模型智慧医疗平行医疗

orthopedicslarge language modelssmart healthcareparallel medicine

《智能科学与技术学报》 2024 (003)

338-346 / 9

国家自然科学基金项目(No.62176266);北京市自然科学基金项目(No.J200012);澳门特别行政区科学技术发展基金项目(No.0145/2023/RIA3,No.0093/2023/RIA2) The National Natural Science Foundation of China(No.62176266),Beijing Natural Science Foundation(No.J200012),The Science and Technology Development Fund of Macao Special Administrative Region(No.0145/2023/RIA3,No.0093/2023/RIA2)

10.11959/j.issn.2096-6652.202433

评论