您的位置：山东大学 -> 科技期刊社 -> 《山东大学学报（理学版）》

《山东大学学报(理学版)》 ›› 2026, Vol. 61 ›› Issue (6): 25-34.doi: 10.6040/j.issn.1671-9352.5.2025.188

• • 上一篇    

融合CBAM注意力机制的人体软组织多物理场快速同步建模

胡子阳1,廖胜辉1*,邬任重1,罗睿2,李建锋3,刘立宏4,奎晓燕1   

  1. 1.中南大学计算机学院, 湖南 长沙 410083;2.江西财经大学虚拟现实(VR)现代产业学院, 江西 南昌 330032;3.吉首大学计算机科学与工程学院, 湖南 吉首 416000;4.中南大学湘雅二医院, 湖南 长沙 410011
  • 发布日期:2026-06-04
  • 通讯作者: 廖胜辉(1981— ),男,教授, 博士生导师,博士,研究方向为三维数字化医疗、人工智能与机器学习、虚拟和增强现实、图形图像、医学建模与仿真、可视化、3D打印. E-mail:lsh@csu.edu.cn
  • 作者简介:胡子阳(1995— ),男,博士研究生,研究方向为医学建模与仿真、医学图像分析、虚拟手术与物理仿真. E-mail:ziyanghu@csu.edu.cn*通信作者:廖胜辉(1981— ),男,教授, 博士生导师,博士,研究方向为三维数字化医疗、人工智能与机器学习、虚拟和增强现实、图形图像、医学建模与仿真、可视化、3D打印. E-mail:lsh@csu.edu.cn
  • 基金资助:
    国家自然科学基金资助项目(62372475,U22A2034,62177047)

Rapid synchronous multi-physics modeling of human soft tissue with the integration of CBAM attention mechanism

HU Ziyang1, LIAO Shenghui1*, WU Renzhong1, LUO Rui2, LI Jianfeng3, LIU Lihong4, KUI Xiaoyan1   

  1. 1. School of Computer Science and Engineering, Central South University, Changsha 410083, Hunan, China;
    2. School of Virtual Reality(VR)Modern Industries, Jiangxi University of Finance and Economics, Nanchang 330032, Jiangxi, China;
    3. School of Computer Science and Engineering, Jishou University, Jishou 416000, Hunan, China;
    4. The Second Xiangya Hospital, Central South University, Changsha 410011, Hunan, China
  • Published:2026-06-04

PDF (PC)

1

摘要： 人体软组织的快速物理建模对手术模拟至关重要。深度学习结合有限元计算的方案解决了传统方案建模效率低下的弊端。然而,已有的研究仅关注软组织受外载时的变形建模,忽略了应力和反力等物理场对手术训练指导性意义。为此,本文提出一种新颖的基于神经网络的软组织快速多物理场建模方案。方案通过紧凑编码软组织所受载荷与机械响应之间的非线性关系实现物理场的快速预测。针对物理场之间存在数量级差异导致网络训练不收敛的问题,引入卷积块注意力模块(convolutional block attention module, CBAM)来动态平衡各个物理场之间的权重,解决大尺度物理场主导模型训练的问题。实验表明,所提方案相较于同类方案可以更加精准、高效地预测软组织受到外部载荷时的多物理场。相比于传统数值方法,以约5%的精度损失实现了上千倍的效率提升,有望为外科模拟等计算机医疗辅助技术提供便利。

关键词: 物理建模, 深度学习, 手术模拟, 有限元模型

Abstract: Rapid physical modeling of human soft tissue is crucial for surgical simulation. The integration of deep learning with finite element analysis addresses the inefficiencies of traditional modeling approaches. However, existing research primarily focuses on deformation modeling under external loading, neglecting the importance of other physical fields, such as stress and reaction forces, which play a critical role in guiding surgical training. To address this gap, we propose a novel neural network-based approach for rapid multi-physics modeling of soft tissues. This approach efficiently predicts physical fields by compactly encoding the nonlinear relationships between the loading conditions and mechanical responses of the soft tissue. To resolve the issue of non-convergence during network training caused by the scale differences between physical fields, we introduce the convolutional block attention module(CBAM)to dynamically balance the weights between different physical fields, thus overcoming the dominance of large-scale physical fields in model training. Extensive experiments show that the proposed method outperforms similar approaches in terms of both accuracy and efficiency in predicting multi-physics fields of soft tissue under external loads. Compared to traditional numerical methods, it achieves a several-thousand-fold improvement in efficiency with only about a 5% loss in accuracy, making it a promising tool for computer-aided medical technologies such as surgical simulation.

Key words: physical-based modeling, deep learning, surgical simulation, finite element model

中图分类号: 

  • TP391
[1] CACCIANIGA G, MARIANI A, DE PARATESI C G, et al. Multi-sensory guidance and feedback for simulation-based training in robot assisted surgery: a preliminary comparison of visual, haptic, and visuo-haptic[J]. IEEE Robotics and Automation Letters, 2021, 6(2):3801-3808.
[2] UJITOKO Y, BAN Y. Survey of pseudo-haptics: haptic feedback design and application proposals[J]. IEEE Transactions on Haptics, 2021, 14(4):699-711.
[3] SURYAWANSHI P, GUPTA A. A mass spring model for physically-realistic haptic rendering of deformable objects[C] //2022 International Symposium on Electrical, Electronics and Information Engineering(ISEEIE). New Jersey: IEEE, 2022:278-281.
[4] LI Y, ZHOU X H, LI H, et al. Haptic simulation system for liver surgery based on variable virtual stiffness optimization[C] //2021 IEEE 7th International Conference on Virtual Reality(ICVR). Foshan: IEEE, 2021:156-160.
[5] TANG Y S, LIU S, DENG Y R, et al. An improved method for soft tissue modeling[J]. Biomedical Signal Processing and Control, 2021, 65:102367.
[6] MOROOKA K, CHEN X, KURAZUME R, et al. Real-time nonlinear FEM with neural network for simulating soft organ model deformation[C] //Medical Image Computing and Computer-Assisted Intervention-MICCAI 2008. Heidelberg: Springer, 2008:742-749.
[7] LIANG L, LIU M L, MARTIN C, et al. A deep learning approach to estimate stress distribution: a fast and accurate surrogate of finite-element analysis[J]. Journal of the Royal Society, Interface, 2018, 15(138):20170844.
[8] PHELLAN R, HACHEM B, CLIN J, et al. Real-time biomechanics using the finite element method and machine learning: review and perspective[J]. Medical Physics, 2021, 48(1):7-18.
[9] WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C] //Computer Vision-ECCV 2018. Cham: Springer, 2018:3-19.
[10] RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation[M] //Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015. Cham: Springer, 2015:234-241.
[11] MENDIZABAL A, MÁRQUEZ-NEILA P, COTIN S. Simulation of hyperelastic materials in real-time using deep learning[J]. Medical Image Analysis, 2020, 59:101569.
[12] DESHPANDE S, LENGIEWICZ J, BORDAS S P A. Probabilistic deep learning for real-time large deformation simulations[J]. Computer Methods in Applied Mechanics and Engineering, 2022, 398:115307.
[13] HU J, SHEN L, SUN G. Squeeze-and-excitation networks[C] //2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018:7132-7141.
[14] HOU Q B, ZHOU D Q, FENG J S. Coordinate attention for efficient mobile network design[C] //2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR). Nashville: IEEE, 2021:13708-13717.
[15] GUO S X, CAI X J, GAO B F, et al. Tensor-mass Model based real-time simulation of vessel deformation and force feedback for the interventional surgery training system[C] //2017 IEEE International Conference on Mechatronics and Automation(ICMA). Takamatsu: IEEE, 2017:433-438.
[16] YE X F, MEI X K, XIAO S G. Filling model based soft tissue deformation model[C] //2018 IEEE International Conference on Mechatronics and Automation. Changchun: IEEE, 2018:1655-1659.
[17] NIROOMANDI S, ALFARO I, CUETO E, et al. Real-time deformable models of non-linear tissues by model reduction techniques[J]. Computer Methods and Programs in Biomedicine, 2008, 91(3):223-231.
[18] NIROOMANDI S, ALFARO I, CUETO E, et al. Accounting for large deformations in real-time simulations of soft tissues based on reduced-order models[J]. Computer Methods and Programs in Biomedicine, 2012, 105(1):1-12.
[19] COURTECUISSE H, ALLARD J, KERFRIDEN P, et al. Real-time simulation of contact and cutting of heterogeneous soft-tissues[J]. Medical Image Analysis, 2014, 18(2):394-410.
[20] LATORRE M, HUMPHREY J D. Fast, rate-independent, finite element implementation of a 3D constrained mixture model of soft tissue growth and remodeling[J]. Computer Methods in Applied Mechanics and Engineering, 2020, 368:113156.
[21] ZHANG J N, CHAUHAN S. Fast computation of soft tissue thermal response under deformation based on fast explicit dynamics finite element algorithm for surgical simulation[J]. Computer Methods and Programs in Biomedicine, 2020, 187:105244.
[22] WU S W, WAN D T, JIANG C, et al. A finite strain model for multi-material, multi-component biomechanical analysis with total Lagrangian smoothed finite element method[J]. International Journal of Mechanical Sciences, 2023, 243:108017.
[23] TANG L, LIU P X, HOU W G. Simulation of soft tissue deformation under physiological motion based on complementary dynamic method[J]. Computer Methods and Programs in Biomedicine, 2024, 243:107851.
[24] BICKEL B, BÄCHER M, OTADUY M A, et al. Capture and modeling of non-linear heterogeneous soft tissue[J]. ACM Transactions on Graphics, 2009, 28(3):1-9.
[25] PELLICER-VALERO O J, RUPÉREZ M J, MARTÍNEZ-SANCHIS S, et al. Real-time biomechanical modeling of the liver using machine learning models trained on finite element method simulations[J]. Expert Systems with Applications, 2020, 143:113083.
[26] PFAFF T, FORTUNATO M, SANCHEZ-GONZALEZ A, et al. Learning mesh-based simulation with graph networks[C] //International Conference on Learning Representations. [S.l.: s.n.] , 2021:1-9.
[27] SALEHI Y, GIANNACOPOULOS D. PhysGNN: a physics-driven graph neural network based model for predicting soft tissue deformation in image-guided neurosurgery[J]. Advances in Neural Information Processing Systems, 2022, 35:37282-37296.
[28] ZHANG X, WANG Z M, SUN W, et al. Heterogeneous soft tissue deformation model based on cellular neural networks: application in pulmonary hamartomas surgery[J]. Biomedical Signal Processing and Control, 2024, 95:106290.
[29] BUSTIN H, MEYER T, REITER R, et al. ElastoNet: neural network-based multicomponent MR elastography wave inversion with uncertainty quantification[J]. Medical Image Analysis, 2025, 105:103642.
[30] MA S Y, HE Z, WANG R K, et al. Measurement of biomechanical properties of transversely isotropic biological tissue using traveling wave expansion[J]. Medical Image Analysis, 2025, 101:103457.
[31] KOUTRAS C, SHAYESTEHPOUR H, PÉREZ J, et al. Characterization of spine and torso stiffness via differentiable biomechanics[J]. Medical Image Analysis, 2025, 103:103573.
[32] FANG X, KIM D, XU X A, et al. Correspondence attention for facial appearance simulation[J]. Medical Image Analysis, 2024, 93:103094.
[33] HUANG X R, HE D M, LI Z M, et al. Maxillofacial bone movements-aware dual graph convolution approach for postoperative facial appearance prediction[J]. Medical Image Analysis, 2025, 99:103350.
[34] CHUI C, KOBAYASHI E, CHEN X, et al. Combined compression and elongation experiments and non-linear modelling of liver tissue for surgical simulation[J]. Medical & Biological Engineering & Computing, 2004, 42(6):787-798.
[35] UMALE S, DECK C, BOURDET N, et al. Experimental mechanical characterization of abdominal organs: liver, kidney & spleen[J]. Journal of the Mechanical Behavior of Biomedical Materials, 2013, 17:22-33.
[36] ABDEL-MISIH S R, BLOOMSTON M. Liver anatomy[J]. Surgical Clinics of North America, 2010, 90(4):643-653.
[37] LO B, CHUNG A J, STOYANOV D, et al. Real-time intra-operative 3D tissue deformation recovery[C] //2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro. Paris: IEEE, 2008:1387.
[1] 张勇,纪伟,钟毅. 命名实体识别方法及在电力领域的应用[J]. 《山东大学学报(理学版)》, 2026, 61(5): 1-17.
[2] 赵钰琳,梁峰宁,赵藤,曹亚茹,王淋,朱红. 基于深度真值发现的胶质瘤基因状态预测方法[J]. 《山东大学学报(理学版)》, 2025, 60(7): 13-21.
[3] 陈玉明,郑光宇,焦娜. 基于粒神经网络的多标签学习[J]. 《山东大学学报(理学版)》, 2024, 59(5): 1-11.
[4] 李程,车文刚,高盛祥. 一种用于航拍图像的目标检测算法[J]. 《山东大学学报(理学版)》, 2023, 58(9): 59-70.
[5] 仲诚诚,周恒,张梓童,张春雷. LAC-UNet: 基于胶囊表达局部-整体特征关系的语义分割模型[J]. 《山东大学学报(理学版)》, 2023, 58(11): 116-126.
[6] 徐菲菲,许赟杰. 基于Arc-LSTM的人职匹配研究[J]. 《山东大学学报(理学版)》, 2021, 56(1): 83-90.
[7] 郝长盈,兰艳艳,张海楠,郭嘉丰,徐君,庞亮,程学旗. 基于拓展关键词信息的对话生成模型[J]. 《山东大学学报(理学版)》, 2019, 54(7): 68-76.
[8] 刘飚,路哲,黄雨薇,焦萌,李泉其,薛瑞. 神经网络结构在功耗分析中的性能对比[J]. 《山东大学学报(理学版)》, 2019, 54(1): 60-66.
[9] 庞博,刘远超. 融合pointwise及深度学习方法的篇章排序[J]. 山东大学学报（理学版）, 2018, 53(3): 30-35.
[10] 刘明明,张敏情,刘佳,高培贤. 一种基于浅层卷积神经网络的隐写分析方法[J]. 山东大学学报（理学版）, 2018, 53(3): 63-70.
[11] 刘铭, 昝红英, 原慧斌. 基于SVM与RNN的文本情感关键句判定与抽取[J]. 山东大学学报（理学版）, 2014, 49(11): 68-73.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
版权所有 © 2018 《山东大学学报(理学版)》编辑部　
地址: 山东省济南市山大南路27号山东大学中心校区（250100）　电话: +86-0531-88366917　E-mail: xblxb@sdu.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发