JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE) ›› 2026, Vol. 61 ›› Issue (6): 25-34.doi: 10.6040/j.issn.1671-9352.5.2025.188

Previous Articles    

Rapid synchronous multi-physics modeling of human soft tissue with the integration of CBAM attention mechanism

HU Ziyang1, LIAO Shenghui1*, WU Renzhong1, LUO Rui2, LI Jianfeng3, LIU Lihong4, KUI Xiaoyan1   

  1. 1. School of Computer Science and Engineering, Central South University, Changsha 410083, Hunan, China;
    2. School of Virtual Reality(VR)Modern Industries, Jiangxi University of Finance and Economics, Nanchang 330032, Jiangxi, China;
    3. School of Computer Science and Engineering, Jishou University, Jishou 416000, Hunan, China;
    4. The Second Xiangya Hospital, Central South University, Changsha 410011, Hunan, China
  • Published:2026-06-04

Abstract: Rapid physical modeling of human soft tissue is crucial for surgical simulation. The integration of deep learning with finite element analysis addresses the inefficiencies of traditional modeling approaches. However, existing research primarily focuses on deformation modeling under external loading, neglecting the importance of other physical fields, such as stress and reaction forces, which play a critical role in guiding surgical training. To address this gap, we propose a novel neural network-based approach for rapid multi-physics modeling of soft tissues. This approach efficiently predicts physical fields by compactly encoding the nonlinear relationships between the loading conditions and mechanical responses of the soft tissue. To resolve the issue of non-convergence during network training caused by the scale differences between physical fields, we introduce the convolutional block attention module(CBAM)to dynamically balance the weights between different physical fields, thus overcoming the dominance of large-scale physical fields in model training. Extensive experiments show that the proposed method outperforms similar approaches in terms of both accuracy and efficiency in predicting multi-physics fields of soft tissue under external loads. Compared to traditional numerical methods, it achieves a several-thousand-fold improvement in efficiency with only about a 5% loss in accuracy, making it a promising tool for computer-aided medical technologies such as surgical simulation.

Key words: physical-based modeling, deep learning, surgical simulation, finite element model

CLC Number: 

  • TP391
[1] CACCIANIGA G, MARIANI A, DE PARATESI C G, et al. Multi-sensory guidance and feedback for simulation-based training in robot assisted surgery: a preliminary comparison of visual, haptic, and visuo-haptic[J]. IEEE Robotics and Automation Letters, 2021, 6(2):3801-3808.
[2] UJITOKO Y, BAN Y. Survey of pseudo-haptics: haptic feedback design and application proposals[J]. IEEE Transactions on Haptics, 2021, 14(4):699-711.
[3] SURYAWANSHI P, GUPTA A. A mass spring model for physically-realistic haptic rendering of deformable objects[C] //2022 International Symposium on Electrical, Electronics and Information Engineering(ISEEIE). New Jersey: IEEE, 2022:278-281.
[4] LI Y, ZHOU X H, LI H, et al. Haptic simulation system for liver surgery based on variable virtual stiffness optimization[C] //2021 IEEE 7th International Conference on Virtual Reality(ICVR). Foshan: IEEE, 2021:156-160.
[5] TANG Y S, LIU S, DENG Y R, et al. An improved method for soft tissue modeling[J]. Biomedical Signal Processing and Control, 2021, 65:102367.
[6] MOROOKA K, CHEN X, KURAZUME R, et al. Real-time nonlinear FEM with neural network for simulating soft organ model deformation[C] //Medical Image Computing and Computer-Assisted Intervention-MICCAI 2008. Heidelberg: Springer, 2008:742-749.
[7] LIANG L, LIU M L, MARTIN C, et al. A deep learning approach to estimate stress distribution: a fast and accurate surrogate of finite-element analysis[J]. Journal of the Royal Society, Interface, 2018, 15(138):20170844.
[8] PHELLAN R, HACHEM B, CLIN J, et al. Real-time biomechanics using the finite element method and machine learning: review and perspective[J]. Medical Physics, 2021, 48(1):7-18.
[9] WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C] //Computer Vision-ECCV 2018. Cham: Springer, 2018:3-19.
[10] RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation[M] //Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015. Cham: Springer, 2015:234-241.
[11] MENDIZABAL A, MÁRQUEZ-NEILA P, COTIN S. Simulation of hyperelastic materials in real-time using deep learning[J]. Medical Image Analysis, 2020, 59:101569.
[12] DESHPANDE S, LENGIEWICZ J, BORDAS S P A. Probabilistic deep learning for real-time large deformation simulations[J]. Computer Methods in Applied Mechanics and Engineering, 2022, 398:115307.
[13] HU J, SHEN L, SUN G. Squeeze-and-excitation networks[C] //2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018:7132-7141.
[14] HOU Q B, ZHOU D Q, FENG J S. Coordinate attention for efficient mobile network design[C] //2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR). Nashville: IEEE, 2021:13708-13717.
[15] GUO S X, CAI X J, GAO B F, et al. Tensor-mass Model based real-time simulation of vessel deformation and force feedback for the interventional surgery training system[C] //2017 IEEE International Conference on Mechatronics and Automation(ICMA). Takamatsu: IEEE, 2017:433-438.
[16] YE X F, MEI X K, XIAO S G. Filling model based soft tissue deformation model[C] //2018 IEEE International Conference on Mechatronics and Automation. Changchun: IEEE, 2018:1655-1659.
[17] NIROOMANDI S, ALFARO I, CUETO E, et al. Real-time deformable models of non-linear tissues by model reduction techniques[J]. Computer Methods and Programs in Biomedicine, 2008, 91(3):223-231.
[18] NIROOMANDI S, ALFARO I, CUETO E, et al. Accounting for large deformations in real-time simulations of soft tissues based on reduced-order models[J]. Computer Methods and Programs in Biomedicine, 2012, 105(1):1-12.
[19] COURTECUISSE H, ALLARD J, KERFRIDEN P, et al. Real-time simulation of contact and cutting of heterogeneous soft-tissues[J]. Medical Image Analysis, 2014, 18(2):394-410.
[20] LATORRE M, HUMPHREY J D. Fast, rate-independent, finite element implementation of a 3D constrained mixture model of soft tissue growth and remodeling[J]. Computer Methods in Applied Mechanics and Engineering, 2020, 368:113156.
[21] ZHANG J N, CHAUHAN S. Fast computation of soft tissue thermal response under deformation based on fast explicit dynamics finite element algorithm for surgical simulation[J]. Computer Methods and Programs in Biomedicine, 2020, 187:105244.
[22] WU S W, WAN D T, JIANG C, et al. A finite strain model for multi-material, multi-component biomechanical analysis with total Lagrangian smoothed finite element method[J]. International Journal of Mechanical Sciences, 2023, 243:108017.
[23] TANG L, LIU P X, HOU W G. Simulation of soft tissue deformation under physiological motion based on complementary dynamic method[J]. Computer Methods and Programs in Biomedicine, 2024, 243:107851.
[24] BICKEL B, BÄCHER M, OTADUY M A, et al. Capture and modeling of non-linear heterogeneous soft tissue[J]. ACM Transactions on Graphics, 2009, 28(3):1-9.
[25] PELLICER-VALERO O J, RUPÉREZ M J, MARTÍNEZ-SANCHIS S, et al. Real-time biomechanical modeling of the liver using machine learning models trained on finite element method simulations[J]. Expert Systems with Applications, 2020, 143:113083.
[26] PFAFF T, FORTUNATO M, SANCHEZ-GONZALEZ A, et al. Learning mesh-based simulation with graph networks[C] //International Conference on Learning Representations. [S.l.: s.n.] , 2021:1-9.
[27] SALEHI Y, GIANNACOPOULOS D. PhysGNN: a physics-driven graph neural network based model for predicting soft tissue deformation in image-guided neurosurgery[J]. Advances in Neural Information Processing Systems, 2022, 35:37282-37296.
[28] ZHANG X, WANG Z M, SUN W, et al. Heterogeneous soft tissue deformation model based on cellular neural networks: application in pulmonary hamartomas surgery[J]. Biomedical Signal Processing and Control, 2024, 95:106290.
[29] BUSTIN H, MEYER T, REITER R, et al. ElastoNet: neural network-based multicomponent MR elastography wave inversion with uncertainty quantification[J]. Medical Image Analysis, 2025, 105:103642.
[30] MA S Y, HE Z, WANG R K, et al. Measurement of biomechanical properties of transversely isotropic biological tissue using traveling wave expansion[J]. Medical Image Analysis, 2025, 101:103457.
[31] KOUTRAS C, SHAYESTEHPOUR H, PÉREZ J, et al. Characterization of spine and torso stiffness via differentiable biomechanics[J]. Medical Image Analysis, 2025, 103:103573.
[32] FANG X, KIM D, XU X A, et al. Correspondence attention for facial appearance simulation[J]. Medical Image Analysis, 2024, 93:103094.
[33] HUANG X R, HE D M, LI Z M, et al. Maxillofacial bone movements-aware dual graph convolution approach for postoperative facial appearance prediction[J]. Medical Image Analysis, 2025, 99:103350.
[34] CHUI C, KOBAYASHI E, CHEN X, et al. Combined compression and elongation experiments and non-linear modelling of liver tissue for surgical simulation[J]. Medical & Biological Engineering & Computing, 2004, 42(6):787-798.
[35] UMALE S, DECK C, BOURDET N, et al. Experimental mechanical characterization of abdominal organs: liver, kidney & spleen[J]. Journal of the Mechanical Behavior of Biomedical Materials, 2013, 17:22-33.
[36] ABDEL-MISIH S R, BLOOMSTON M. Liver anatomy[J]. Surgical Clinics of North America, 2010, 90(4):643-653.
[37] LO B, CHUNG A J, STOYANOV D, et al. Real-time intra-operative 3D tissue deformation recovery[C] //2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro. Paris: IEEE, 2008:1387.
[1] ZHANG Yong, JI Wei, ZHONG YI. Methods of named entity recognition and applications in electric power domain [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2026, 61(5): 1-17.
[2] ZHAO Yulin, LIANG Fengning, ZHAO Teng, CAO Yaru, WANG Lin, ZHU Hong. Method for glioma gene status prediction based on deep truth discovery [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2025, 60(7): 13-21.
[3] CHEN Yumin, ZHENG Guangyu, JIAO Na. Multi-label learning based on granular neural networks [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2024, 59(5): 1-11.
[4] Cheng LI,Wengang CHE,Shengxiang GAO. A object detection algorithm for aerial images [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2023, 58(9): 59-70.
[5] Chengcheng ZHONG,Heng ZHOU,Zitong ZHANG,Chunlei ZHANG. LAC-UNet: semantic segmentation model based on capsules for representing part-whole hierarchical features [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2023, 58(11): 116-126.
[6] Fei-fei XU,Yun-jie XU. Research on matching resumes and positions based on Arc-LSTM [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2021, 56(1): 83-90.
[7] Chang-ying HAO,Yan-yan LAN,Hai-nan ZHANG,Jia-feng GUO,Jun XU,Liang PANG,Xue-qi CHENG. Dialogue generation model based on extended keywords information [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2019, 54(7): 68-76.
[8] LIU Biao, LU Zhe, HUANG Yu-wei, JIAO Meng, LI Quan-qi, XUE Rui. Comparative study on neural network structures in power analysis [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2019, 54(1): 60-66.
[9] PANG Bo, LIU Yuan-chao. Fusion of pointwise and deep learning methods for passage ranking [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2018, 53(3): 30-35.
[10] LIU Ming-ming, ZHANG Min-qing, LIU Jia, GAO Pei-xian. Steganalysis method based on shallow convolution neural network [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2018, 53(3): 63-70.
[11] LIU Ming, ZAN Hong-ying, YUAN Hui-bin. Key sentiment sentence prediction using SVM and RNN [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2014, 49(11): 68-73.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!