HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries

<p dir="ltr">Simulation-based training is essential for developing minimally invasive surgical skills. While box trainers provide tactile feedback for practicing techniques like suturing and knot-tying, they lack visual realism. Virtual Reality (VR) simulators provide a visually real...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلف الرئيسي: Waseem Palliyali (22927804) (author)
مؤلفون آخرون: Hawa Hamza (17707224) (author), Santu Paul (7145237) (author), Ali Baig (22927807) (author), Abdulla Al-Ansari (14150583) (author), Omar Aboumarzouk (18427923) (author), Zhigang Deng (2638495) (author), Nikhil V. Navkar (14158857) (author)
منشور في: 2025
الموضوعات:
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
_version_ 1864513531511046144
author Waseem Palliyali (22927804)
author2 Hawa Hamza (17707224)
Santu Paul (7145237)
Ali Baig (22927807)
Abdulla Al-Ansari (14150583)
Omar Aboumarzouk (18427923)
Zhigang Deng (2638495)
Nikhil V. Navkar (14158857)
author2_role author
author
author
author
author
author
author
author_facet Waseem Palliyali (22927804)
Hawa Hamza (17707224)
Santu Paul (7145237)
Ali Baig (22927807)
Abdulla Al-Ansari (14150583)
Omar Aboumarzouk (18427923)
Zhigang Deng (2638495)
Nikhil V. Navkar (14158857)
author_role author
dc.creator.none.fl_str_mv Waseem Palliyali (22927804)
Hawa Hamza (17707224)
Santu Paul (7145237)
Ali Baig (22927807)
Abdulla Al-Ansari (14150583)
Omar Aboumarzouk (18427923)
Zhigang Deng (2638495)
Nikhil V. Navkar (14158857)
dc.date.none.fl_str_mv 2025-07-16T09:00:00Z
dc.identifier.none.fl_str_mv 10.1007/s10055-025-01193-2
dc.relation.none.fl_str_mv https://figshare.com/articles/journal_contribution/HySim_towards_development_of_a_hybrid_simulation_framework_with_improved_visual_and_tactile_realism_for_minimally_invasive_surgeries/30971029
dc.rights.none.fl_str_mv CC BY 4.0
info:eu-repo/semantics/openAccess
dc.subject.none.fl_str_mv Engineering
Biomedical engineering
Information and computing sciences
Graphics, augmented reality and games
Simulators
Virtual reality
Tactile feedback
Surgical training
Surgical skills
dc.title.none.fl_str_mv HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries
dc.type.none.fl_str_mv Text
Journal contribution
info:eu-repo/semantics/publishedVersion
text
contribution to journal
description <p dir="ltr">Simulation-based training is essential for developing minimally invasive surgical skills. While box trainers provide tactile feedback for practicing techniques like suturing and knot-tying, they lack visual realism. Virtual Reality (VR) simulators provide a visually realistic environment but often lack tactile feedback. This work integrates the strengths of both box trainers and VR simulators in a simulation framework. The proposed simulation framework, HySim, combines virtual and physical tissues into a unified operative view, thereby improving visual and tactile realism. HySim was assessed on: (a) simulation of surgical scenarios, (b) feedback from 10 participants specialized in robotic urology surgery on visual and tactile realism, and usefulness, and (c) the alignment of virtual and physical tissues during scope movements. HySim was successfully deployed for both laparoscopic (bowel anastomosis) and robotic (urethral dissection) scenarios. Compared to VR simulator, surgeons rated HySim higher for instrument motion and handling (<i>p</i> = 0.042), tool-tissue interaction (<i>p</i> = 0.022), tissue movement and behavior (<i>p</i> = 0.004), and usefulness (<i>p</i> = 0.042). It was also rated higher compared to box trainer for the operative view (<i>p</i> = 0.042). However, all three simulation environments received similar scores for the likelihood of adoption. For a scope tilt/pan movement with speed less than 10 degrees per second, the physical and virtual tissues did not have noticeable misalignment. HySim can enhance the training environment by improving both visual realism and tactile feedback. Further user studies are required to assess HySim for simulating generic and patient-specific preoperative training scenarios.</p><h2 dir="ltr">Other Information</h2><p dir="ltr">Published in: Virtual Reality<br>License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s10055-025-01193-2" target="_blank">https://dx.doi.org/10.1007/s10055-025-01193-2</a></p>
eu_rights_str_mv openAccess
id Manara2_e8bf3f3ca9817f659030159db5a45b06
identifier_str_mv 10.1007/s10055-025-01193-2
network_acronym_str Manara2
network_name_str Manara2
oai_identifier_str oai:figshare.com:article/30971029
publishDate 2025
repository.mail.fl_str_mv
repository.name.fl_str_mv
repository_id_str
rights_invalid_str_mv CC BY 4.0
spelling HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeriesWaseem Palliyali (22927804)Hawa Hamza (17707224)Santu Paul (7145237)Ali Baig (22927807)Abdulla Al-Ansari (14150583)Omar Aboumarzouk (18427923)Zhigang Deng (2638495)Nikhil V. Navkar (14158857)EngineeringBiomedical engineeringInformation and computing sciencesGraphics, augmented reality and gamesSimulatorsVirtual realityTactile feedbackSurgical trainingSurgical skills<p dir="ltr">Simulation-based training is essential for developing minimally invasive surgical skills. While box trainers provide tactile feedback for practicing techniques like suturing and knot-tying, they lack visual realism. Virtual Reality (VR) simulators provide a visually realistic environment but often lack tactile feedback. This work integrates the strengths of both box trainers and VR simulators in a simulation framework. The proposed simulation framework, HySim, combines virtual and physical tissues into a unified operative view, thereby improving visual and tactile realism. HySim was assessed on: (a) simulation of surgical scenarios, (b) feedback from 10 participants specialized in robotic urology surgery on visual and tactile realism, and usefulness, and (c) the alignment of virtual and physical tissues during scope movements. HySim was successfully deployed for both laparoscopic (bowel anastomosis) and robotic (urethral dissection) scenarios. Compared to VR simulator, surgeons rated HySim higher for instrument motion and handling (<i>p</i> = 0.042), tool-tissue interaction (<i>p</i> = 0.022), tissue movement and behavior (<i>p</i> = 0.004), and usefulness (<i>p</i> = 0.042). It was also rated higher compared to box trainer for the operative view (<i>p</i> = 0.042). However, all three simulation environments received similar scores for the likelihood of adoption. For a scope tilt/pan movement with speed less than 10 degrees per second, the physical and virtual tissues did not have noticeable misalignment. HySim can enhance the training environment by improving both visual realism and tactile feedback. Further user studies are required to assess HySim for simulating generic and patient-specific preoperative training scenarios.</p><h2 dir="ltr">Other Information</h2><p dir="ltr">Published in: Virtual Reality<br>License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s10055-025-01193-2" target="_blank">https://dx.doi.org/10.1007/s10055-025-01193-2</a></p>2025-07-16T09:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1007/s10055-025-01193-2https://figshare.com/articles/journal_contribution/HySim_towards_development_of_a_hybrid_simulation_framework_with_improved_visual_and_tactile_realism_for_minimally_invasive_surgeries/30971029CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/309710292025-07-16T09:00:00Z
spellingShingle HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries
Waseem Palliyali (22927804)
Engineering
Biomedical engineering
Information and computing sciences
Graphics, augmented reality and games
Simulators
Virtual reality
Tactile feedback
Surgical training
Surgical skills
status_str publishedVersion
title HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries
title_full HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries
title_fullStr HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries
title_full_unstemmed HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries
title_short HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries
title_sort HySim: towards development of a hybrid simulation framework with improved visual and tactile realism for minimally invasive surgeries
topic Engineering
Biomedical engineering
Information and computing sciences
Graphics, augmented reality and games
Simulators
Virtual reality
Tactile feedback
Surgical training
Surgical skills