A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries
<h3>Background and Objective</h3><p dir="ltr">During open surgeries, telementoring serves as a valuable tool for transferring surgical knowledge from a specialist surgeon (mentor) to an operating surgeon (mentee). Depicting the intended movements of the surgical instrumen...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , , , , , |
| منشور في: |
2024
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513555946012672 |
|---|---|
| author | Malek Anabtawi (19757100) |
| author2 | Dehlela Shabir (14150565) Jhasketan Padhan (14150571) Abdulla Al-Ansari (14150583) Omar M. Aboumarzouk (14779240) Zhigang Deng (2638495) Nikhil V. Navkar (14158857) |
| author2_role | author author author author author author |
| author_facet | Malek Anabtawi (19757100) Dehlela Shabir (14150565) Jhasketan Padhan (14150571) Abdulla Al-Ansari (14150583) Omar M. Aboumarzouk (14779240) Zhigang Deng (2638495) Nikhil V. Navkar (14158857) |
| author_role | author |
| dc.creator.none.fl_str_mv | Malek Anabtawi (19757100) Dehlela Shabir (14150565) Jhasketan Padhan (14150571) Abdulla Al-Ansari (14150583) Omar M. Aboumarzouk (14779240) Zhigang Deng (2638495) Nikhil V. Navkar (14158857) |
| dc.date.none.fl_str_mv | 2024-11-01T00:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1016/j.cmpb.2024.108396 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/A_holographic_telementoring_system_depicting_surgical_instrument_movements_for_real-time_guidance_in_open_surgeries/27130122 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Biomedical and clinical sciences Clinical sciences Telemedicine Surgical telementoring Open surgery Mixed reality Augmented reality |
| dc.title.none.fl_str_mv | A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <h3>Background and Objective</h3><p dir="ltr">During open surgeries, telementoring serves as a valuable tool for transferring surgical knowledge from a specialist surgeon (mentor) to an operating surgeon (mentee). Depicting the intended movements of the surgical instruments over the operative field improves the understanding of the required tool-tissue interaction. The objective of this work is to develop a telementoring system tailored for open surgeries, enabling the mentor to remotely demonstrate the necessary motions of surgical instruments to the mentee.</p><h3>Methods</h3><p dir="ltr">A remote telementoring system for open surgery was implemented. The system generates visual cues in the form of virtual surgical instrument motion augmented onto the live view of the operative field. These cues can be rendered on both conventional screens in the operating room and as dynamic holograms on a head mounted display device worn by the mentee. The technical performance of the system was evaluated, where the operating room and remote location were geographically separated and connected via the Internet. Additionally, user studies were conducted to assess the effectiveness of the system as a mentoring tool.</p><h3>Results</h3><p dir="ltr">The system took 307 ± 12 ms to transmit an operative field view of 1920 × 1080 resolution, along with depth information spanning 36 cm, from the operating room to the remote location. Conversely, it took 145 ± 14 ms to receive the motion of virtual surgical instruments from the remote location back to the operating room. Furthermore, the user studies demonstrated: (a) mentor's capability to annotate the operative field with an accuracy of 3.92 ± 2.1 mm, (b) mentee's ability to comprehend and replicate the motion of surgical instruments in real-time with an average deviation of 12.8 ± 3 mm, (c) efficacy of the rendered dynamic holograms in conveying information intended for surgical instrument motion.</p><h3>Conclusions</h3><p dir="ltr">The study demonstrates the feasibility of transmitting information over the Internet from the mentor to the mentee in the form of virtual surgical instruments’ motion and projecting it as holograms onto the live view of the operative field. This holds potential to enhance real-time collaborative capabilities between the mentor and the mentee during an open surgery.</p><h2>Other Information</h2><p dir="ltr">Published in: Computer Methods and Programs in Biomedicine<br>License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.cmpb.2024.108396" target="_blank">https://dx.doi.org/10.1016/j.cmpb.2024.108396</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_365345fbdfcd0222cdca36a5847f8597 |
| identifier_str_mv | 10.1016/j.cmpb.2024.108396 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/27130122 |
| publishDate | 2024 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeriesMalek Anabtawi (19757100)Dehlela Shabir (14150565)Jhasketan Padhan (14150571)Abdulla Al-Ansari (14150583)Omar M. Aboumarzouk (14779240)Zhigang Deng (2638495)Nikhil V. Navkar (14158857)Biomedical and clinical sciencesClinical sciencesTelemedicineSurgical telementoringOpen surgeryMixed realityAugmented reality<h3>Background and Objective</h3><p dir="ltr">During open surgeries, telementoring serves as a valuable tool for transferring surgical knowledge from a specialist surgeon (mentor) to an operating surgeon (mentee). Depicting the intended movements of the surgical instruments over the operative field improves the understanding of the required tool-tissue interaction. The objective of this work is to develop a telementoring system tailored for open surgeries, enabling the mentor to remotely demonstrate the necessary motions of surgical instruments to the mentee.</p><h3>Methods</h3><p dir="ltr">A remote telementoring system for open surgery was implemented. The system generates visual cues in the form of virtual surgical instrument motion augmented onto the live view of the operative field. These cues can be rendered on both conventional screens in the operating room and as dynamic holograms on a head mounted display device worn by the mentee. The technical performance of the system was evaluated, where the operating room and remote location were geographically separated and connected via the Internet. Additionally, user studies were conducted to assess the effectiveness of the system as a mentoring tool.</p><h3>Results</h3><p dir="ltr">The system took 307 ± 12 ms to transmit an operative field view of 1920 × 1080 resolution, along with depth information spanning 36 cm, from the operating room to the remote location. Conversely, it took 145 ± 14 ms to receive the motion of virtual surgical instruments from the remote location back to the operating room. Furthermore, the user studies demonstrated: (a) mentor's capability to annotate the operative field with an accuracy of 3.92 ± 2.1 mm, (b) mentee's ability to comprehend and replicate the motion of surgical instruments in real-time with an average deviation of 12.8 ± 3 mm, (c) efficacy of the rendered dynamic holograms in conveying information intended for surgical instrument motion.</p><h3>Conclusions</h3><p dir="ltr">The study demonstrates the feasibility of transmitting information over the Internet from the mentor to the mentee in the form of virtual surgical instruments’ motion and projecting it as holograms onto the live view of the operative field. This holds potential to enhance real-time collaborative capabilities between the mentor and the mentee during an open surgery.</p><h2>Other Information</h2><p dir="ltr">Published in: Computer Methods and Programs in Biomedicine<br>License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.cmpb.2024.108396" target="_blank">https://dx.doi.org/10.1016/j.cmpb.2024.108396</a></p>2024-11-01T00:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1016/j.cmpb.2024.108396https://figshare.com/articles/journal_contribution/A_holographic_telementoring_system_depicting_surgical_instrument_movements_for_real-time_guidance_in_open_surgeries/27130122CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/271301222024-11-01T00:00:00Z |
| spellingShingle | A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries Malek Anabtawi (19757100) Biomedical and clinical sciences Clinical sciences Telemedicine Surgical telementoring Open surgery Mixed reality Augmented reality |
| status_str | publishedVersion |
| title | A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries |
| title_full | A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries |
| title_fullStr | A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries |
| title_full_unstemmed | A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries |
| title_short | A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries |
| title_sort | A holographic telementoring system depicting surgical instrument movements for real-time guidance in open surgeries |
| topic | Biomedical and clinical sciences Clinical sciences Telemedicine Surgical telementoring Open surgery Mixed reality Augmented reality |