Dynamic reconstruction of deformable soft-tissue with stereo scope in minimal invasive surgery

Jingwei Song, Jun Wang, Liang Zhao, Shoudong Huang, Gamini Dissanayake

Research output: Contribution to journalArticlepeer-review

Abstract / Description of output

In minimal invasive surgery, it is important to rebuild and visualize the latest deformed shape of soft-tissue surfaces to mitigate tissue damages. This letter proposes an innovative Simultaneous localization and mapping (SLAM) algorithm for deformable dense reconstruction of surfaces using a sequence of images from a stereoscope. We introduce a warping field based on the embedded deformation nodes with three-dimensional (3-D) shapes recovered from consecutive pairs of stereo images. The warping field is estimated by deforming the last updated model to the current live model. Our SLAM system can incrementally build a live model by progressively fusing new observations with vivid accurate texture; estimate the deformed shape of unobserved region with the principle as-rigid-as-possible; show the consecutive shape of models; and estimate the current relative pose between the soft-tissue and the scope. In-vivo experiments with publicly available datasets demonstrate that the 3-D models can be incrementally built for different soft-tissues with different deformations from sequences of stereo images obtained by laparoscopes. Results show the potential clinical application of our SLAM system for providing surgeon useful shape and texture information in minimal invasive surgery.
Original languageEnglish
Pages (from-to)155-166
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume3
Issue number1
DOIs
Publication statusPublished - 3 Aug 2017

Fingerprint

Dive into the research topics of 'Dynamic reconstruction of deformable soft-tissue with stereo scope in minimal invasive surgery'. Together they form a unique fingerprint.

Cite this