Application of visual tracking for robot-assisted laparoscopic surgery. (English) Zbl 1028.68208

Summary: With the increasing popularity of laparoscopic surgery, the demand for better modes of laparoscopic surgery also increases. The current laparoscopic surgery mode requires an assistant to hold and manipulate the endoscope through commands from the surgeon. However, during lengthy surgery procedures, accurate and on-time adjustment of the camera cannot be guaranteed due to the fatigue and hand trembling of the camera assistant. This article proposes a practical visual tracking method to achieve automated instrument localization and endoscope maneuvering in robot-assisted laparoscopic surgery. Solutions concerning this approach, such as, endoscope calibration, marker design, distortion correction, and endoscope manipulator design are described in detail. Experimental results are presented to show the feasibility of the proposed method.


68U99 Computing methodologies and applications
68U10 Computing methodologies for image processing
Full Text: DOI


[1] Mettler, Human Reproduction 13 pp 2748– (1998)
[2] A simple fast edge-based visual tracker, Technical Report 97/20, pp. 1-14.
[3] http://citeseer.nj.nec.com/59426.html
[4] Real-time self-calibrating stereo person tracking using 3-D shape estimation from blob features, Proc Int Conf on Pattern Recognition, Aug. 1996, pp. 627-632.
[5] Reddi, IEEE Trans Pattern Anal Mach Intell 17 pp 765– (1995) · Zbl 05112118
[6] Bayesian estimation of 3-D human motion from an image sequence, Technique Report, July 1998.
[7] http://www.merl.com/reports/TR98-06/
[8] Choreographed scope maneuvering in robotically-assisted laparoscopy with active vision guidance, IEEE Workshop on Application of Computer Vision, Saratoga, FL, Dec. 1996, pp. 187-192.
[9] Wei, IEEE in Engineering and Biology pp 40– (jan.)
[10] Chen, J Intell Robot Syst 12 pp 155– (1995) · Zbl 05477069
[11] Tsai, IEEE J Robot Automat RA-3 pp 323– (1987)
[12] Computer graphics: Principles and practice, Addison-Wesley, 1995.
[13] Asari, Medical Biol Eng Comput 37 pp 8– (1999)
[14] Smith, IEEE Trans Medical Imaging 11 pp 117– (1992)
[15] Elements of photogrammetry, Mcgraw-Hill Inc., 1983.
[16] KARL STORZ Endoscopy Canada Ltd., http://www.karlstorz.com/.
[17] Ascension Technology Corporation, http://www.ascension-tech.com.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.