×

Quaternion-based visual servo control in the presence of camera calibration error. (English) Zbl 1185.93084

Summary: Visual servo control systems use information from images along with knowledge of the optic parameters (i.e. camera calibration) to position the camera relative to some viewed object. If there are inaccuracies in the camera calibration, then performance degradation and potentially unpredictable response from the visual servo control system may occur. Motivated by the desire to incorporate robustness to the camera calibration, different control methods have been developed. Previous adaptive/robust controllers (especially for six degree-of-freedom camera motion) rely heavily on properties of the rotation parameterization to formulate state estimates and a measurable closed-loop error system. All of these results are based on the singular axis-angle parameterization. Motivated by the desire to express the rotation by a non-singular parameterization, efforts in this paper address the question: Can state estimates and a measurable closed-loop error system be crafted in terms of the quaternion parameterization when the camera calibration parameters are unknown? To answer this question, a contribution of this paper is the development of a robust controller and closed-loop error system based on a new quaternion-based estimate of the rotation error. A Lyapunov-based analysis is provided which indicates that the controller yields asymptotic regulation of the rotation and translation error signals given a sufficient approximation of the camera calibration parameters. Simulation results are provided that illustrate the performance of the controller for a range of calibration uncertainty.

MSC:

93C83 Control/observation systems involving computers (process control, etc.)
93B35 Sensitivity (robustness)
93B52 Feedback control
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Astolfi, Two solutions to the adaptive visual servoing problem, IEEE Transactions on Robotics and Automation 18 (3) pp 387– (2002)
[2] Bishop, Camera modeling for visual servo control applications, Mathematical and Computer Modeling 24 (5/6) pp 79– (1996)
[3] Dixon, Adaptive tracking control of a wheeled mobile robot via an uncalibrated camera system, IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics 31 (3) pp 341– (2001)
[4] Hsu L, Aquino PLS. Adaptive visual tracking with uncertain manipulator dynamics and uncalibrated camera. Proceedings of the IEEE Conference on Decision and Control, Phoenix, AZ, U.S.A., 1999; 1248-1253.
[5] Kelly, Robust asymptotically stable visual servoing of planar robots, IEEE Transactions on Robotics and Automation 12 (5) pp 759– (1996)
[6] Kelly, Fixed-eye direct visual feedback control of planar robots, Journal of Systems Engineering 4 (5) pp 239– (1995)
[7] Zergeroglu, Vision-based nonlinear tracking controllers in the presence of parametric uncertainty, IEEE/ASME Transactions on Mechatronics 6 (3) pp 322– (2001)
[8] Zergeroglu E, Dawson DM, de Queiroz M, Nagarkatti S. Robust visual-servo control of planar robot manipulators in the presence of uncertainty. Proceedings of the IEEE Conference on Decision and Control, Phoenix, AZ, U.S.A., 1999; 4137-4142.
[9] Liu, Uncalibrated visual servoing of robots using a depth-independent interaction matrix, IEEE Transactions on Robotics 22 (4) pp 804– (2006)
[10] Liu Y, Wang H, Lam K. Dynamic visual servoing of robots in uncalibrated environments. Proceedings of the IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005; 3142-3148.
[11] Liu Y, Wang H, Zhou D. Dynamic tracking of manipulators using visual feedback from an uncalibrated fixed camera. Proceedings of the IEEE International Conference on Robotics and Automation, Orlando, FL, U.S.A., 2006; 4124-4129.
[12] Piepmeier JA, McMurray GV, Lipkin H. A dynamic jacobian estimation method for uncalibrated visual servoing. Proceedings of the IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Atlanta, GA, U.S.A., 1999; 944-949.
[13] Piepmeier, Uncalibrated dynamic visual servoing, IEEE Transactions on Robotics and Automation 20 (1) pp 143– (2004)
[14] Piepmeier JA, McMurray GV, Lipkin H. A dynamic quasi-Newton method for uncalibrated visual servoing. Proceedings of the IEEE International Conference on Robotics and Automation, Detroit, MI, U.S.A., 1999; 1595-1600.
[15] Piepmeier JA, Gumpert BA, Lipkin H. Uncalibrated eye-in-hand visual servoing. Proceedings of the IEEE International Conference on Robotics and Automation, Washington, DC, U.S.A., 2002; 568-573.
[16] Piepmeier JA. Experimental results for uncalibrated eye-in-hand visual servoing. Southeastern Symposium on System Theory, Morgantown, WV, U.S.A., 2003; 335-339.
[17] Shahamiri M, Jagersand M. Uncalibrated visual servoing using a biased Newton method for on-line singularity detection and avoidance. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, Alberta, Canada, 2005; 3953-3958.
[18] Malis, Visual servoing invariant to changes in camera-intrinsic parameters, IEEE Transactions on Robotics and Automation 20 (1) pp 72– (2004)
[19] Malis, 2-1/2-D visual servoing, IEEE Transactions on Robotics and Automation 15 (2) pp 238– (1999)
[20] Fang, An exponential class of model-free visual servoing controllers in the presence of uncertain camera calibration, International Journal of Robotics and Automation 21 (4) pp 247– (2006)
[21] Malis, Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods, IEEE Transactions on Robotics and Automation 18 (2) pp 176– (2002) · Zbl 1039.68682
[22] Hu G, Dixon WE, Gupta S, Fitz-coy N. A quaternion formulation for homography-based visual servo control. Proceedings of the IEEE International Conference on Robotics and Automation, Orlando, FL, U.S.A., 2006; 2391-2396.
[23] Malis, 2 1/2 D visual servoing with respect to unknown objects through a new estimation scheme of camera displacement, International Journal of Computer Vision 37 (1) pp 79– (2000) · Zbl 0996.68237
[24] Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint (1993)
[25] Shi J, Tomasi C. Good features to track. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, U.S.A., 1994; 593-600.
[26] Tomasi C, Kanade T. Detection and tracking of point features. Technical Report, Carnegie Mellon University, 1991.
[27] Hartley, Multiple View Geometry in Computer Vision (2000) · Zbl 0956.68149
[28] Fang Y, Behal A, Dixon WE, Dawson DM. Adaptive 2.5d visual servoing of kinematically redundant robot manipulators. Proceedings of the IEEE Conference on Decision and Control, Las Vegas, NV, U.S.A., 2002; 2860-2865.
[29] Faugeras, Motion and structure from motion in a piecewise planar environment, International Journal of Pattern Recognition and Artificial Intelligence 2 (3) pp 485– (1988)
[30] Zhang Z, Hanson AR. Scaled Euclidean 3d reconstruction based on externally uncalibrated cameras. IEEE Symposium on Computer Vision, Coral Gables, FL, U.S.A., 1995; 37-42.
[31] Shuster, A survey of attitude representations, The Journal of the Astronautical Sciences 41 (4) pp 439– (1993)
[32] Hu G. Visual servo tracking control via a Lyapunov-based approach. Dissertation, University of Florida, 2007.
[33] Krstic, Nonlinear and Adaptive Control Design (1995)
[34] Corke, Dynamic effects in visual closed-loop systems, IEEE Transactions on Robotics and Automation 12 (5) pp 671– (1996)
[35] Conticelli F, Allotta B. Two-level visual control of dynamic look-and-move systems. Proceedings of the IEEE International Conference on Robotics and Automation, San Francisco, CA, U.S.A., 2000; 3784-3789. · Zbl 0948.93039
[36] Behala, Adaptive position and orientation regulation for the camera-in-hand problem, Journal of Robotic Systems 22 (9) pp 457– (2005)
[37] Kelly R, Reyes F, Moreno J, Hutchinson S. A two-loops direct visual control of direct-drive planar robots with moving target. Proceedings of the IEEE International Conference on Robotics and Automation 1999; 599-604.
[38] Kelly, Stable visual servoing camera-in-hand robotic systems, IEEE/ASME Transactions on Mechatronics 5 (1) pp 39– (2000)
[39] Dixon, Nonlinear Control of Engineering Systems: A Lyapunov-based Approach (2003) · Zbl 1060.93003 · doi:10.1007/978-1-4612-0031-4
[40] Slotine, Applied Nonlinear Control (1991)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.