zbMATH — the first resource for mathematics

Monocular camera based trajectory tracking of 3-DOF helicopter. (English) Zbl 1302.93155
Summary: The vision based flight control problems of unmanned Micro Aerial Vehicles (MAVs) have attracted much attention in recent years. This paper presents a new solution to the trajectory tracking problem of a 3-Degrees-Of-Freedom (3-DOF) helicopter by utilizing only an onboard monocular camera without any artificial marker. First, the Parallel Tracking And Mapping (PTAM) algorithm, which is a famous solution to the visual simultaneous localization and mapping (vSLAM) problem, is employed to estimate the attitude angles of the 3-DOF helicopter. Then the calibration puzzle of the mapping between the onboard camera and helicopter coordinate systems is turned into an optimization problem. A robust cost function is applied to get the accurate estimate of the mapping. Finally, for the purpose of alleviating the influences of nonlinearity and coupling between channels, the Feedback Linearization (FL) and the Linear Quadratic Regulation (LQR) techniques are employed to design the controller. Experimental results show that the proposed method can ensure that the helicopter hovers without drift and has good tracking performance.
93C85 Automated systems (robots, etc.) in control theory
68T45 Machine vision and scene understanding
94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
68T40 Artificial intelligence for robotics
93B18 Linearizations
49N10 Linear-quadratic optimal control problems
Full Text: DOI
[1] Brockers , R. S. Susca D. Zhu L. Matthies Fully self-contained vision-aided navigation and landing of a micro air vehicle independent from external sensor inputs Conference on Unmanned Systems Technology XIV Baltimore, MD 83870Q 2012
[2] Weiss, Mo- nocular-SLAM-Based Navigation for Autonomous Micro Helicopters in GPS-Denied Environments, J. Field Robot. 28 (6) pp 854– (2011)
[3] Ghadiok, On the design and development of attitude stabilization, vision-based navigation, and aerial gripping for a low-cost quadrotor, Auton. Robot. 33 (1-2) pp 41– (2012)
[4] Grabe , V. H. H. Bulthoff P. R. Giordano On-board Velocity Estimation and Closed-loop Control of a Quadrotor UAV based on Optical Flow IEEE International Conference on Robotics and Automation Saint Paul, MN 491 497 2012
[5] Eberli, Vision Based Position Control for MAVs Using One Single Circular Landmark, J. Intell. Robot. Syst. 61 (1-4) pp 495– (2011) · Zbl 06070420
[6] Herisse , B. F. X. Russotto T. Hamel R. Mahony Hovering flight and vertical landing control of a VTOL Unmanned Aerial Vehicle using Optical Flow IEEE/RSJ International Conference on Intelligent Robots and Systems Nice, France 801 806 2008
[7] Herisse, Landing a VTOL Unmanned Aerial Vehicle on a Moving Platform Using Optical Flow, IEEE Trans. Robot. 8 (1) pp 77– (2012)
[8] Marlow, Local Terrain Mapping for Obstacle Avoidance Using Monocular Vision, J. the Amer. Helicopter Soc. 56 (2) pp 22007– (2011)
[9] Herisse , B. S. Oustrieres T. Hamel R. Mahony F. X. Russotto A general optical flow based terrain-following strategy for a VTOL UAV using multiple views IEEE International Conference on Robotics and Automation Anchorage, AK 3341 3348 2010
[10] Shakernia, Landing an Unmanned Air Vehicle: Vision based Motion Estimation and Nonlinear Control, Asian J. Control 1 (3) pp 128– (1999)
[11] Li , W. T. Zhang K. Kuhnlenz A Vision-Guided Autonomous Quadrotor in an air-Ground Multi-Robot System IEEE International Conference on Robotics and Automation Shanghai, China 2980 2985 2011
[12] Guenard, A Practical Visual Servo Control for an Unmanned Aerial Vehicle, IEEE Trans. Robot. 24 (2) pp 331– (2008)
[13] Carrillo, Stabilization and Trajectory Tracking of a Quad-Rotor Using Vision, J. Intell. Robot. Syst. 61 (1-4) pp 103– (2011) · Zbl 06070399
[14] Lee , D. T. Ryan H. J. Kim Autonomous Landing of a VTOL UAV on a Moving Platform Using Image-based Visual Servoing IEEE International Conference on Robotics and Automation Saint Paul, MN 971 976 2012
[15] Meier , L. P. Tanskanen F. Fraundorfer M. Pollefeys PIXHAWK: A System for Autonomous Flight using Onboard Computer Vision IEEE International Conference on Robotics and Automation Shanghai, China 2992 2997 2011
[16] Yamada , T. T. Yairi S. H. Bener K. Machida A Study on SLAM for Indoor Blimp with Visual Markers ICROS-SICE International Joint Conference Fukuoka, Japan 647 652 2009
[17] Davison, MonoSLAM: Real-time single camera SLAM, IEEE Trans. Pattern Anal. Mach. Intell. 29 (6) pp 1052– (2007) · Zbl 05340861
[18] Klein , G. D. Murray Parallel tracking and mapping for small AR workspaces Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality Nara, Japan 225 234 2007
[19] Eade , E. T. Drummond Scalable Monocular SLAM IEEE Computer Society Conference on Computer Vision and Pattern Recognition New York, NY 469 476 2006
[20] Chiu, Vision-Only Automatic Flight Control for Small UAVs, IEEE Trans. Veh. Technol. 60 (6) pp 2425– (2011)
[21] Tanaka, Wireless Vision-Based Stabilization of Indoor Microhelicopter, IEEE/ASME Trans. Mechatron. 17 (3) pp 519– (2012)
[22] Kallapur, Robust Gyro-free Attitude Estimation for a Small Fixed-wing Unmanned Aerial Vehicle, Asian J. Control 14 (6) pp 1484– (2012) · Zbl 1303.93169
[23] Rosten , E. T. Drummond Machine learning for high-speed corner detection 9th European Conference on Computer Vision Graz, Austria 430 443 2006
[24] Strasdat, Visual SLAM: Why filter?, Image Vis. Comput. 30 (2) pp 65– (2012)
[25] Ma, An Invitation to 3-D Vision: From Images to Geometric Models (2006)
[26] Zhang, Determining the epipolar geometry and its uncertainty: a review, Int. J. Comput. Vis. 27 (2) pp 161– (1998) · Zbl 05470921
[27] Shan, Synchronised trajectory-tracking control of multiple 3-DOF experimental helicopter, IEE Proceedings-Control Theory and Applicat. 152 (6) pp 683– (2005)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.