×

Manipulation of articulated objects using dual-arm robots via answer set programming. (English) Zbl 1522.68595

Summary: The manipulation of articulated objects is of primary importance in Robotics and can be considered as one of the most complex manipulation tasks. Traditionally, this problem has been tackled by developing ad hoc approaches, which lack flexibility and portability. In this paper, we present a framework based on answer set programming (ASP) for the automated manipulation of articulated objects in a robot control architecture. In particular, ASP is employed for representing the configuration of the articulated object for checking the consistency of such representation in the knowledge base and for generating the sequence of manipulation actions. The framework is exemplified and validated on the Baxter dual-arm manipulator in the first, simple scenario. Then, we extend such scenario to improve the overall setup accuracy and to introduce a few constraints in robot actions execution to enforce their feasibility. The extended scenario entails a high number of possible actions that can be fruitfully combined together. Therefore, we exploit macro actions from automated planning in order to provide more effective plans. We validate the overall framework in the extended scenario, thereby confirming the applicability of ASP also in more realistic Robotics settings and showing the usefulness of macro actions for the robot-based manipulation of articulated objects.

MSC:

68T40 Artificial intelligence for robotics
68N17 Logic programming
68T20 Problem solving in the context of artificial intelligence (heuristics, search strategies, etc.)
PDFBibTeX XMLCite
Full Text: DOI arXiv

References:

[1] Alviano, M., Amendola, G., Dodaro, C., Leone, N., Maratea, M. and Ricca, F.2019. Evaluation of disjunctive programs in WASP. In LPNMR, Balduccini, M., Lierler, Y., and Woltran, S., Eds. Lecture Notes in Computer Science, vol. 11481. Springer, 241-255. · Zbl 1522.68096
[2] Andres, B., Rajaratnam, D., Sabuncu, O. and Schaub, T.2015. Integrating ASP into ROS for reasoning in robots. In Proceedings of the 13th International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR 2015), Calimeri, F., Ianni, G. and Truszczynski, M., Eds. Lecture Notes in Computer Science, vol. 9345. Springer, 69-82. · Zbl 1467.68187
[3] Balduccini, M. and Lierler, Y.2017. Constraint answer set solver EZCSP and why integration schemas matter. Theory and Practice of Logic Programming17, 4, 462-515. · Zbl 1379.68038
[4] Banbara, M., Kaufmann, B., Ostrowski, M. and Schaub, T.2017. Clingcon: The next generation. Theory and Practice of Logic Programming17, 4, 408-461. · Zbl 1379.68040
[5] Baral, C.2003. Knowledge Representation, Reasoning and Declarative Problem Solving. Cambridge University Press. · Zbl 1056.68139
[6] Bertolucci, R., Capitanelli, A., Dodaro, C., Leone, N., Maratea, M., Mastrogiovanni, F. and Vallati, M.2019. An ASP-based framework for the manipulation of articulated objects using dual-arm robots. In Proceedings of the 15th International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR 2019), Balduccini, M., Lierler, Y., and Woltran, S., Eds. Lecture Notes in Computer Science, vol. 11481. Springer, 32-44. · Zbl 1522.68594
[7] Bodenhagen, L., Fugl, A. R., Jordt, A., Willatzen, M., Andersen, K. A., Olsen, M. M., Koch, R., Petersen, H. G. and Krüger, N.2014. An adaptable robot vision system performing manipulation actions with flexible objects. IEEE Transactions on Automation Science and Engineering11, 3, 749-765.
[8] Botea, A., Enzenberger, M., Müller, M. and Schaeffer, J.2005. Macro-FF: improving AI planning with automatically learned macro-operators. Journal of Artificial Intelligence Research24, 581-621. · Zbl 1080.68657
[9] Brewka, G., Eiter, T. and Truszczynski, M.2011. Answer set programming at a glance. Communications of the ACM54, 12, 92-103.
[10] Cabalar, P., Kaminski, R., Morkisch, P. and Schaub, T.2019. telingo = ASP + time. In Proceedings of the 15th International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR 2019), Balduccini, M., Lierler, Y., and Woltran, S., Eds. Lecture Notes in Computer Science, vol. 11481. Springer, 256-269. · Zbl 1522.68105
[11] Calimeri, F., Faber, W., Gebser, M., Ianni, G., Kaminski, R., Krennwallner, T., Leone, N., Maratea, M., Ricca, F. and Schaub, T.2020. ASP-core-2 input language format. Theory and Practice of Logic Programming 20, 2, 294-309. · Zbl 1472.68180
[12] Capitanelli, A., Maratea, M., Mastrogiovanni, F. and Vallati, M.2017. Automated planning techniques for robot manipulation tasks involving articulated objects. In Proceedings of the 16th International Conference of the Italian Association for Artificial Intelligence (AI*IA 2017), Esposito, F., Basili, R., Ferilli, S., and Lisi, F. A., Eds. Lecture Notes in Computer Science, vol. 10640. Springer, 483-497.
[13] Capitanelli, A., Maratea, M., Mastrogiovanni, F. and Vallati, M.2018. On the manipulation of articulated objects in human-robot cooperation scenarios. Robotics and Autonomous Systems109, 139-155.
[14] Chrpa, L.2010. Generation of macro-operators via investigation of action dependencies in plans. Knowledge Engineering Review25, 3, 281-297.
[15] Chrpa, L. and Vallati, M.2019. Improving domain-independent planning via critical section macro-operators. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI 2019). AAAI Press, 7546-7553.
[16] Chrpa, L., Vallati, M. and Mccluskey, T. L.2015. On the online generation of effective macro-operators. In Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI 2015). AAAI Press, 1544-1550.
[17] Coles, A., Fox, M. and Smith, A.2007. Online identification of useful macro-actions for planning. In Proceedings of the 17th International Conference on Automated Planning and Scheduling (ICAPS 2007), Boddy, M. S., Fox, M., and Thiébaux, S., Eds. AAAI, 97-104.
[18] Darvish, K., Wanderlingh, F., Bruno, B., Simetti, E., Mastrogiovanni, F. and Casalino, G.2018. Flexible human-robot cooperation models for assisted show-floor tasks. Mechatronics51, 97-114.
[19] Di Rosa, E., Giunchiglia, E. and Maratea, M.2008. A new approach for solving satisfiability problems with qualitative preferences. In ECAI, Ghallab, M., Spyropoulos, C. D., Fakotakis, N., and Avouris, N. M., Eds. Frontiers in Artificial Intelligence and Applications, vol. 178. IOS Press, 510-514.
[20] Di Rosa, E., Giunchiglia, E. and Maratea, M.2010. Solving satisfiability problems with preferences. Constraints15, 4, 485-515. · Zbl 1208.68199
[21] Dimopoulos, Y., Gebser, M., Lühne, P., Romero, J. and Schaub, T.2017. plasp 3: Towards effective ASP planning. In Proceedings of the 14th International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR 2017), Balduccini, M. and Janhunen, T., Eds. Lecture Notes in Computer Science, vol. 10377. Springer, 286-300. · Zbl 1491.68190
[22] Erdem, E. and Patoglu, V.2018. Applications of ASP in robotics. Künstliche Intelligenz32, 2-3, 143-149.
[23] Erdem, E., Patoglu, V. and Saribatur, Z. G.2015. Integrating hybrid diagnostic reasoning in plan execution monitoring for cognitive factories with multiple robots. In Proceedings of the IEEE International Conference on Robotics and Automation, (ICRA 2015). IEEE, 2007-2013.
[24] Erdem, E., Patoglu, V., Saribatur, Z. G., Schüller, P., and Uras, T.2013. Finding optimal plans for multiple teams of robots through a mediator: A logic-based approach. Theory and Practice of Logic Programming13, 4-5, 831-846. · Zbl 1286.68406
[25] Gebser, M., Jost, H., Kaminski, R., Obermeier, P., Sabuncu, O., Schaub, T. and Schneider, M.2013. Ricochet robots: A transverse ASP benchmark. In Proceedings of the 12th International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR 2013), Cabalar, P. and Son, T. C., Eds. Lecture Notes in Computer Science, vol. 8148. Springer, 348-360.
[26] Gebser, M., Kaminski, R., Kaufmann, B., Ostrowski, M., Schaub, T. and Wanko, P.2016. Theory solving made easy with clingo 5. In Proceedings of the 32rd Technical Communications of the International Conference on Logic Programming (ICLP 2016 TCs), Carro, M., King, A., Saeedloei, N., and Vos, M. D., Eds. OASICS, vol. 52. Schloss Dagstuhl, 2:1-2:15.
[27] Gebser, M., Maratea, M. and Ricca, F.2017. The design of the seventh answer set programming competition. In LPNMR, Balduccini, M. and Janhunen, T., Eds. Lecture Notes in Computer Science, vol. 10377. Springer, 3-9. · Zbl 1418.68029
[28] Gebser, M., Maratea, M. and Ricca, F.2020. The seventh answer set programming competition: Design and results. Theory and Practice of Logic Programming20, 2, 176-204. · Zbl 1472.68026
[29] Gelfond, M. and Lifschitz, V.1988. The stable model semantics for logic programming. In Proceedings of 5th the International Conference on Logic Programming (ICLP 1988). MIT Press, 1070-1080.
[30] Gelfond, M. and Lifschitz, V.1991. Classical negation in logic programs and disjunctive databases. New Generation Computing9, 365-385. · Zbl 0735.68012
[31] Gerevini, A. E., Saetti, A. and Vallati, M.2015. Exploiting macro-actions and predicting plan length in planning as satisfiability. AI Communications28, 2, 323-344. · Zbl 1373.68375
[32] Giunchiglia, E. and Maratea, M.2006. Solving optimization problems with DLL. In Proceedings of the 17th European Conference on Artificial Intelligence (ECAI 2006). Frontiers in Artificial Intelligence and Applications, vol. 141. IOS Press, 377-381.
[33] Harnad, S.1990. The symbol grounding problem. Physica D42, 335-346.
[34] Heyer, C.2010. Human-Robot interaction and future industrial robotics applications. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 4749-4754.
[35] Hoffmann, J. and Nebel, B.2001. The FF planning system: Fast plan generation through heuristic search. Journal of Artificial Intelligence Research14, 253-302. · Zbl 0970.68044
[36] Howey, R., Long, D. and Fox, M.2004. VAL: automatic plan validation, continuous effects and mixed initiative planning using PDDL. In Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2004). IEEE Computer Society, 294-301.
[37] Kautz, H. A. and Selman, B.1992. Planning as satisfiability. In Proceedings of the 10th European Conference on Artificial Intelligence (ECAI 1992), Neumann, B., Ed. John Wiley and Sons, 359-363.
[38] Korf, R.1985. Macro-Operators: A weak method for learning. Artificial Intelligence26, 1, 35-77. · Zbl 0562.68071
[39] Krüger, J., Lien, T. K. and Verl, A.2009. Cooperation of human and machines in assembly lines. CIRP Annals58, 2, 628-646.
[40] Lifschitz, V.2002. Answer set programming and plan generation. Artificial Intelligence138, 1-2, 39-54. · Zbl 0995.68020
[41] Mccluskey, T. L. and Porteous, J. M.1997. Engineering and compiling planning domain models to promote validity and efficiency. Artificial Intelligence95, 1, 1-65. · Zbl 0894.68137
[42] Nair, A., Chen, D., Agrawal, P., Isola, P., Abbeel, P., Malik, J. and Levine, S.2017. Combining self-supervised learning and imitation for vision-based rope manipulation. In Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA 2017). IEEE, 2146-2153.
[43] Newton, M. A. H., Levine, J., Fox, M. and Long, D.2007. Learning macro-actions for arbitrary planners and domains. In Proceedings of the 17th International Conference on Automated Planning and Scheduling (ICAPS 2007), Boddy, M. S., Fox, M., and Thiébaux, S., Eds. AAAI, 256-263.
[44] Niemelä, I.1999. Logic programs with stable model semantics as a constraint programming paradigm. Annals of Mathematics and Artificial Intelligence25, 3-4, 241-273. · Zbl 0940.68018
[45] Schäpers, B., Niemueller, T., Lakemeyer, G., Gebser, M. and Schaub, T.2018. ASP-Based Time-Bounded Planning for Logistics Robots. In Proceedings of the 28th International Conference on Automated Planning and Scheduling (ICAPS 2018). AAAI Press, 509-517.
[46] Schulman, J., Ho, J., Lee, C. and Abbeel, P.2013. Learning from demonstrations through the use of non-rigid registration. In Proceedings of the 16th International Symposium on Robotics Research (ISRR 2013), Inaba, M. and Corke, P., Eds. Springer Tracts in Advanced Robotics, vol. 114. Springer, 339-354.
[47] Shen, D. and Lierler, Y.2018. Smt-Based constraint answer set solver EZSMT+ for non-tight programs. In Proceedings of the 16th International Conference on Principles of Knowledge Representation and Reasoning (KR 2018), Thielscher, M., Toni, F., and Wolter, F., Eds. AAAI Press, 67-71.
[48] Thomas, A., Amatya, S., Mastrogiovanni, F. and Baglietto, M.2018. Towards perception-aware task-motion planning. In Proceedings of the AAAI 2018 Fall Symposium on Reasoning and Learning in Real-World Systems for Long-Term Autonomy. Arlington, VA, USA.
[49] Thomas, A., Mastrogiovanni, F. and Baglietto, M.2019. Task-Motion planning for navigation in belief space. In Proceedings of the 2019 International Symposium on Robotics Research (ISER). Hanoi, Vietnam.
[50] Wakamatsu, H., Arai, E. and Hirai, S.2006. Knotting/unknotting manipulation of deformable linear objects. International Journal of Robotic Research25, 4, 371-395.
[51] Yamakawa, Y., Namiki, A. and Ishikawa, M.2013. Dynamic high-speed knotting of a rope by a manipulator. International Journal of Advanced Robotic Systems10, 1-12.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.