Show simple item record

dc.contributor.authorRouillard, T.
dc.contributor.authorHoward, Ian
dc.contributor.authorCui, Lei
dc.identifier.citationRouillard, T. and Howard, I. and Cui, L. 2019. Autonomous Two-Stage Object Retrieval Using Supervised and Reinforcement Learning, in 16th IEEE International Conference on Mechatronics and Automation (ICMA), Aug 4-7 2019. Tianjin, Peoples Republic of China: IEEE.

Humans have been sending tele-operated robots into hazardous areas in an attempt to preserve life for many years. The task they are presented with is often challenging and requires cognitive abilities, that is, the ability to process information in order to apply it to a different situation. In this work, we proposed an autonomous approach employing both supervised and reinforcement learning for hidden-object retrieval in two stages. Stage 1 used both learning methods to find a hidden object whereas stage 2 only used reinforcement learning to isolate it. The method is targeted towards field robots with reduced computational power hence we explored the viability of tabular reinforcement learning algorithms. We used a convolutional neural network (CNN) to interpret the state of the scene from images and a reinforcement learning agent for each stage of the task. The robot was presented with a workspace containing piles of rubble under one of which an object was buried. The robot must learn to find and isolate it. We compared the performance of four reinforcement learning algorithms over 500 episodes and found that Sarsa (λ) and RMax were most appropriate for stage 1 and 2 respectively. The approach allowed a robot to learn to complete a search and retrieval task by interpreting images. This could lead to the deployment of such robots in disaster areas eliminating the need for tele-operated platforms.

dc.subjectScience & Technology
dc.subjectAutomation & Control Systems
dc.subjectEngineering, Electrical & Electronic
dc.subjectIntelligent robots
dc.subjectReinforcement learning
dc.subjectComputer vision
dc.subjectRobotic Manipulation
dc.titleAutonomous Two-Stage Object Retrieval Using Supervised and Reinforcement Learning
dc.typeConference Paper
dcterms.source.titleProceedings of 2019 IEEE International Conference on Mechatronics and Automation, ICMA 2019
dcterms.source.conference16th IEEE International Conference on Mechatronics and Automation (IEEE ICMA)
dcterms.source.conference-start-date4 Aug 2019
dcterms.source.conferencelocationTianjin, PEOPLES R CHINA
curtin.departmentSchool of Civil and Mechanical Engineering
curtin.accessStatusFulltext not available
curtin.facultyFaculty of Science and Engineering
curtin.contributor.orcidHoward, Ian [0000-0003-3999-9184]
curtin.contributor.orcidCui, Lei [0000-0003-2283-5079]
dcterms.source.conference-end-date7 Aug 2019
curtin.contributor.scopusauthoridHoward, Ian [12808325800]
curtin.contributor.scopusauthoridCui, Lei [35168967600]

Files in this item


This item appears in the following Collection(s)

Show simple item record