Contact-based state estimation and policy learning for robotic manipulation tasks
Author
Li, ShuaiOther Contributors
Trinkle, Jeffrey C.; Lyu, Siwei; Cutler, Barbara M.; Wen, John T.; Patterson, Stacy;Date Issued
2017-08Subject
Computer scienceDegree
PhD;Terms of Use
This electronic version is a licensed copy owned by Rensselaer Polytechnic Institute, Troy, NY. Copyright of original work retained by author.; Attribution-NonCommercial-NoDerivs 3.0 United StatesMetadata
Show full item recordAbstract
In this thesis, we focus on improving the perception capability for robots and addressing the problem of combining the perception capability with action planning and execution for robotic manipulation tasks. Our proposed approach combines Bayesian filtering methods with accurate models of multi-body dynamics for state estimation in the robotic manipulation tasks. In order to understand the design trade-offs of particle filter applications for the state estimation problems, we evalu- ate different particle filter modeling options in both simulation and physical exper- iments. We then propose a contact-based RBPF that samples the discrete contact states and updates the continuous state distribution through Kalman filters. Re- sults show that the contact-based RBPF is more effective and more efficient than the state of the art filters that sample the continuous state space. Finally, we apply reinforcement learning algorithms to learn policies for robotic manipulation tasks with a state space discretized using contact states. This discretized space learning is proven to be more effective than learning with continuous state space. We further propose to combine the learned policies with the contact-based RBPF for online action selection during robotic manipulation tasks.; The robotic manipulation problem is very important in robotic research and appli- cations. In a typical robotic manipulation task, the robot needs to interact with certain objects to accomplish a goal, such as picking up a cup from a table. Without manipulation capabilities, robots will not be able to help humans with their daily tasks such as using tools to fix a broken car. Although the hardware of robots has been significantly improved, the ability to perceive the current state of a robotic manipulation task is still essential for a robot to fully utilize its hardware. However, less effort has been made to address the perception problem for robotic manipulation tasks.;Description
August 2017; School of ScienceDepartment
Dept. of Computer Science;Publisher
Rensselaer Polytechnic Institute, Troy, NYRelationships
Rensselaer Theses and Dissertations Online Collection;Access
CC BY-NC-ND. Users may download and share copies with attribution in accordance with a Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 License. No commercial use or derivatives are permitted without the explicit approval of the author.;Collections
Except where otherwise noted, this item's license is described as CC BY-NC-ND. Users may download and share copies with attribution in accordance with a Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 License. No commercial use or derivatives are permitted without the explicit approval of the author.