Dexterous Manipulation of Construction Tools using Anthropomorphic Robotic Hand

Automation in Construction 156 (2023): 105133.

1University of British Columbia

Dexterous robotic hand grasps a screwdriver, relocates it to a box, and releases palm for placement.

Abstract

Emerging studies are utilizing reinforcement learning (RL) and imitation learning (IL) to control large-scale robots in heavy construction tasks. There is limited attention given to the automation of delicate tasks typically performed manually. This paper proposes the control of an anthropomorphic robotic hand with a high degree of freedom for the manipulation of construction tools in a learning-based approach. For controlling the robotic hand, a simulation-based policy learning framework based on pretraining policies through IL is presented, subsequently fine-tuning them for construction tool manipulation using RL. In experimental trials, six policies are trained for the robotic hand to grasp six different construction tools. The results indicate that each of the learned policies enables the robotic hand to manipulate the corresponding tool with an almost 100% success rate, demonstrating resilience when confronted with tools of different scales. Additionally, the paper showcases the potential for scaling up the fundamental policy for downstream applications.


Overview

Interpolate start reference image.

Video

BibTeX

@article{huang2023105133,
  author    = {Huang, Lei and Cai, Weijia and Zhu, Zihan and Zou, Zhengbo},
  title     = {Dexterous manipulation of construction tools using anthropomorphic robotic hand},
  journal = {Automation in Construction},
  volume = {156},
  pages = {105133},
  year = {2023},
  issn = {0926-5805},
  doi = {https://doi.org/10.1016/j.autcon.2023.105133},
  url = {https://www.sciencedirect.com/science/article/pii/S092658052300393X},
}