Immersive Remote Grasping: Realtime Gripper Control by a Heterogenous Robot Control System

VRST '16 Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology Pages 337-338 - nov 2016
Current developments in the field of user interface (UI) technologies as well as robotic systems provide enormous potential to reshape the future of human-robot interaction (HRI) and collaboration. However, the design of reliable, intuitive and comfortable user interfaces is a challenging task. In this paper, we focus on one important aspect of such interfaces, i.e., teleoperation. We explain how to setup a heterogeneous, extendible and immersive system for controlling a distant robotic system via the network. Therefore, we exploit current technologies from the area of virtual reality (VR) and the Unity3D game engine in order to provide natural user interfaces for teleoperation. Regarding robot control, we use the well-known robot operating system (ROS) and apply its freely available modular components. The contribution of this work lies in the implementation of a flexible immersive grasping control system using a network layer (ROSbridge) between Unity3D and ROS for arbitary robotic hardware.

Images and movies

 

BibTex references

@InProceedings\{KELZS16,
  author       = "Krupke, Dennis and Einig, Lasse and Langbehn, Eike and Zhang, Jianwei and Steinicke, Frank",
  title        = "Immersive Remote Grasping: Realtime Gripper Control by a Heterogenous Robot Control System",
  booktitle    = "VRST '16 Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology Pages 337-338",
  month        = "nov",
  year         = "2016",
  keywords     = "teleoperation, virtual reality, Unity3D, ROS, robot, HRI, human-robot interaction",
  url          = "http://basilic.informatik.uni-hamburg.de/Publications/2016/KELZS16"
}

Other publications in the database

» Dennis Krupke
» Lasse Einig
» Eike Langbehn
» Jianwei Zhang
» Frank Steinicke