LightAir: Augmented Reality System for Human-Drone Communication using Foot Gestures and Projected Image

9 pages•Published: February 11, 2018

Dzmitry Tsetserukou, Mikhail Matrosov, Olga Volkova and Evgeny Tsykunov

Abstract

We propose a new paradigm of human-drone interaction through projecting image on the ground and foot gestures. The proposed technology allowed creating a new type of tangible interaction with drone, e.g., DroneBall game for augmented sport and FlyMap to let a drone know where to fly.
We developed LightAir system that makes possible information sharing, GPS- navigating, controlling and playing with drones in a tangible way. In contrast to the hand gestures, that are common for smartphones, we came up with the idea of foot gestures and projected image for intelligent human-drone interaction. Such gestures make communication with the drone intuitive, natural, and safe. To our knowledge, it is the world’s first system that provides the human-drone bilateral tangible interaction. The paper also introduces the novel concept of Drone Haptics.

Keyphrases: augmented reality, computer vision, foot gesture recognition, human drone interaction, quadcopter

In: Akihiko Shirai, Laurent Chretien, Anne-Sophie Clayer, Simon Richir and Shoichi Hasegawa (editors). ReVo 2017: Laval Virtual ReVolution 2017 "Transhumanism++", vol 1, pages 41-49.

Links:	https://easychair.org/publications/paper/GkVv
	https://doi.org/10.29007/lv22

BibTeX entry

@inproceedings{ReVo2017:LightAir_Augmented_Reality_System,
  author    = {Dzmitry Tsetserukou and Mikhail Matrosov and Olga Volkova and Evgeny Tsykunov},
  title     = {LightAir: Augmented Reality System for Human-Drone Communication  using Foot Gestures and Projected Image},
  booktitle = {ReVo 2017: Laval Virtual ReVolution 2017 "Transhumanism++"},
  editor    = {Akihiko Shirai and Laurent Chretien and Anne-Sophie Clayer and Simon Richir and Shoichi Hasegawa},
  series    = {EPiC Series in Engineering},
  volume    = {1},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2516-2330},
  url       = {/publications/paper/GkVv},
  doi       = {10.29007/lv22},
  pages     = {41-49},
  year      = {2018}}

Download PDF Open PDF in browser