Related Work

XLeapr is loosely based on an existing gesture control application called DesktopLeapr. DesktopLeapr was released very early in the development of the Leap APIs, it offered no configurability or extensibility, and has not been updated since.

Difficulty

This project presents some very interesting challenges. We will be directly manipulating the X window APIs with Python which is a fairly poorly documented process and will require some time to learn. The Leap API will also be integrated which is well-documented, but very poorly implemented. The lack of common gesture support and extensibility in the Leap API will also be a challenge because we will have to implement most of the gestures ourselves and develop our own gesture API to meet our goal of extensibility.

Relevance

The development of new interaction technologies is moving faster than knowledge representation systems can keep up with them. We hope that by building a generalized gesture control application for Linux, we can ease the burden on application developers by allowing users to define their own application-specific gestures.