MINT2 Research team
Méthodes et outils pour l'interaction à gestes
- Leader : Laurent Grisoni
- Research center(s) : CRI Lille - Nord Europe
- Field : Perception, Cognition and Interaction
- Theme : Interaction and visualization
The proposed project focuses on gestural interaction, i.e. the use of gesture as a human-computer interaction (HCI) technique. Over the years, numerous technical solutions have been proposed to track the paths of body parts using objects to be held (e.g. a mouse), worn (e.g. gloves) or touched (e.g. a touchscreen), or using contactless perceptual technologies (e.g. computer vision). About 25 years ago, Buxton et al., in 1983, mentionned that there remains “a perceived discrepancy between the apparent power of the approach and its extremely low utilization in current practice”. In spite of all the time (and technology improvements) since then, that is still true. Gesture-based applications remains very basic : the flick commands supported by web browsers like Opera or Firefox and the swipe, pinch and rotate gestures popularized by the iPhone are probably the most prominent examples of the current state of gestural interaction. Our general goal is to advance this state beyond specific applications and simple marking gestures.
We adress the global problem of gesture-based interaction from three views: cognitive, numerical/algorithmic, and finally hardware point of view. We more specifically aim at tackling the following challenges:
- First, usage aspects: we need to imagine what new uses of gesture-based interaction can be. This implies to exhibit tasks for which gesture improves efficiency (speed, accuracy....), and propose news interactions systems for these tasks.
- Second, numerical aspects: we need to understand gestural interaction. What does it imply, numerically speaking, to have an application use gesture? How to integrate in-depth analysis and recognition of interaction gesture into application?
- Last, hardware aspects: we need to further improve interaction hardware. While there are many hardware systems available for user to input gesture, there is still some work that needs to be achieved for user to get feedback from application. We target our effort on a class of feedback on which very few has been done: tactile feedback.
International and industrial relations
startups GotoTouchVR, Holusion, Foligraph, Hap2U. medical network of the NWE european project VR4REHAB.