Incorporating tilt-based interaction in multimodal user interfaces for mobile devices

Jani Mäntyjärvi, Fabio Paternò, Carmen Santoro

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    2 Citations (Scopus)


    Emerging ubiquitous environments raise the need to support multiple interaction modalities in diverse types of devices. Designing multimodal interfaces for ubiquitous environments using development tools creates challenges since target platforms support different resources and interfaces. Model-based approaches have been recognized as useful for managing the increasing complexity consequent to the many available interaction platforms. However, they have usually focused on graphical and/or vocal modalities. This paper presents a solution for enabling the development of tilt-based hand gesture and graphical modalities for mobile devices in a multimodal user interface development tool. The challenges related to developing gesture-based applications for various types of devices involving mobile devices are discussed in detail. The possible solution presented is based on a logical description language for handgesture user interfaces. Such language allows us to obtain a user interface implementation on the target mobile platform. The solution is illustrated with an example application that can be accessed from both the desktop and mobile device supporting tiltbased gesture interaction
    Original languageEnglish
    Title of host publicationTask Models and Diagrams for Users Interface Design
    EditorsK. Coninx, K. Luyten, K.A. Schneider
    ISBN (Electronic)978-3-540-70816-2
    ISBN (Print)978-3-540-70815-5
    Publication statusPublished - 2006
    MoE publication typeA4 Article in a conference publication
    Event5th International Workshop on TAsk MOdels and DIAgrams for user interface design, TAMODIA 2006 - Hasselt, Belgium
    Duration: 23 Oct 200624 Oct 2006

    Publication series

    SeriesLecture Notes in Computer Science


    Conference5th International Workshop on TAsk MOdels and DIAgrams for user interface design, TAMODIA 2006
    Abbreviated titleTAMODIA 2006


    • user interface
    • user interaction
    • human-computer interaction
    • model-based design
    • gestural interfaces
    • mobile device
    • tilt interface
    • tilt interaction
    • gesture interface
    • gesture interaction
    • accelerometer


    Dive into the research topics of 'Incorporating tilt-based interaction in multimodal user interfaces for mobile devices'. Together they form a unique fingerprint.

    Cite this