Expert system for gesture recognition in terminal's user interface

Tapio Frantti (Corresponding Author), Sanna Kallio

Research output: Contribution to journalArticleScientificpeer-review

10 Citations (Scopus)

Abstract

This paper presents and describes a soft computing based expert system for gesture recognition procedure, as a part of intelligent user interface of a mobile terminal. In the presented solution, a terminal includes three acceleration sensors positioned like xyz co-ordinate system in order to get three-dimensional (3D) acceleration vector, xyz. The 3D acceleration vector is, after Doppler spectrum definition, used as an input vector to a fuzzy reasoning unit of embedded expert system, which classifies gestures (time series of acceleration vectors). In the reasoning unit fuzzy rule aided method is used to classification. The method is compared to the fuzzy c-means classification with feature extraction, to the hidden Markov model (HMM) classification and SOM classification. Fuzzy methods classified successfully the test sets. The advantages of the fuzzy methods are computational effectiveness, simple implementation, lower data sample rate requirement and reliability. Moreover, fuzzy methods do not require training like SOM and HMM. Therefore, the methods can be applied to the real time systems where different gestures can be used, for example, instead of the keyboard functions. The computational effectiveness and low sample rate requirement also increases the operational time of device compared to computationally heavy HMM method. Furthermore, the easy implementation and reliability are important factors for the success of the new technology's spreading on the mass market of terminals.
Original languageEnglish
Pages (from-to)189 - 202
Number of pages14
JournalExpert Systems with Applications
Volume26
Issue number2
DOIs
Publication statusPublished - 2004
MoE publication typeA1 Journal article-refereed

Fingerprint

Gesture recognition
Expert systems
User interfaces
Hidden Markov models
Soft computing
Fuzzy rules
Computational methods
Real time systems
Feature extraction
Time series
Sensors

Keywords

  • Fuzzy
  • HMM
  • SOM
  • FCM
  • Gesture recognition
  • User interface

Cite this

Frantti, Tapio ; Kallio, Sanna. / Expert system for gesture recognition in terminal's user interface. In: Expert Systems with Applications. 2004 ; Vol. 26, No. 2. pp. 189 - 202.
@article{cfdf58a8a5f844c683c21ed7cdfca7fd,
title = "Expert system for gesture recognition in terminal's user interface",
abstract = "This paper presents and describes a soft computing based expert system for gesture recognition procedure, as a part of intelligent user interface of a mobile terminal. In the presented solution, a terminal includes three acceleration sensors positioned like xyz co-ordinate system in order to get three-dimensional (3D) acceleration vector, xyz. The 3D acceleration vector is, after Doppler spectrum definition, used as an input vector to a fuzzy reasoning unit of embedded expert system, which classifies gestures (time series of acceleration vectors). In the reasoning unit fuzzy rule aided method is used to classification. The method is compared to the fuzzy c-means classification with feature extraction, to the hidden Markov model (HMM) classification and SOM classification. Fuzzy methods classified successfully the test sets. The advantages of the fuzzy methods are computational effectiveness, simple implementation, lower data sample rate requirement and reliability. Moreover, fuzzy methods do not require training like SOM and HMM. Therefore, the methods can be applied to the real time systems where different gestures can be used, for example, instead of the keyboard functions. The computational effectiveness and low sample rate requirement also increases the operational time of device compared to computationally heavy HMM method. Furthermore, the easy implementation and reliability are important factors for the success of the new technology's spreading on the mass market of terminals.",
keywords = "Fuzzy, HMM, SOM, FCM, Gesture recognition, User interface",
author = "Tapio Frantti and Sanna Kallio",
year = "2004",
doi = "10.1016/S0957-4174(03)00134-9",
language = "English",
volume = "26",
pages = "189 -- 202",
journal = "Expert Systems with Applications",
issn = "0957-4174",
publisher = "Elsevier",
number = "2",

}

Expert system for gesture recognition in terminal's user interface. / Frantti, Tapio (Corresponding Author); Kallio, Sanna.

In: Expert Systems with Applications, Vol. 26, No. 2, 2004, p. 189 - 202.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Expert system for gesture recognition in terminal's user interface

AU - Frantti, Tapio

AU - Kallio, Sanna

PY - 2004

Y1 - 2004

N2 - This paper presents and describes a soft computing based expert system for gesture recognition procedure, as a part of intelligent user interface of a mobile terminal. In the presented solution, a terminal includes three acceleration sensors positioned like xyz co-ordinate system in order to get three-dimensional (3D) acceleration vector, xyz. The 3D acceleration vector is, after Doppler spectrum definition, used as an input vector to a fuzzy reasoning unit of embedded expert system, which classifies gestures (time series of acceleration vectors). In the reasoning unit fuzzy rule aided method is used to classification. The method is compared to the fuzzy c-means classification with feature extraction, to the hidden Markov model (HMM) classification and SOM classification. Fuzzy methods classified successfully the test sets. The advantages of the fuzzy methods are computational effectiveness, simple implementation, lower data sample rate requirement and reliability. Moreover, fuzzy methods do not require training like SOM and HMM. Therefore, the methods can be applied to the real time systems where different gestures can be used, for example, instead of the keyboard functions. The computational effectiveness and low sample rate requirement also increases the operational time of device compared to computationally heavy HMM method. Furthermore, the easy implementation and reliability are important factors for the success of the new technology's spreading on the mass market of terminals.

AB - This paper presents and describes a soft computing based expert system for gesture recognition procedure, as a part of intelligent user interface of a mobile terminal. In the presented solution, a terminal includes three acceleration sensors positioned like xyz co-ordinate system in order to get three-dimensional (3D) acceleration vector, xyz. The 3D acceleration vector is, after Doppler spectrum definition, used as an input vector to a fuzzy reasoning unit of embedded expert system, which classifies gestures (time series of acceleration vectors). In the reasoning unit fuzzy rule aided method is used to classification. The method is compared to the fuzzy c-means classification with feature extraction, to the hidden Markov model (HMM) classification and SOM classification. Fuzzy methods classified successfully the test sets. The advantages of the fuzzy methods are computational effectiveness, simple implementation, lower data sample rate requirement and reliability. Moreover, fuzzy methods do not require training like SOM and HMM. Therefore, the methods can be applied to the real time systems where different gestures can be used, for example, instead of the keyboard functions. The computational effectiveness and low sample rate requirement also increases the operational time of device compared to computationally heavy HMM method. Furthermore, the easy implementation and reliability are important factors for the success of the new technology's spreading on the mass market of terminals.

KW - Fuzzy

KW - HMM

KW - SOM

KW - FCM

KW - Gesture recognition

KW - User interface

U2 - 10.1016/S0957-4174(03)00134-9

DO - 10.1016/S0957-4174(03)00134-9

M3 - Article

VL - 26

SP - 189

EP - 202

JO - Expert Systems with Applications

JF - Expert Systems with Applications

SN - 0957-4174

IS - 2

ER -