QtSensorGestures Plugins

The QtSensorGestures recognizer plugins are the way to create your own sensor gestures.

Creating software to recognize motion gestures using sensors is a huge subject not covered here.

The QSensorGesture API does not limit usage to any of the common classification methods of gesture recognition, such as Hidden Markov Models, Neural Networks, Dynamic Time Warping, or even the ad-hoc heuristic recognizers of Qt's built-in sensor gesture recognizers. It's basically a signaling system for lower level gesture recogition methods and algorithms to communicate to the higher level applications.

Overview

The steps for creating a sensor gesture plugin are as follows:

• Sub-class from QSensorGesturePluginInterface
• Sub-class from QSensorGestureRecognizer and implement gesture recognizer logic using QtSensors.
• Create an instance of that recognizer in the derived QSensorGesturePluginInterface class, and call QSensorGestureManager::registerSensorGestureRecognizer(sRec); in your registerRecognizers() function. QSensorGestureManager will retain ownership of the recognizer object.

  This is the class in which the gesture recognizer system should be implemented from.

 MySensorGestureRecognizer::MySensorGestureRecognizer(QObject *parent)
     : QSensorGestureRecognizer(parent)
 {
 }

 MySensorGestureRecognizer::~MySensorGestureRecognizer()
 {
 }

 bool MySensorGestureRecognizer::start()
 {
     Q_EMIT mySignal();
     return true;
 }

 bool MySensorGestureRecognizer::stop()
 {
     return true;
 }

 bool MySensorGestureRecognizer::isActive()
 {
     return true;
 }

 void  MySensorGestureRecognizer::create()
 {
 }

 QString MySensorGestureRecognizer::id() const
 {
     return QString("QtSensors.mygestures");
 }

 MySensorGesturePlugin::MySensorGesturePlugin(){}
 MySensorGesturePlugin::~MySensorGesturePlugin(){}

 QList <QSensorGestureRecognizer *>  MySensorGesturePlugin::createRecognizers()
 {
     QList <QSensorGestureRecognizer *>  recognizers;
     MySensorGestureRecognizer *recognizer = new MySensorGestureRecognizer(this);
     recognizers.append(recognizer);

     return recognizers;
 }

 QStringList MySensorGesturePlugin::supportedIds() const
 {
        return QStringList() << "QtSensors.mygestures";
 }

Recognizer Classes

If you are making sensorgestures available through the QtSensorGestures API, these are the classes to subclass.

Recognizer Plugins

The Sensor Gesture Recognizers that come with Qt are made using an ad-hoc heuristic approach. The user cannot define their own gestures, and must learn how to perform and accommodate the pre-defined gestures herein.

A developer may use any method, including computationally- and training-intensive well- known classifiers, to produce gesture recognizers. There are currently no classes in Qt for gesture training, nor is it possible for the user to define his own sensor-based motion gestures.

A procedure for writing ad-hoc recognizers might include:

• Obtain and gather output from the accelerometer through QAccelerometerReading of a gesture being performed.
• Use various methods and constraints on the accelerometer data to recognize the various states:
  1. Initial "listening" state for a gesture
  2. Start of a possible gesture, moving into a "detecting" state
  3. End of a possible gesture, moving into a "recognizing" state
  4. and finally, if it is recognized, the "recognized" state, or if not recognized, move back to the "listening" state.
• Test procedure to make sure it is easy to perform, and will not produce too many false positive recognitions, or collisions if used with other gestures. Meaning that gestures performed get recognized as another gesture instead.

Below you will find a list of included plugins and their signals.

For the ShakeGestures plugin:

For the QtSensorGestures plugin: