From: "Pandruvada, Srinivas" <srinivas.pandruvada@intel.com>
To: "linux-iio@vger.kernel.org" <linux-iio@vger.kernel.org>,
"jic23@kernel.org" <jic23@kernel.org>
Cc: "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>
Subject: [RFP] iio: Support of gesture sensor as a standard IIO sensor
Date: Sat, 6 Jan 2018 00:07:20 +0000 [thread overview]
Message-ID: <1515197240.26317.65.camel@intel.com> (raw)
SGkgSm9uYXRoYW4gYW5kIEV2ZXJ5b25lLA0KDQpUaGUgSW50ZWwgSW50ZWdyYXRlZCBzZW5zb3Ig
aHViIChJU0gpIG9uIHNvbWUgcGxhdGZvcm1zIGhhdmUgYWJpbGl0eSB0bw0KaWRlbnRpZnkgZ2Vz
dHVyZXMuIFRoaXMgaXMgYXZhaWxhYmxlIG9uIHNvbWUgQW5kcm9pZCBwbGF0Zm9ybXMuIFdlIHdh
bnQNCnRvIGJyaW5nIGluIHRoaXMgY2FwYWJpbGl0eSB0byBvdGhlciBMaW51eCBmbGF2b3JzIGFs
c28uwqANCg0KVGhpcyBhbGdvcml0aG0gZm9yIGdlc3R1cmUgcmVjb2duaXRpb24gZXhlY3V0ZXMg
aW4gSVNIIGFzIHRoaXMgaXMgYQ0KY29tcHV0YXRpb24gaW50ZW5zaXZlIGFuZCBuZWVkIHRvIGJl
IHJ1bm5pbmcgZXZlbiB3aGVuIHRoZSBtYWluDQpwbGF0Zm9ybSBDUFUgZ29lcyB0byBzbGVlcC4N
Cg0KV2UgYWxyZWFkeSBoYXZlIElTSCBzdXBwb3J0IGF2YWlsYWJsZSBpbiB1cHN0cmVhbSBMaW51
eCBmb3IgYSB3aGlsZS4NClRoZSBzdGFuZGFyZCBzZW5zb3JzIGluIElTSCBsaWtlIEFjY2VsZXJv
bWV0ZXIsIEd5cm8sIEFMUyBldGMgYWxyZWFkeQ0KZXhwb3NlZCB2aWEgTGludXggSUlPLiBTZXZl
cmFsIExhcHRvcHMgYW5kIDItaW4tMXMgYWxyZWFkeSB1c2luZyBzb21lDQpmZWF0dXJlcyBsaWtl
IHNjcmVlbiByb3RhdGlvbiwgYXV0byBiYWNrIGxpZ2h0IGFkanVzdG1lbnQgZXRjLiBXZSBjYW4N
CmFsc28gYWRkIGdlc3R1cmVzLiBGb3IgZXhhbXBsZQ0KLWRldmljZSB3YWtlIHVwIGZyb20gZGVl
cCBwb3dlciBzYXZlIHN0YXRlIG9uY2UgZGV2aWNlIGlzIHBpY2tlZCB1cA0KLVVzZXIgY2FuIHNl
bmQgZGV2aWNlIHRvIHNsZWVwIGJ5IHNpbXBsZSBoYW5kIGdlc3R1cmVzDQotU29tZSBnYW1lcyBj
YW4gdXRpbGl6ZSBnZXN0dXJlcyB0byBiZSBtb3JlIHVzZXIgZnJpZW5kbHkJDQoNClRoZSBwcm9w
b3NhbCBoZXJlIGlzIHRvIGV4cG9zZSBnZXN0dXJlIHNlbnNvciB2aWEgc3RhbmRhcmQgSUlPDQpp
bnRlcmZhY2UuDQoNCkEgdHlwaWNhbCBnZXN0dXJlIHJlY29nbml0aW9uIHByb2Nlc3MgaW52b2x2
ZXM6DQoNClJhdyBEYXRhIC0+IFByZXByb2Nlc3NpbmcgLT4gRmVhdHVyZSBFeHRyYWN0aW9uIC0+
IFRlbXBsYXRlIG1hdGNoIC0+DQpNYXRjaGVkIGFjdGl2aXR5DQoNClRoaXMgcHJvY2Vzc2luZyBp
cyBkb25lIGluIElTSC4gSW50ZWwgcHJvdmlkZXMgYSBjb250ZW50IHNlbnNpbmcgU0RLDQpbMV0g
dG8gZGV2ZWxvcCBhcHBsaWNhdGlvbnMuIFRoZXJlIGFyZSBhbHJlYWR5IHNvbWUgc3RhbmRhcmQg
Z2VzdHVyZXMNCnBhdHRlcm5zIGFscmVhZHkgaW4gYnVpbHQgaW4gdGhlIElTSCBmb3IgQW5kcm9p
ZCBkZXZpY2VzLiBUaGUgU0RLDQpkb2N1bWVudGF0aW9uIHByb3ZpZGVzIGRldGFpbHMgYWJvdXQg
dGhlbS4gQWxzbyB0aGVyZSBhcmUgdXNlciBkZWZpbmVkDQpnZXN0dXJlcyB3aGljaCBlc3NlbnRp
YWxseSBhcmUgdGVtcGxhdGVzIGZvciBtYXRjaGluZyBhbmQgbmVlZHMgdG8gYmUNCmRvd25sb2Fk
ZWQgdG8gSVNILg0KDQpGcm9tIGFuIElJTyBzZW5zb3IgcG9pbnQgb2YgdmlldyBBIEdlc3R1cmUg
c2Vuc29yOg0KT3V0cHV0cw0KCUEgcHJlIGRlZmluZWQgYWN0aXZpdHkgdHlwZQ0KCQlXQUtFDQoJ
CVRJTFQNCgkJR0xBTkNFDQoJCVBJQ0tfVVANCgkJwqAmDQoJCcKgbW9yZQ0KDQoJQSB1c2VyIGRl
ZmluZWQgYWN0aXZpdHkgdHlwZSBhcyAic3RyaW5nIg0KDQpJbnB1dHMNCglBIHJhdyBiaW5hcnkg
Y2RldiBpbnRlcmZhY2UgdG8gZG93bmxvYWQgdGVtcGxhdGVzL3BhdHRlcm5zDQoNCg0KSSB3YW50
IHRvIGdhdGhlciBtb3JlIG9waW5pb25zIGJlZm9yZSBzdWJtaXR0aW5nIGEgUkZDIHBhdGNoLg0K
DQpSZWZlcmVuY2VzDQoxLiBodHRwczovL3NvZnR3YXJlLmludGVsLmNvbS9lbi11cy9kb2N1bWVu
dGF0aW9uL2NvbnRleHQtc2Vuc2luZy1zZGstZg0Kb3ItYW5kcm9pZC1kZXZlbG9wZXItZ3VpZGUN
CjIuIGh0dHBzOi8vc29mdHdhcmUuaW50ZWwuY29tL2VuLXVzL2RvY3VtZW50YXRpb24vdXNpbmct
Z2VzdHVyZS1yZWNvZ25pDQp0aW9uLWFzLWRpZmZlcmVudGlhdGlvbi1mZWF0dXJlLW9uLWFuZHJv
aWQNCg0KVGhhbmtzLA0KU3Jpbml2YXM=
WARNING: multiple messages have this Message-ID (diff)
From: "Pandruvada, Srinivas" <srinivas.pandruvada@intel.com>
To: "linux-iio@vger.kernel.org" <linux-iio@vger.kernel.org>,
"jic23@kernel.org" <jic23@kernel.org>
Cc: "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>
Subject: [RFP] iio: Support of gesture sensor as a standard IIO sensor
Date: Sat, 6 Jan 2018 00:07:20 +0000 [thread overview]
Message-ID: <1515197240.26317.65.camel@intel.com> (raw)
Hi Jonathan and Everyone,
The Intel Integrated sensor hub (ISH) on some platforms have ability to
identify gestures. This is available on some Android platforms. We want
to bring in this capability to other Linux flavors also.
This algorithm for gesture recognition executes in ISH as this is a
computation intensive and need to be running even when the main
platform CPU goes to sleep.
We already have ISH support available in upstream Linux for a while.
The standard sensors in ISH like Accelerometer, Gyro, ALS etc already
exposed via Linux IIO. Several Laptops and 2-in-1s already using some
features like screen rotation, auto back light adjustment etc. We can
also add gestures. For example
-device wake up from deep power save state once device is picked up
-User can send device to sleep by simple hand gestures
-Some games can utilize gestures to be more user friendly
The proposal here is to expose gesture sensor via standard IIO
interface.
A typical gesture recognition process involves:
Raw Data -> Preprocessing -> Feature Extraction -> Template match ->
Matched activity
This processing is done in ISH. Intel provides a content sensing SDK
[1] to develop applications. There are already some standard gestures
patterns already in built in the ISH for Android devices. The SDK
documentation provides details about them. Also there are user defined
gestures which essentially are templates for matching and needs to be
downloaded to ISH.
From an IIO sensor point of view A Gesture sensor:
Outputs
A pre defined activity type
WAKE
TILT
GLANCE
PICK_UP
&
more
A user defined activity type as "string"
Inputs
A raw binary cdev interface to download templates/patterns
I want to gather more opinions before submitting a RFC patch.
References
1. https://software.intel.com/en-us/documentation/context-sensing-sdk-f
or-android-developer-guide
2. https://software.intel.com/en-us/documentation/using-gesture-recogni
tion-as-differentiation-feature-on-android
Thanks,
Srinivas
next reply other threads:[~2018-01-06 0:07 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-01-06 0:07 Pandruvada, Srinivas [this message]
2018-01-06 0:07 ` [RFP] iio: Support of gesture sensor as a standard IIO sensor Pandruvada, Srinivas
2018-01-06 0:20 ` Alan Cox
2018-01-06 0:20 ` Alan Cox
2018-01-06 13:12 ` Jonathan Cameron
2018-01-06 13:12 ` Jonathan Cameron
2018-01-06 17:43 ` Pandruvada, Srinivas
2018-01-06 17:43 ` Pandruvada, Srinivas
2018-01-18 22:40 ` Pavel Machek
2018-01-20 15:19 ` Jonathan Cameron
2018-01-20 20:31 ` Pandruvada, Srinivas
2018-01-20 20:31 ` Pandruvada, Srinivas
2018-01-27 22:09 ` Pavel Machek
2018-01-27 22:55 ` Pandruvada, Srinivas
2018-01-27 22:55 ` Pandruvada, Srinivas
2018-01-28 8:40 ` Pavel Machek
2018-01-28 9:38 ` Jonathan Cameron
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1515197240.26317.65.camel@intel.com \
--to=srinivas.pandruvada@intel.com \
--cc=jic23@kernel.org \
--cc=linux-iio@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.