SYSTEMS AND METHODS OF GESTURAL INTERACTION IN A PERVASIVE COMPUTING ENVIRONMENT
The technology disclosed relates to selecting among devices to interact with. It also relates operating a smart phone with reduced power consumption. It further relates to gesturally interacting with devices that lack gestural responsiveness. The technology disclosed also relates to distinguishing control gestures from proximate non-control gestures in a pervasive three dimensional (3D) sensory space. The technology disclosed further relates to selecting among virtual interaction modalities to interact with.
1 . A method of selecting among devices for interaction, the method including:
detecting, using a smart phone equipped with a motion sensory control device that detects gestures in a three dimensional (3D) sensory space, one or more heterogeneous devices in a living room that accept motion control commands;
creating, using the smart phone, data for display that identifies the heterogeneous devices;
presenting the created data on a display;
interpreting input from a touch command across the display as selecting one of the identified heterogeneous devices; and
establishing a communication channel between the smart phone and the selected device.
2 . The method of claim 1 , further including
detecting one or more gestures in the 3D sensory space;
preprocessing information about the detected gestures to reduce bandwidth for transmission; and
sending the preprocessed information about the detected gestures via the communication channel to the selected device.
3 . The method of claim 1 , further including
detecting a paradigm-setting gesture that sets a control paradigm used to preprocess one or more gestures in the 3D sensory space to send to the selected device via the communications channel.
4 . The method of claim 3 , further including
controlling on-screen responsiveness of the selected device to the gestures based at least on the set control paradigm.
5 . The method of claim 1 , wherein the display for the presentation of created data is a display on the smart phone.
6 . A system including a smart phone equipped with a motion sensory control device that detects gestures in a three dimensional (3D) sensory space, and also including one or more processors coupled to memory, the memory loaded with computer program instructions when executed on the one or more processors, implement actions comprising:
detecting, using the smart phone, one or more heterogeneous devices that accept motion control commands;
creating, using the smart phone, data for display that identifies the heterogeneous devices;
displaying the created data;
interpreting input from a touch command across the display as selecting one of the identified heterogeneous devices; and
establishing a communication channel between the smart phone and the selected device.
7 . The system of claim 6 , the actions further including:
detecting one or more gestures in the 3D sensory space;
preprocessing information about the detected gestures to reduce bandwidth for transmission; and
sending the preprocessed information about the detected gestures via the communication channel to the selected device.
8 . The system of claim 6 , the actions further including:
detecting a paradigm-setting gesture that sets a control paradigm used to preprocess one or more gestures in the 3D sensory space to send to the selected device via the communications channel.
9 . The system of claim 8 , the actions further including:
controlling on-screen responsiveness of the selected device to the gestures based at least on the set control paradigm.
10 . The system of claim 6 , wherein
the display for the presentation of created data is a display on the smart phone.
11 . A non-transitory computer-readable recording medium having computer program instructions recorded thereon that, when executed on a processor, cause the processor to perform a method comprising:
detecting, using a smart phone, one or more heterogeneous devices that accept motion control commands;
creating, using the smart phone, data for display that identifies the heterogeneous devices;
displaying the created data;
interpreting input from a touch command across the display as selecting one of the identified heterogeneous devices; and
establishing a communication channel between the smart phone and the selected device.
12 . The non-transitory computer-readable recording medium of claim 11 , the method additionally comprising:
detecting one or more gestures in the 3D sensory space;
preprocessing information about the detected gestures to reduce bandwidth for transmission; and
sending the preprocessed information about the detected gestures via the communication channel to the selected device.
13 . The non-transitory computer-readable recording medium of claim 11 , the method additionally comprising:
detecting a paradigm-setting gesture that sets a control paradigm used to preprocess one or more gestures in the 3D sensory space to send to the selected device via the communications channel.
14 . The non-transitory computer-readable recording medium of claim 11 , the method additionally comprising:
controlling on-screen responsiveness of the selected device to the gestures based at least on the set control paradigm.