System for non-verbal hands-free user input

1. An electronic device comprising:

a bone conduction sensor to generate bone conduction data, the bone conduction data associated with vibrations propagating via a facial structure of a user;

an eye-tracking assembly to generate gaze data associated with the user;

a display;

one or more processors; and

one or more computer-readable media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving, from the bone conduction sensor, the bone conduction data;

receiving environmental audio data, the environmental audio data representative of noise in an environment surrounding the electronic device;

receiving audio output data, the audio output data associated with content presented to the user by the display;

filtering the bone conduction data based at least in part on the environmental audio data and the audio output data;

associating filtered bone conduction data with a first non-verbal command of a plurality of non-verbal commands based at least in part on a comparison of the filtered bone conduction data with a plurality of stored user-generated waveforms, a first user-defined stored waveform of the plurality of stored user-generated waveforms corresponding to the first non-verbal command;

receiving, from the eye-tracking assembly, the gaze data;

receiving visual data associated with the content presented to the user by the display;

determining a target object for the first non-verbal command based at least in part on the gaze data and the visual data, the visual data including a representation of the target object; and

causing an operation to execute with respect to the target object, the operation associated with the first non-verbal command.

2. The electronic device of claim 1 , wherein the bone conduction sensor is positioned within an ear canal of the user during use.

3. The electronic device of claim 2 , wherein the bone conduction sensor is in contact with the ear canal.

4. The electronic device of claim 1 , wherein the bone conduction sensor is coupled to an arm associated with an earbud of the electronic device.

5. The electronic device of claim 1 , wherein the eye-tracking assembly comprises at least one infrared image device and at least one infrared illuminator.

6. The electronic device of claim 1 , further comprising:

an external microphone to generate the environmental audio data.

7. The electronic device of claim 6 , further comprising:

an in-ear microphone to generate in-ear audio data, the in-ear audio data representative of noise in an ear canal of the user, wherein:

the bone conduction sensor is a contact microphone; and

the operations further comprise:

filtering the bone conduction data based at least in part on the in-ear audio data; and

providing noise cancellation based at least in part on the environmental audio data and the in-ear audio data.

8. The electronic device of claim 1 , wherein the operations further comprise:

detecting the first non-verbal command within the bone conduction data by determining that at least a portion of the filtered bone conduction data matches a waveform associated with a non-verbal command.

9. The electronic device of claim 1 , wherein the operations further comprise:

receiving, from the bone conduction sensor, additional bone conduction data;

detecting a second non-verbal command from the plurality of non-verbal commands within the additional bone conduction data based at least in part on a second user defined stored waveform from the plurality of stored user-generated waveforms, the second user-defined stored waveform different than the first user-defined stored waveform;

receiving, from the eye-tracking assembly, additional gaze data;

determining a second target for the operation associated with the first second non-verbal command based at least in part on the second additional gaze data and additional visual data, the additional visual data being presented on the display; and

causing a second operation to execute with respect to the second target, the second operation associated with the second non-verbal command corresponding to the second user-defined stored waveform.

10. The electronic device of claim 9 , further comprising:

receiving, from an external microphone, the environmental audio data; and

filtering the additional bone conduction data based at least in part on the environmental audio data.

11. The electronic device of claim 1 , where the operations further comprise:

receiving, from the bone conduction sensor, additional bone conduction data; and

responsive to determining that the additional bone conduction data does not correspond to one of the plurality of stored user-generated waveforms, utilizing the additional bone conduction data to cancel noise in the environment surrounding the electronic device.

12. The electronic device of claim 1 , wherein associating the bone conduction data with the first non-verbal command of the plurality of non-verbal commands is based at least in part on an active application on the electronic device, the active application associated with the visual data.

13. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving, from a bone conduction sensor, bone conduction data;

receiving environmental audio data, the environmental audio data representative of noise in an environment surrounding an electronic device;

receiving audio output data, the audio output data associated with content presented to a user by a display;

filtering the bone conduction data based at least in part on the environmental audio data and the audio output data;

associating the filtered bone conduction data with a first non-verbal command of a plurality of non-verbal commands based at least in part on a comparison of the filtered bone conduction data with a plurality of stored user-generated waveforms, a first user-defined stored waveform of the plurality of stored user-generated waveforms corresponding to the first non-verbal command;

receiving, from an eye-tracking assembly, gaze data;

receiving visual data associated with the content presented to the user by the display;

determining a target object for the first non-verbal command based at least in part on the gaze data and the visual data, the visual data including a representation of the target object; and

causing an operation to execute based at least in part on the target object, the operation associated with the first non-verbal command.

14. The one or more non-transitory computer-readable media of claim 13 , the operations further comprising:

receiving, from an external microphone, the environmental audio data.

15. The one or more non-transitory computer-readable media of claim 13 , the operations further comprising:

receiving, from the bone conduction sensor, additional bone conduction data;

detecting a second non-verbal command from the plurality of non-verbal commands within the additional bone conduction data based at least in part on a second user-defined stored waveform from the plurality of stored user-generated waveforms, the second user-defined stored waveform different than the first user-defined stored waveform;

receiving, from the eye-tracking assembly, additional gaze data;

determining a second target for the second non-verbal command based at least in part on the additional gaze data and additional visual data, the additional visual data being presented on the display; and

causing a second operation to execute based at least in part on the second target, the second operation associated with the second non-verbal command corresponding to the second user defined stored waveform.

16. The one or more non-transitory computer-readable media of claim 13 , the operations further comprising:

detecting the first non-verbal command from the plurality of non-verbal commands within the filtered bone conduction data based at least in part on the first user-defined stored waveform.

17. The one or more non-transitory computer-readable media of claim 13 , wherein associating the filtered bone conduction data with the first non-verbal command of the plurality of non-verbal commands is based at least in part on an active application on the electronic device, the active application associated with the visual data.

18. A method comprising:

receiving, from a bone conduction sensor, bone conduction data;

receiving environmental audio data, the environmental audio data representative of noise in an environment surrounding an electronic device;

receiving audio output data, the audio output data associated with content presented to a user by a display;

filtering the bone conduction data based at least in part on the environmental audio data and the audio output data;

associating filtered bone conduction data with a first non-verbal command of a plurality of non-verbal commands based at least in part on a comparison of the filtered bone conduction data with a plurality of stored user-generated waveforms, a first user-defined stored waveform of the plurality of stored user-generated waveforms corresponding to the first non-verbal command;

receiving, from an eye-tracking assembly, gaze data;

receiving visual data associated with the content presented to the user by the display;

determining a target object for the first non-verbal command based at least in part on the gaze data and the visual data; and

causing an operation to execute with respect to the target object, the operation associated with the first non-verbal command.

19. The method of claim 18 , further comprising:

receiving, from the bone conduction sensor, additional bone conduction data;

detecting a second non-verbal command from the plurality of non-verbal commands within the additional bone conduction data based at least in part on a second user-defined stored waveform from the plurality of stored user-generated waveforms, the second user-defined stored waveform different than the first user-defined stored waveform;

receiving, from the eye-tracking assembly, additional gaze data;

determining a second target for the second non-verbal command based at least in part on the additional gaze data and additional visual data, the additional visual data being presented on the display; and

causing a second operation to execute based at least in part on the second target, the operation associated with the second non-verbal command corresponding to the second user-defined stored waveform.

20. The method of claim 18 , wherein associating the bone conduction data with the first non-verbal command of the plurality of non-verbal commands is based at least in part on an active application on the electronic device, the active application associated with the visual data.