IP Library Granted Patent US 10,228,904
Granted Patent B2
US 10,228,904 · App. 14/539,495 · Granted Mar 12, 2019

Gaze triggered voice recognition incorporating device velocity

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,228,904
App. No.
14/539,495
Granted
Mar 12, 2019
Kind
B2
Abstract

One embodiment provides a method, involving: detecting, at an electronic device, a location of user gaze; activating, based on the location of the user gaze, a voice input module, wherein the activating is based on a command input using a modality that detects an input in combination with the location of the user gaze, the modality comprising a change in velocity of the device; detecting, at the electronic device, a voice input; evaluating, using the voice input module, the voice input, and performing, based on evaluation of the voice input, at least one action. Other aspects are described and claimed.

Claims (35)

1. A method, comprising:

detecting, at a display device of an electronic device, a location of user gaze;

activating, based on the location of the user gaze, a voice input module of a digital assistant, wherein the activating is based on a command input using a modality that detects an input in combination with the location of the user gaze, the modality comprising a change in velocity of the device;

detecting, at the electronic device and after activation of the voice input module, a voice input; and

performing, based on the voice input, at least one action, wherein the performed at least one action is irrespective of the location of the user gaze.

2. The method of claim 1 , wherein the voice input module activation is triggered by the location of user gaze being focused on a characteristic selected from a group consisting of: a predetermined location, an icon, an anthropomorphic agent, a user selected image, and a third party created agent.

3. The method of claim 2 , further comprising changing a visual state of the characteristic in response to the user gaze being focused on the characteristic.

4. The method of claim 2 , wherein the location of the characteristic is determined based on a factor selected from a group consisting of: user selection, third party application preference, and current device task.

5. The method of claim 1 , wherein detecting a location of user gaze comprises: using a sensor device to detect the user gaze.

6. The method of claim 5 , wherein the sensor device is selected from a group consisting of: an image capture device, a video capture device, a range imaging device, and a 3D scanning device.

7. The method of claim 1 , wherein detecting a voice input comprises: using an audio capture device to detect audio.

8. The method of claim 7 , wherein the audio detected comprises voice commands from the user.

9. The method of claim 1 , wherein the modality detects an input selected from a group consisting of: facial manipulation, a change in velocity of the device, an electronic communication, a key phrase, and a button press.

10. An information handling device, comprising:

a display device;

a processor operatively coupled to the display device;

at least one sensor operatively coupled to the processor; and

a memory that stores instructions executable by the processor to:

detect a location of user gaze on the display device;

activate, based on the location of the user gaze, a voice input module of a digital assistant, wherein the activating is based on a command input using a modality that detects an input in combination with the location of the user gaze, the modality comprising a change in velocity of the device;

detect, after activation of the voice input module, a voice input using the at least one sensor; and

perform, based on the voice input, at least one action, wherein the performed at least one action is irrespective of the location of the user gaze.

11. The me information handling device of claim 10 , wherein voice input module activation is triggered by the location of user gaze being focused on a characteristic selected from a group consisting of: a predetermined location, an icon, an anthropomorphic agent, a user selected image, and a third party created agent.

12. The information handling device of claim 11 , further comprising changing a visual state of the characteristic in response to the user gaze being focused on the characteristic.

13. The information handling device of claim 11 , wherein the location of the characteristic is determined based on a factor selected from a group consisting of: user selection, third party application preference, and current device task.

14. The information handling device of claim 10 , wherein detecting a location of user gaze comprises: using a sensor device selected from a group consisting of: an image capture device, a video capture device, a range imaging device, and a 3D scanning device.

15. The information handling device of claim 10 , wherein detecting a voice input comprises: using an audio capture device to detect audio.

16. The information handling device of claim 15 , wherein the audio detected comprises voice commands from the user.

17. The information handling device of claim 10 , wherein the modality detects an input selected from a group consisting of: facial manipulation, a change in velocity of the device, an electronic communication, a key phrase, and a button press.

18. A product, comprising:

a storage device having code stored therewith, the code being executable by the processor and comprising:

code that detects a location of a user gaze on a display device;

code that activates, based on the location of the user gaze, a voice input module of a digital assistant, wherein the activating is based on a command input using a modality that detects an input in combination with the location of the user gaze, the modality comprising a change in velocity of the device;

code that detects, after activation of the voice input module, a voice input using a modality; and

code that performs, based on the voice input, at least one action, wherein the performed at least one action is irrespective of the location of the user gaze.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 069870/0670 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2019
From: LENOVO (SINGAPORE) PTE LTD
To: LENOVO PC INTERNATIONAL LTD
Reel/Frame 049844/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2014
From: RAUX, ANTOINE ROLAND
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 034157/0114 →