IP Library › Granted Patent US 12,099,651
Granted Patent B2
US 12,099,651 · App. 18/186,680 · Granted Sep 24, 2024

Natural human-computer interaction for virtual personal assistant systems

Inventor: William C. Deleeuw (Beaverton, OR)
Assignee: Intel Corporation
G06F3/013G06T13/80G06V10/143G06V40/19G10L15/02G10L15/22G10L2015/025G10L2015/227G10L2015/228G10L15/30G10L21/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,099,651
App. No.
18/186,680
Granted
Sep 24, 2024
Kind
B2
Abstract

Technologies for natural language interactions with virtual personal assistant systems include a computing device configured to capture audio input, distort the audio input to produce a number of distorted audio variations, and perform speech recognition on the audio input and the distorted audio variants. The computing device selects a result from a large number of potential speech recognition results based on contextual information. The computing device may measure a user's engagement level by using an eye tracking sensor to determine whether the user is visually focused on an avatar rendered by the virtual personal assistant. The avatar may be rendered in a disengaged state, a ready state, or an engaged state based on the user engagement level. The avatar may be rendered as semitransparent in the disengaged state, and the transparency may be reduced in the ready state or the engaged state. Other embodiments are described and claimed.

Claims (30)

1. An electronic user device comprising:

a sensor to track an eye of a user; and

at least one communication circuit to:

output a first signal to cause a second device to display an avatar with an avatar eye in a first avatar eye position at a first time, the first avatar eye position based on a first position of the user eye corresponding to the first time; and

output a second signal to cause the second device to display the avatar eye in a second avatar eye position at a second time, the second avatar eye position based on a second position of the user eye corresponding to the second time, the second avatar eye position different than the first avatar eye position.

2. The electronic user device of claim 1 , wherein the sensor includes an infrared light sensor.

3. The electronic user device of claim 1 , wherein the sensor is to output a third signal corresponding to movement of a head of the user.

4. The electronic user device of claim 1 , wherein the sensor includes a camera.

5. The electronic user device of claim 1 , wherein the avatar is associated with an application installed on the electronic user device.

6. The electronic user device of claim 1 , further including a microphone.

7. The electronic user device of claim 1 , wherein the avatar has a human face appearance.

8. At least one non-transitory machine-readable storage medium comprising machine-readable instructions to cause at least one processor circuit of an electronic user device to at least:

cause, in response to a first signal, a display to present an avatar having an eye in a first avatar eye position, a gaze of the avatar eye in a first direction in the first avatar eye position, the first signal indicative of a position of an eye of a user at a first time; and

cause, in response to a second signal, the display to present the avatar eye in a second avatar eye position, the gaze of the avatar eye in a second direction in the second avatar eye position, the second direction different than the first direction, the second signal indicative of a change in the position of the eye of the user at a second time.

9. The at least one non-transitory machine-readable storage medium of claim 8 , wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to cause the display to present other content simultaneously with the avatar.

10. The at least one non-transitory machine-readable storage medium of claim 9 , wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to cause the display to present the avatar as spaced apart from the other content on the display.

11. The at least one non-transitory machine-readable storage medium of claim 8 , wherein the machine-readable instructions are to cause one or more of the at least one processor circuitry circuit to change a size of the avatar during presentation of the avatar.

12. The at least one non-transitory machine-readable storage medium of claim 8 , wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to cause the avatar to face out of the display.

13. The at least one non-transitory machine-readable storage medium of claim 8 , wherein the machine-readable instructions are to cause one or more the at least one processor circuit to cause the display to present the avatar responsive to a user input.

14. The at least one non-transitory machine-readable storage medium of claim 8 , wherein the avatar has a human face appearance.

15. An electronic user device comprising:

a sensor to track an eye of a user; and

at least one communication circuit to:

output a first signal to cause a second device to present an avatar with an avatar eye in a first avatar eye position at a first time, the first avatar eye position based on a first position of the user eye corresponding to the first time, the first avatar eye position directed toward the user; and

output a second signal to cause the second device to present the avatar eye in a second avatar eye position at a second time, the second avatar eye position based on a second position of the user eye corresponding to the second time, the second avatar eye position different than the first avatar eye position.

16. The electronic user device of claim 15 , wherein the second avatar eye position is directed away from the user.

17. The electronic user device of claim 15 , wherein the avatar eye appears closed in the second avatar eye position.

18. The electronic user device of claim 15 , wherein a face of the avatar includes human facial features.

19. The electronic user device of claim 18 , wherein the human facial features are presented as opaque.

20. The electronic user device of claim 15 , wherein the sensor is to output a third signal corresponding to movement of a head of the user.

Continuity (6)
Continuation 17532816 · Nov 22, 2021
Continuation 16902967 · Jun 16, 2020
Continuation 16257347 · Jan 25, 2019
Continuation 15452131 · Mar 7, 2017
Division 14129435
Related Publication 20230376108A1 · Nov 23, 2023
Cited By (1)
US 12,399,560