IP Library › Granted Patent US 12,182,924
Granted Patent B2
US 12,182,924 · App. 18/054,802 · Granted Dec 31, 2024

3D gaze point for avatar eye animation

Inventors: Daniel Johansson Tornéus (Danderyd, SE); Johan Bouvin (Mountain View, CA)
Assignee: Tobii AB
G06T13/40G06F3/012G06F3/013
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,182,924
App. No.
18/054,802
Granted
Dec 31, 2024
Kind
B2
Abstract

Systems and methods for avatar eye animation is provided. The method include obtaining a first gaze vector of a user associated with a first eye of the user and obtaining a second gaze vector of the user associated with a second eye of the user. The method further includes determining a first point in a three-dimensional (3D) virtual space that the user is looking toward. The method also includes creating a second point in the 3D virtual space corresponding to the first point in the 3D virtual space. The method then includes rendering a first eye and a second eye of an avatar of the user in the 3D virtual space based on the second point in the 3D virtual space such that the first eye and the second eye of the avatar are looking toward the second point in the 3D virtual space.

Claims (61)

1. A method for avatar eye animation comprising:

obtaining a first gaze vector of a user associated with a first eye of the user;

obtaining a second gaze vector of the user associated with a second eye of the user;

determining a first point in a three-dimensional (3D) virtual space that the user is looking toward;

creating a second point in the 3D virtual space corresponding to the first point in the 3D virtual space; and

rendering a first eye and a second eye of an avatar of the user in the 3D virtual space based on the second point in the 3D virtual space such that the first eye and the second eye of the avatar are looking toward the second point in the 3D virtual space.

2. The method of claim 1 , wherein determining the first point in the 3D virtual space comprises:

obtaining a combined gaze vector of the user based on the first gaze vector of the user and the second gaze vector of the user;

detecting a convergence distance of the user; and

determining the first point in the 3D virtual space based on the combined gaze vector of the user and the convergence distance of the user.

3. The method of claim 2 , wherein the convergence distance of the user is no smaller than a predetermined convergence distance.

4. The method of claim 3 , wherein the predetermined convergence distance is 50 cm.

5. The method of claim 1 , wherein determining the first point in the 3D virtual space comprises:

obtaining a combined gaze vector of the user based on the first gaze vector of the user and the second gaze vector of the user;

determining a point of impact where the combined gaze vector extends and intersects with an object in the 3D virtual space; and

setting the point of impact as the first point in the 3D virtual space.

6. The method of claim 5 , wherein the object in the 3D virtual space is one of a group of pre-selected objects in the 3D virtual space.

7. The method of claim 1 , wherein determining the first point in the 3D virtual space comprises:

determining a point of close intersection where a first extension line of the first gaze vector and a second extension line of the second gaze vector are closest to each other in the 3D virtual space; and

setting the point of close intersection as the first point in the 3D virtual space.

8. The method of claim 1 , wherein determining the first point in the 3D virtual space comprises:

determining a head direction of the user;

determining a closest avatar in the 3D virtual space to an extension line of the head direction;

determining a central point between two eyes of the closest avatar; and

setting the central point as the first point in the 3D virtual space.

9. The method of claim 8 , wherein the closest avatar is chosen from a first group of avatars with a distance to the avatar of the user below a predetermined distance.

10. The method of claim 1 , wherein the second point in the 3D virtual space is the first point in the 3D virtual space.

11. The method of claim 1 , wherein the second point in the 3D virtual space and the first point in the 3D virtual space are different.

12. A system for avatar eye animation comprising:

an eye tracking device operable to:

obtain a first gaze vector of a user associated with a first eye of the user; and

obtain a second gaze vector of the user associated with a second eye of the user; and

a computing device operable to cooperate with the eye tracking device to receive the first gaze vector of the user and the second gaze vector of the user and control the system to:

determine a first point in a three-dimensional (3D) virtual space that the user is looking toward;

create a second point in the 3D virtual space corresponding to the first point in the 3D virtual space; and

render a first eye and a second eye of an avatar of the user in the 3D virtual space based on the second point in the 3D virtual space such that the first eye and the second eye of the avatar are looking toward the second point in the 3D virtual space.

13. The system of claim 12 , wherein to determine the first point in the 3D virtual space comprises:

to obtain a combined gaze vector of the user based on the first gaze vector of the user and the second gaze vector of the user;

to detect a convergence distance of the user; and

to determine the first point in the 3D virtual space based on the combined gaze vector of the user and the convergence distance of the user.

14. The system of claim 13 , wherein the convergence distance of the user is no smaller than a predetermined convergence distance.

15. The system of claim 12 , wherein to determine the first point in the 3D virtual space comprises:

to obtain a combined gaze vector of the user based on the first gaze vector of the user and the second gaze vector of the user;

to determine a point of impact where the combined gaze vector extends and intersects with an object in the 3D virtual space; and

to set the point of impact as the first point in the 3D virtual space.

16. The system of claim 15 , wherein the object in the 3D virtual space is one of a group of pre-selected objects in the 3D virtual space.

17. The system of claim 12 , wherein to determine the first point in the 3D virtual space comprises:

to determine a point of close intersection where a first extension line of the first gaze vector and a second extension line of the second gaze vector are closest to each other in the 3D virtual space; and

to set the point of close intersection as the first point in the 3D virtual space.

18. The system of claim 12 , further comprising:

a movement detection system operable to determine a head direction of the user.

19. The system of claim 18 , wherein to determine the first point in the 3D virtual space comprises:

to determine a closest avatar in the 3D virtual space to an extension line of the head direction;

to determine a central point between two eyes of the closest avatar; and

to set the central point as the first point in the 3D virtual space.

20. A non-transitory computer-readable storage media, wherein a computer program is stored in the non-transitory computer-readable storage media, and a processor executes the computer program to:

obtaining a first gaze vector of a user associated with a first eye of the user;

obtaining a second gaze vector of the user associated with a second eye of the user;

determining a first point in a three-dimensional (3D) virtual space that the user is looking toward;

creating a second point in the 3D virtual space corresponding to the first point in the 3D virtual space; and

rendering a first eye and a second eye of an avatar of the user in the 3D virtual space based on the second point in the 3D virtual space such that the first eye and the second eye of the avatar are looking toward the second point in the 3D virtual space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2022
From: TORNÉUS, DANIEL JOHANSSON; BOUVIN, JOHAN
To: TOBII AB
Reel/Frame 061817/0947 →
Continuity (1)
Related Publication 20240161374A1 · May 16, 2024