AVATAR CUSTOMIZATION FOR OPTIMAL GAZE DISCRIMINATION
Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically select avatar characteristics that optimize gaze perception by the user, based on context parameters associated with the virtual environment.
1 .- 18 . (canceled)
19 . A computer-implemented method for determining user intent, comprising:
tracking head pose of a user, wherein tracking head pose of a user records movement data;
extracting, using the movement data and as extracted features, features in an environment of the user;
performing eye tracking to obtain a fixation point of eyes of the user in a field-of-view of the user in a head frame;
calculating, based on a combination of the fixation point of eyes of the user and the head pose of the user, an eye gaze target point;
determining what virtual objects in the environment of the user intersect with a gaze fixation point in local space, wherein the gaze fixation point is based on the calculation of the eye gaze target point;
determining that the gaze fixation point intersects with a virtual object of the virtual objects;
extracting semantic intent directives associated with the virtual object; and
communicating the semantic intent directives associated with the virtual object to a wearable computing device of another user.
20 . The computer-implemented method of claim 19 , wherein tracking head pose of a user is performed using a wearable computing device of the user comprising a combination of an inertial measurement unit (IMU) and a camera to record rotational and translational motion of the user.
21 . The computer-implemented method of claim 19 , comprising, estimating, using the extracted features, the head pose of the user with respect to a world frame associated with the environment of the user.
22 . The computer-implemented method of claim 19 , wherein the head frame is associated with a coordinate system local to the user.
23 . The computer-implemented method of claim 19 , wherein determining what virtual objects in the environment of the user intersect with the eye gaze target point in local space includes use of static virtual scene models in a world frame associated with the environment of the user and dynamic virtual objects in the environment of the user.
24 . The computer-implemented method of claim 19 , comprising calculating the gaze fixation point with respect to a world frame associated with the environment of the user and a ray direction in the world frame.
25 . The computer-implemented method of claim 19 , wherein the virtual object intersected by the gaze fixation point is classified as an object of interest.
26 . A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform one or more operations, comprising:
tracking head pose of a user, wherein tracking head pose of a user records movement data;
extracting, using the movement data and as extracted features, features in an environment of the user;
performing eye tracking to obtain a fixation point of eyes of the user in a field-of-view of the user in a head frame;
calculating, based on a combination of the fixation point of eyes of the user and the head pose of the user, an eye gaze target point;
determining what virtual objects in the environment of the user intersect with a gaze fixation point in local space, wherein the gaze fixation point is based on the calculation of the eye gaze target point;
determining that the gaze fixation point intersects with a virtual object of the virtual objects;
extracting semantic intent directives associated with the virtual object; and
communicating the semantic intent directives associated with the virtual object to a wearable computing device of another user.
27 . The non-transitory, computer-readable medium of claim 26 , wherein tracking head pose of a user is performed using a wearable computing device of the user comprising a combination of an inertial measurement unit (IMU) and a camera to record rotational and translational motion of the user.
28 . The non-transitory, computer-readable medium of claim 26 , comprising, estimating, using the extracted features, the head pose of the user with respect to a world frame associated with the environment of the user.
29 . The non-transitory, computer-readable medium of claim 26 , wherein the head frame is associated with a coordinate system local to the user.
30 . The non-transitory, computer-readable medium of claim 26 , wherein determining what virtual objects in the environment of the user intersect with the eye gaze target point in local space includes use of static virtual scene models in a world frame associated with the environment of the user and dynamic virtual objects in the environment of the user.
31 . The non-transitory, computer-readable medium of claim 26 , comprising calculating the gaze fixation point with respect to a world frame associated with the environment of the user and a ray direction in the world frame.
32 . The non-transitory, computer-readable medium of claim 26 , wherein the virtual object intersected by the gaze fixation point is classified as an object of interest.
33 . A computer-implemented system, comprising:
one or more computers; and
one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations, comprising:
tracking head pose of a user, wherein tracking head pose of a user records movement data;
extracting, using the movement data and as extracted features, features in an environment of the user;
performing eye tracking to obtain a fixation point of eyes of the user in a field-of-view of the user in a head frame;
calculating, based on a combination of the fixation point of eyes of the user and the head pose of the user, an eye gaze target point;
determining what virtual objects in the environment of the user intersect with a gaze fixation point in local space, wherein the gaze fixation point is based on the calculation of the eye gaze target point;
determining that the gaze fixation point intersects with a virtual object of the virtual objects;
extracting semantic intent directives associated with the virtual object; and
communicating the semantic intent directives associated with the virtual object to a wearable computing device of another user.
34 . The computer-implemented system of claim 33 , wherein tracking head pose of a user is performed using a wearable computing device of the user comprising a combination of an inertial measurement unit (IMU) and a camera to record rotational and translational motion of the user.
35 . The computer-implemented system of claim 33 , comprising, estimating, using the extracted features, the head pose of the user with respect to a world frame associated with the environment of the user.
36 . The computer-implemented system of claim 33 , wherein the head frame is associated with a coordinate system local to the user.
37 . The computer-implemented system of claim 33 , wherein determining what virtual objects in the environment of the user intersect with the eye gaze target point in local space includes use of static virtual scene models in a world frame associated with the environment of the user and dynamic virtual objects in the environment of the user.
38 . The computer-implemented system of claim 33 , comprising calculating the gaze fixation point with respect to a world frame associated with the environment of the user and a ray direction in the world frame.