IP Library Granted Patent US 11,782,506
Granted Patent B2
US 11,782,506 · App. 17/839,878 · Granted Oct 10, 2023

Methods and systems of extended reality environment interaction based on eye motions

Inventor: Sakura Saito (Tokyo, JP)
Assignee: Rovi Guides, Inc.
G06F3/013G06T19/006G06T19/20G06V20/20G06V40/171
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,782,506
App. No.
17/839,878
Granted
Oct 10, 2023
Kind
B2
Abstract

Systems and methods are described for extended reality environment interaction. An extended reality environment including an object is generated for display, and an eye motion is detected. Based on the detecting, it is determined whether the object is in a field of view for at least a predetermined period of time, and in response to determining that the object is in the field of view for at least the predetermined period of time, one or more items related to the object are generated for display in the extended virtual reality environment.

Claims (54)

1. A computer-implemented method, comprising:

generating for display, during a extended reality session, an extended reality environment including an object;

determining, during the extended reality session, that the object is in a field of view for a first period of time, wherein the first period of time is determined using a timer and the first period of time is less than a threshold period of time;

determining, during the extended reality session, that the object is no longer in the field of view;

based on the determining that the object is no longer in the field of view, pausing the timer;

determining, during the extended reality session, that the object is again in the field of view;

based on the determining that the object is again in the field of view, resuming use of the timer;

determining that the object has been in the field of view for a second period of time since resuming the use of the timer; and

in response to determining that a combination of the first period of time and the second period of time during the extended reality session is at least the threshold period of time, generating for display in the extended reality environment one or more items related to the object.

2. The method of claim 1 , wherein the one or more items related to the object comprise textual information, one or more images, video, or any combination thereof.

3. The method of claim 1 , wherein determining that the object is in the field of view, and determining that the object is again in the field of view, further comprises determining that the object is in a gaze of a user associated with the extended reality session.

4. The method of claim 1 , wherein determining that the object is no longer in the field of view further comprises determining that the object is no longer in a gaze of a user associated with the extended reality session.

5. The method of claim 1 , wherein the threshold period of time is a first threshold period of time, the method further comprising:

determining that, during the extended reality session, at least a second threshold period of time has elapsed from commencing the display of the one or more items related to the object during which the object has not been in the field of view; and

ceasing display of the one or more items related to the object in response to determining that at least the second threshold period of time has elapsed from commencing the display of the one or more items related to the object during which the object has not been in the field of view.

6. The method of claim 1 , further comprising:

detecting an eye motion by monitoring eyelid motion of a user,

wherein each of determining that the object is in the field of view, determining that the object is no longer in the field of view, and determining that the object is again in the field of view, is based on the detecting.

7. The method of claim 1 , further comprising:

determining a new object is in the field of view for at least the threshold period of time; and

in response to determining that the new object is in the field of view for at least the predetermined period of time, generating for display in the extended reality environment one or more items related to the new object, while continuing to generate for display in the extended reality environment the one or more items related to the object.

8. The method of claim 1 , further comprising:

setting the threshold period of time based on input received from a user associated with the extended reality session.

9. The method of claim 1 , further comprising:

setting the threshold period of time based on historical data of a user associated with the extended reality session.

10. The method of claim 1 , wherein the extended reality environment is generated for display at an extended reality head-mounted device.

11. A computer-implemented system, comprising:

memory;

control circuitry configured to:

generate for display, during a extended reality session, an extended reality environment including an object, wherein the extended reality session is associated with a user profile stored in the memory;

determine, during the extended reality session, that the object is in a field of view for a first period of time, wherein the first period of time is determined using a timer and the first period of time is less than a threshold period of time;

determine, during the extended reality session, that the object is no longer in the field of view;

based on the determining that the object is no longer in the field of view, pause the timer;

determine, during the extended reality session, that the object is again in the field of view;

based on the determining that the object is again in the field of view, resume use of the timer;

determine that the object has been in the field of view for a second period of time since resuming the use of the timer; and

in response to determining that a combination of the first period of time and the second period of time during the extended reality session is at least the threshold period of time, generate for display in the extended reality environment one or more items related to the object.

12. The system of claim 11 , wherein the one or more items related to the object comprise textual information, one or more images, video, or any combination thereof.

13. The system of claim 11 , wherein the control circuitry is configured to determine that the object is in the field of view, and determine that the object is again in the field of view, by determining that the object is in a gaze of a user associated with the extended reality session.

14. The system of claim 11 , wherein the control circuitry is configured to determine that the object is no longer in the field of view by determining that the object is no longer in a gaze of a user associated with the extended reality session.

15. The system of claim 11 , wherein the threshold period of time is a first threshold period of time, and the control circuitry is further configured to:

determine that, during the extended reality session, at least a second threshold period of time has elapsed from commencing the display of the one or more items related to the object during which the object has not been in the field of view; and

cease display of the one or more items related to the object in response to determining that at least the second threshold period of time has elapsed from commencing the display of the one or more items related to the object during which the object has not been in the field of view.

16. The system of claim 11 , wherein the control circuitry is further configured to:

detect an eye motion by monitoring eyelid motion of a user,

perform each of determining that the object is in the field of view, determining that the object is no longer in the field of view, and determining that the object is again in the field of view, based on the detecting.

17. The system of claim 11 , wherein the control circuitry is further configured to:

determine a new object is in the field of view for at least the threshold period of time; and

in response to determining that the new object is in the field of view for at least the predetermined period of time, generate for display in the extended reality environment one or more items related to the new object, while continuing to generate for display in the extended reality environment the one or more items related to the object.

18. The system of claim 11 , wherein the control circuitry is further configured to:

set the threshold period of time based on input received from a user associated with the extended reality session.

19. The system of claim 11 , wherein the control circuitry is further configured to:

setting the threshold period of time based on historical data of a user associated with the extended reality session.

20. The system of claim 11 , wherein the extended reality environment is generated for display at an extended reality head-mounted device.

Assignments (3)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0392 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2022
From: SAITO, SAKURA
To: ROVI GUIDES, INC.
Reel/Frame 060381/0088 →
Continuity (2)
Continuation 17075232 · Oct 20, 2020
Related Publication 20230034712A1 · Feb 2, 2023
Cited By (3)
US 12,260,018 US 12,373,029 US 12,436,609