IP Library › Granted Patent US 11,979,630
Granted Patent B2
US 11,979,630 · App. 17/539,620 · Granted May 7, 2024

Augmented reality display for content consumption based on field of view

Inventors: Saloni Sharma (Rajasthan, IN); Greeshma Jagadha Phani Lakshmi Alapati (Andhra Pradesh, IN); Harshith Kumar Gejjegondanahally Sreekanth (Karnataka, IN); Ishan Bhadula (Uttarakhand, IN); Simranjeet Gill (Punjab, IN); Sourabh Kumar (Bihar, IN); Srikanth Channapragada (Karnataka, IN); Vivek Sehgal (Uttar Pradesh, IN); Reda Harb (Bellevue, IN)
Assignee: Rovi Guides, Inc.
H04N21/4222G06F3/013G06F3/0481G06F3/04847G06F3/14G06T11/00H04N21/4126H04N21/4363H04N21/472
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,979,630
App. No.
17/539,620
Granted
May 7, 2024
Kind
B2
Abstract

Systems and methods are presented herein for generating an augmented reality (“AR”) display with user interface (“UI”) elements that respond to changes in pupil characteristics in response to detecting device streaming content. A media stream playing on a device that is within a threshold distance of the AR device is detected. The source of the media stream is identified. The AR device queries the source of the media stream for a consumption option. An AR overlay is generated and comprises selectable UI elements corresponding to the consumption options. In response to receiving an input at a UI element, the AR overlay is generated based on the consumption option.

Claims (86)

1. A method, comprising:

detecting a first media stream playing on a first device that is within a threshold distance of an augmented reality (“AR”) device;

detecting a second media stream playing on a second device that is within the threshold distance of the AR device;

accessing a first piece of subject matter data related to the first media stream and a second piece of subject matter data related to the second media stream;

accessing a profile associated with a user, wherein the profile comprises viewing history data related to the user;

calculating a first score for the first media stream being played on the first device, wherein the first score is calculated based on the viewing history data and the first piece of subject matter data;

calculating a second score for the second media stream being played on the second device, wherein the second score is calculated based on the viewing history data and the second piece of subject matter data;

selecting the first media stream based on the first score and the second score;

identifying, using the AR device, a content server associated with the first media stream being played on the first device;

querying, using the AR device, the content server associated with the first media stream for a consumption option for the first media stream in response to identifying the content server associated with the first media stream being played on the first device;

receiving the consumption option from the content server associated with the first media stream;

receiving a parameter from the content server associated with the first media stream;

generating, using the AR device, a first AR overlay that comprises at least one user interface (“UI”) element that corresponds to the consumption option for the first media stream, wherein at least a portion of the AR overlay is associated with the parameter from the content server associated with the first media stream;

receiving an input corresponding to an interaction with the at least one UI element; and

in response to receiving the input, performing one or more of:

modifying the playing of the first media stream playing on the first device based on the consumption option; and

generating, using the AR device, a second AR overlay related to the consumption option.

2. The method of claim 1 , wherein the first media stream playing on the first device is within a field of view of the AR device.

3. The method of claim 1 , wherein detecting the first media stream playing on the first device that is within the threshold distance of the AR device comprises:

determining a first location of the AR device;

determining a second location of the first device playing the first media stream;

determining a distance between the first location and the second location; and

comparing the distance to the threshold distance.

4. The method of claim 1 , wherein detecting the first media stream playing on the first device that is within the threshold distance of the AR device comprises:

activating a local communication network at the AR device;

determining a distance corresponding to at least one device responsive to the local communication network based on a response corresponding to the at least one device; and

comparing the distance to the threshold distance.

5. The method of claim 1 , wherein identifying, using the AR device, the content server associated with the first media stream comprises identifying the content server based on metadata associated with the first media stream.

6. The method of claim 1 , wherein the at least one UI element comprises at least one identifier, wherein the at least one identifier is associated with at least one content item available via the first media stream.

7. The method of claim 6 , wherein the at least one identifier comprises at least one of an image corresponding to content available via the first media stream, a portion of at least one video available via the first media stream, and at least one identifier of the content server associated with the first media stream.

8. The method of claim 1 , wherein the consumption option comprises at least one of controlling the first media stream on the first device, modifying display options corresponding to the first media stream on the first device, controlling the first media stream on the AR device, and modifying display options corresponding to the first media stream on the AR device.

9. The method of claim 1 , wherein receiving the input corresponding to the interaction with the at least one UI element comprises:

determining at least one pupil is within a threshold distance of the AR device;

determining a first iteration of a pupil characteristic, wherein the first iteration corresponds to a first time stamp;

determining a second iteration of the pupil characteristic, wherein the second iteration corresponds to a second time stamp later than the first time stamp;

comparing the first iteration to the second iteration;

in response to determining the first iteration is different from the second iteration, comparing a magnitude of difference to an input deviation threshold; and

in response to determining the magnitude meets or exceeds the input threshold, generating an executable instruction based on the at least one UI element corresponding to the pupil characteristic.

10. The method of claim 9 , wherein the pupil characteristic comprises at least one of a pupil size, a blink rate, and a light reflection magnitude.

11. The method of claim 1 , wherein modifying the playing of the first media stream playing on the first device based on the consumption option comprises executing a modification instruction based on the consumption option.

12. The method of claim 11 , wherein the modification instruction comprises at least one of a playback command, a caption setting modification, and an interface display modification.

13. The method of claim 1 , further comprising:

generating for display an interface, wherein the interface comprises the at least one UI element, wherein each of the at least one UI elements corresponds to at least one of a display setting or content available for consumption;

determining that a pupil corresponding to a user is within a threshold distance of the interface;

detecting at least one pupil characteristic of the pupil;

determining, based on the pupil characteristic, at least one modification for the interface; and

modifying the interface based on the at least one modification.

14. A system comprising:

input/output circuitry configured to:

receive an input corresponding to an interaction with at least one user interface (“UI”) element;

control circuitry configured to:

detect a first media stream playing on a first device that is within a threshold distance of an augmented reality (“AR”) device;

detect a second media stream playing on a second device that is within the threshold distance of the AR device;

access a first piece of subject matter data related to the first media stream and a second piece of subject matter data related to the second media stream;

access a profile associated with a user, wherein the profile comprises viewing history data related to the user;

calculate a first score for the first media stream being played on the first device, wherein the first score is calculated based on the viewing history data and the first piece of subject matter data;

calculate a second score for the second media stream being played on the second device, wherein the second score is calculated based on the viewing history data and the second piece of subject matter data;

select the first media stream based on the first score and the second score;

identify a content server associated with the first media stream being played on the first device;

query the content server associated with the first media stream for a consumption option for the first media stream in response to identifying the content server associated with the first media stream being played on the first device;

receive the consumption option from the content server associated with the first media stream;

receive at least one parameter from the content server associated with the first media stream;

generate a first AR overlay that comprises at least one UI element that corresponds to the consumption option for the first media stream, wherein at least a portion of the AR overlay is associated with the parameter from the content server associated with the first media stream; and

in response to receiving the input, perform one or more of:

modifying the playing of the first media stream playing on the first device based on the consumption option; and

generating a second AR overlay related to the consumption option.

15. The system of claim 14 , wherein the at least one UI element comprises at least one identifier, wherein the at least one identifier is associated with at least one content item available via the first media stream.

16. The system of claim 14 , wherein the consumption option comprises at least one of controlling the first media stream on the first device, modifying display options corresponding to the first media stream on the first device, controlling the first media stream on the AR device, and modifying display options corresponding to the first media stream on the AR device.

17. A non-transitory computer-readable medium having non-transitory computer-readable instructions encoded thereon for generating an augmented reality (“AR”) overlay which, when executed by control circuitry, causes the control circuitry to:

receive an input corresponding to an interaction with at least one user interface (“UI”) element;

detect a first media stream playing on a first device that is within a threshold distance of an AR device;

detect a second media stream playing on a second device that is within the threshold distance of the AR device;

access a first piece of subject matter data related to the first media stream and a second piece of subject matter data related to the second media stream;

access a profile associated with a user, wherein the profile comprises viewing history data related to the user;

calculate a first score for the first media stream being played on the first device, wherein the first score is calculated based on the viewing history data and the first piece of subject matter data;

calculate a second score for the second media stream being played on the second device, wherein the second score is calculated based on the viewing history data and the second piece of subject matter data;

select the first media stream based on the first score and the second score;

identify a content server associated with the first media stream being played on the first device;

query the content server associated with the first media stream for a consumption option for the first media stream in response to identifying the content server associated with the first media stream being played on the first device;

receive the consumption option from the content server associated with the first media stream;

receive at least one parameter from the content server associated with the first media stream;

generate a first AR overlay that comprises at least one UI element that corresponds to the consumption option for the first media stream, wherein at least a portion of the AR overlay is associated with the parameter from the content server associated with the first media stream;

receive an input corresponding to an interaction with at least one UI element; and

in response to receiving the input, perform one or more of:

modifying the playing of the stream playing on the first device based on the consumption option; and

generating a second AR overlay related to the consumption option.

Assignments (3)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0406 →
SECURITY INTEREST Recorded May 19, 2023
From: ADEIA GUIDES INC.; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063707/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2021
From: SHARMA, SALONI; ALAPATI, GREESHMA JAGADHA PHANI LAKSHMI; SREEKANTH, HARSHITH KUMAR GEJJEGONDANAHALLY; BHADULA, ISHAN; GILL, SIMRANJEET; KUMAR, SOURABH; CHANNAPRAGADA, SRIKANTH; SEHGAL, VIVEK; HARB, REDA
To: ROVI GUIDES, INC.
Reel/Frame 058307/0182 →
Continuity (1)
Related Publication 20230171456A1 · Jun 1, 2023
Cited By (2)
US 12,561,918 US 12,675,957