IP Library › Granted Patent US 11,638,061
Granted Patent B1
US 11,638,061 · App. 17/539,623 · Granted Apr 25, 2023

Augmented reality display for content consumption relative to a field of view

Inventors: Saloni Sharma (Rajasthan, IN); Greeshma Jagadha Phani Lakshmi Alapati (Andhra Pradesh, IN); Harshith Kumar Gejjegondanahally Sreekanth (Karnataka, IN); Ishan Bhadula (Uttarakhand, IN); Simranjeet Gill (Punjab, IN); Sourabh Kumar (Bihar, IN); Srikanth Channapragada (Karnataka, IN); Vivek Sehgal (Uttar Pradesh, IN); Reda Harb (Bellevue, WA)
Assignee: ROVI GUIDES, INC.
H04N21/4312G06F3/013H04N21/4126H04N21/4363H04N21/4516H04N21/472
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,638,061
App. No.
17/539,623
Filed
Dec 1, 2021
Granted
Apr 25, 2023
Kind
B1
Art Unit
2422
USPC
725/38
Abstract

Systems and methods are presented herein for generating an augmented reality (“AR”) display with user interface (“UI”) elements that respond to changes in pupil characteristics in response to detecting device streaming content. A media stream playing on a device that is within a threshold distance of the AR device is detected. The source of the media stream is identified. The AR device queries the source of the media stream for a consumption option. An AR overlay is generated and comprises selectable UI elements corresponding to the consumption options. In response to receiving an input at a UI element, the AR overlay is generated based on the consumption option.

Claims (66)

1. A method, comprising:

detecting a media stream playing on a device that is outside a field of view of an augmented reality (“AR”) device;

identifying the device receiving the media stream;

in response to identifying the device receiving the media stream, generating at least one user interface (“UI”) element on a display that corresponds to the AR device, wherein the at least one UI element conveys information corresponding to content available via the media stream;

receiving an input corresponding to the at least one UI element; and

in response to receiving the input, generating an AR overlay that comprises a mirror of the media stream playing on the device, wherein the AR overlay comprises at least one UI element corresponding to an instruction to control display of the media stream on at least one of the device and the AR device.

2. The method of claim 1 , wherein detecting the media stream playing on the device that is outside the field of view of the AR device comprises:

activating a first local communication network at the AR device;

determining at least one device is responsive to the first local communication network based on a response corresponding to the at least one device; and

identifying the media stream playing on the at least one device.

3. The method of claim 1 , wherein identifying the device receiving the media stream comprises retrieving a device identifier corresponding to the device receiving the media stream based on at least one of metadata associated with the device receiving the media stream and metadata associated with the media stream.

4. The method of claim 1 , wherein identifying the device receiving the media stream comprises:

identifying a content provider associated with the media stream;

identifying a plurality of devices within a threshold distance of the AR device;

retrieving profile information for each of the plurality of devices;

determining, based on the profile information, which of the plurality of devices is associated with the content provider; and

in response to determining which of the plurality of devices is associated with the content provider, identifying the device from the plurality of devices that is receiving the media stream.

5. The method of claim 4 , wherein identifying the plurality of devices within the threshold distance of the AR device comprises:

activating a local communication network at the AR device;

determining a distance corresponding to each of the plurality of devices based on a response associated with a connection to the local communication network corresponding to each of the plurality of devices; and

comparing the distance to the threshold distance.

6. The method of claim 1 , wherein the at least one UI element comprises at least one of a maturity rating, a content stream identifier, a content source identifier, and a user profile identifier.

7. The method of claim 1 , wherein the at least one UI element comprises at least one of a portion of at least one video available via the media stream and at least one image corresponding to content available via the media stream.

8. The method of claim 1 , wherein receiving the input corresponding to the at least one UI element comprises:

determining at least one pupil is within an input threshold distance of the AR device;

determining a first iteration of a pupil characteristic, wherein the first iteration corresponds to a first time stamp;

determining a second iteration of the pupil characteristic, wherein the second iteration corresponds to a second time stamp later than the first time stamp;

comparing the first iteration to the second iteration;

in response to determining the first iteration is different from the second iteration, comparing a magnitude of difference to an input deviation threshold; and

in response to determining the magnitude meets or exceeds the input deviation threshold, generating an executable instruction based on the at least one UI element corresponding to the pupil characteristic.

9. The method of claim 8 , wherein the pupil characteristic comprises at least one of a pupil size, a blink rate, and a light reflection magnitude.

10. The method of claim 1 , wherein the AR overlay further comprises at least one UI element which, when associated with the input, is configured to generate an instruction for modifying display of the media stream on at least one of the device and the AR device.

11. A system comprising:

input/output circuitry configured to:

receive an input corresponding to at least one UI element;

control circuitry configured to:

detect a media stream playing on a device that is outside a field of view of an augmented reality (“AR”) device;

identify the device receiving the media stream;

in response to identifying the device receiving the media stream, generate at least one user interface (“UI”) element on a display that corresponds to the AR device, wherein the at least one UI element conveys information corresponding to content available via the media stream; and

in response to receiving the input, generate an AR overlay that comprises a mirror of the media stream playing on the device, wherein the AR overlay comprises at least one UI element corresponding to an instruction to control display of the media stream on at least one of the device and the AR device.

12. The system of claim 11 , wherein the control circuitry configured to detect the media stream playing on the device that is outside the field of view of the AR device is further configured to:

activate a first local communication network at the AR device;

determine at least one device is responsive to the first local communication network based on a response corresponding to the at least one device; and

identify the media stream playing on the at least one device.

13. The system of claim 11 , wherein the control circuitry configured to identify the device receiving the media stream is further configured to retrieve a device identifier corresponding to the device receiving the media stream based on at least one of metadata associated with the device receiving the media stream and metadata associated with the media stream.

14. The system of claim 11 , wherein the control circuitry configured to identify the device receiving the media stream is further configured to:

identify a content provider associated with the media stream;

identify a plurality of devices within a threshold distance of the AR device;

retrieve profile information for each of the plurality of devices;

determine, based on the profile information, which of the plurality of devices is associated with the content provider; and

in response to determining which of the plurality of devices is associated with the content provider, identify the device from the plurality of devices that is receiving the media stream.

15. The system of claim 11 , wherein the at least one UI element comprises at least one of a maturity rating, a content stream identifier, a content source identifier, and a user profile identifier.

16. The system of claim 11 , wherein the at least one UI element comprises at least one of a portion of at least one video available via the media stream and at least one image corresponding to content available via the media stream.

17. The system of claim 11 , wherein the input/output circuitry configured to receive the input corresponding to the at least one UI element is further configured to:

determine at least one pupil is within an input threshold distance of the AR device;

determine a first iteration of a pupil characteristic, wherein the first iteration corresponds to a first time stamp;

determine a second iteration of the pupil characteristic, wherein the second iteration corresponds to a second time stamp later than the first time stamp;

compare the first iteration to the second iteration;

in response to determining the first iteration is different from the second iteration, compare a magnitude of difference to an input deviation threshold; and

in response to determining the magnitude meets or exceeds the input deviation threshold, generate an executable instruction based on the at least one UI element corresponding to the pupil characteristic.

18. A non-transitory computer-readable medium having non-transitory computer-readable instructions encoded thereon for generating an augmented reality (“AR”) overlay which, when executed by control circuitry, causes the control circuitry to:

detect a media stream playing on a device that is outside a field of view of an AR device;

identify the device receiving the media stream;

in response to identifying the device receiving the media stream, generate at least one user interface (“UI”) element on a display that corresponds to the AR device, wherein the at least one UI element conveys information corresponding to content available via the media stream;

receive an input corresponding to at least one UI element; and

in response to receiving the input, generate an AR overlay that comprises a mirror of the media stream playing on the device, wherein the AR overlay comprises at least one UI element corresponding to an instruction to control display of the media stream on at least one of the device and the AR device.

Assignments (3)
CHANGE OF NAME Recorded Oct 4, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069113/0406 →
SECURITY INTEREST Recorded May 19, 2023
From: ADEIA GUIDES INC.; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063707/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2021
From: SHARMA, SALONI; ALAPATI, GREESHMA JAGADHA PHANI LAKSHMI; SREEKANTH, HARSHITH KUMAR GEJJEGONDANAHALLY; BHADULA, ISHAN; GILL, SIMRANJEET; KUMAR, SOURABH; CHANNAPRAGADA, SRIKANTH; SEHGAL, VIVEK; HARB, REDA
To: ROVI GUIDES, INC.
Reel/Frame 058307/0217 →
Cited By (2)
US 12,301,914 US 12,657,742