Granted Patent B2

US 12,439,106 · App. 17/966,556 · Granted Oct 7, 2025

Inventors: Dhananjay Lal (Englewood, CO); Reda Harb (Issaquah, WA)

Assignee: Adeia Guides Inc.

H04N21/2385H04N21/2402

Abstract

Claims (56)

1. A method of live broadcasting of light field media content from a capture device, comprising:

estimating an upstream bandwidth available to the capture device for uploading content in a network;

receiving, from the capture device, a request for a first service tier from a plurality of service tiers, wherein each service tier is based on a different network condition and is associated with a different respective quality level of network resources for transmission and processing of the light field media content captured by the capture device, the light field media content comprising an image array;

determining that a bandwidth associated with the first service tier is greater than the estimated upstream bandwidth;

determining a second service tier based on the estimated upstream bandwidth, wherein the second service tier is associated with a lower quality level of network resources than the first service tier;

determining parameters for reducing the image array to a reduced image array based on the second service tier, wherein determining the parameters comprises selecting a number of sub-aperture images from the image array based on maximizing feature saliency of the image array;

allocating, to the capture device, resources corresponding to the second service tier for transmission of the reduced image array; and

allocating, in a cloud system, resources corresponding to the second service tier for processing the transmitted reduced image array.

2. The method of claim 1 , further comprising:

determining the bandwidth associated with the first service tier is not greater than the estimated upstream bandwidth;

allocating, to the capture device, resources corresponding to the first service tier for transmission of the image array; and

allocating, in the cloud system, resources corresponding to the first service tier for processing the transmitted image array.

3. The method of claim 1 , further comprising:

estimating the upstream bandwidth periodically;

in response to determining a drop in the upstream bandwidth, determining the bandwidth associated with the second service tier exceeds the dropped upstream bandwidth;

determining a third service tier based on the dropped upstream bandwidth, wherein the third service tier is associated with a lower quality level of network resources than the second service tier;

determining parameters for reducing the image array to a second reduced image array;

allocating, to the capture device, resources corresponding to the third service tier for transmission of the second reduced image array; and

allocating, in the cloud system, resources corresponding to the third service tier for processing the transmitted second reduced image array.

4. The method of claim 1 ,

wherein the reduced image array comprises the selected sub-aperture images.

5. The method of claim 1 , further comprising:

selecting each of the number of sub-aperture images from the image array such that each selected sub-aperture image is adjacent to at least one other selected sub-aperture image.

6. The method of claim 1 , wherein the transmission of the reduced image array at the second service tier corresponds to a reduced cone of view of the light field media content when rendered at a display device.

7. The method of claim 6 , wherein the transmission of the reduced image array at the second service tier minimizes a loss of quality of the rendered light field media content resulting from the reduced cone of view.

8. The method of claim 6 , wherein a type of the reduced cone of view comprises at least one of a parallax in all cardinal directions, asymmetrical parallax, horizontal parallax, vertical parallax, or diagonal parallax.

9. The method of claim 8 , further comprising:

determining, for rendering at the display device, the type of the reduced cone of view based on at least one of the second service tier, maximizing feature saliency, maximizing perspective-accurate viewing, or supporting a particular parallax.

10. The method of claim 1 , wherein the resources comprise at least one of a network resource, compute resource, or storage resource.

11. The method of claim 1 , wherein the capture device is coupled to at least one of a camera or a microlens array.

12. A system for live broadcasting of light field media content from a capture device, the system comprising:

input/output circuitry configured to:

receive, from the capture device, a request for a first service tier from a plurality of service tiers, wherein each service tier is based on a different network condition and is associated with a different respective quality level of network resources for transmission and processing of the light field media content captured by the capture device, the light field media content comprising an image array; and

a control circuitry configured to:

estimate an upstream bandwidth available to the capture device for uploading content in a network;

determine that a bandwidth associated with the first service tier is greater than the estimated upstream bandwidth;

determine a second service tier based on the estimated upstream bandwidth, wherein the second service tier is associated with a lower quality level of network resources than the first service tier;

determine parameters for reducing the image array to a reduced image array based on the second service tier, wherein determining the parameters comprises selecting a number of sub-aperture images from the image array based on maximizing feature saliency of the image array;

allocate, to the capture device, resources corresponding to the second service tier for transmission of the reduced image array; and

allocate, in a cloud system, resources corresponding to the second service tier for processing the transmitted reduced image array.

13. The system of claim 12 , wherein the control circuitry is further configured to:

determine the bandwidth associated with the first service tier is not greater than the estimated upstream bandwidth;

allocate, to the capture device, resources corresponding to the first service tier for transmission of the image array; and

allocate, in the cloud system, resources corresponding to the first service tier for processing the transmitted image array.

14. The system of claim 12 , wherein the control circuitry is further configured to:

estimate the upstream bandwidth periodically;

in response to determining a drop in the upstream bandwidth, determine the bandwidth associated with the second service tier exceeds the dropped upstream bandwidth;

determine a third service tier based on the dropped upstream bandwidth, wherein the third service tier is associated with a lower quality level of network resources than the second service tier;

determine parameters for reducing the image array to a second reduced image array;

allocate, to the capture device, resources corresponding to the third service tier for transmission of the second reduced image array; and

allocate, in the cloud system, resources corresponding to the third service tier for processing the transmitted second reduced image array.

15. The system of claim 12 , wherein the reduced image array comprises the selected sub-aperture images.

16. The system of claim 12 , wherein the control circuitry is further configured to:

select each of the number of sub-aperture images from the image array such that each selected sub-aperture image is adjacent to at least one other selected sub-aperture image.

17. The system of claim 12 , wherein the transmission of the reduced image array at the second service tier corresponds to a reduced cone of view of the light field media content when rendered at a display device.

18. The system of claim 17 , wherein a type of the reduced cone of view comprises at least one of a parallax in all cardinal directions, asymmetrical parallax, horizontal parallax, vertical parallax, or diagonal parallax.

Assignments (3)

Continuity (1)

References Cited (29)