Granted Patent B2

US 12,212,730 · App. 18/207,815 · Granted Jan 28, 2025

Inventors: Ishan Bhadula (Uttarakhand, IN); Vivek Sehgal (Uttar Pradesh, IN); Greeshma Jagadha Phani Lakshmi Alapati (Andhra Pradesh, IN); Srikanth Channapragada (Karnataka, IN); Reda Harb (Issaquah, WA)

Assignee: Adeia Guides Inc.

H04N13/117H04L65/70H04N13/161H04N13/178H04N21/25891H04N21/812H04N21/84

Abstract

Claims (82)

1. A method comprising:

receiving a spherical media content item comprising a plurality of tiles;

determining a user preference for a scene type in the spherical media content item, wherein the user preference is based on a plurality of users;

identifying, based on the user preference, a subset of the plurality of tiles;

predicting, based on the identified subset of tiles, a viewport to be generated for display at a computing device;

identifying, based on the predicted viewport to be generated for display, a first subset of tiles to be transmitted to a computing device at a first resolution;

encoding, at a first priority, the first subset of tiles at the first resolution, wherein tiles that are not included in the first subset of tiles are encoded at a second priority, and wherein the second priority is lower than the first priority; and

transmitting, to the computing device, the first subset of tiles at the first resolution.

2. The method of claim 1 , further comprising:

identifying, based on the predicted viewport to be generated for display, a second subset of tiles to be received at the computing device at a second resolution, wherein the first resolution is higher than the second resolution; and

receiving, at the computing device, the second subset of tiles at the second resolution.

3. The method of claim 1 , further comprising:

determining a user preference for a character in the spherical media content item; and

assigning each tile that depicts the character as a tile of interest, wherein the assigning is based at least in part on using facial recognition to track the character throughout the spherical media content item.

4. The method of claim 1 , wherein:

metadata is associated with the spherical media content item; and

identifying the subset of the plurality of tiles is further based on the metadata associated with the spherical media content item.

5. The method of claim 1 , further comprising:

identifying an advertisement;

associating the advertisement with the first tile;

transmitting, to the computing device, the advertisement;

generating, at the computing device, the advertisement for display; and

determining, based on input from a sensor of the computing device, an effectiveness of the advertisement.

6. The method of claim 1 , further comprising:

associating the determined user preference for the scene type with the computing device;

adding the computing device to a group of computing devices, wherein the group is based on the determined user preference for the scene type associated with the computing device; and wherein:

transmitting the first subset of tiles at the first resolution further comprises transmitting the first subset of tiles to the computing devices of the group of computing devices.

7. The method of claim 1 , further comprising:

identifying, based on the predicted viewport, an other subset of the plurality of tiles of the spherical media content;

transmitting the other subset of the plurality of tiles of the spherical media content to the computing device; and

identifying at least one incomplete viewport comprising a tile not transmitted to the computing device; and, if the predicted viewport is within a threshold number of tiles of the incomplete viewport:

generating a notification for display.

8. The method of claim 1 , wherein, in response to a request from a streaming server:

a viewport prediction server determines the user preference for the scene type;

the user preference for the scene type is transmitted, from the viewport prediction server, to an encoder;

wherein the encoder:

identifies the subset of the plurality of tiles;

predicts, based on the identified subset of the plurality of tiles, the viewport to be generated for display;

identifies, based on the predicted viewport to be generated for display, the first subset of tiles to be transmitted at the first resolution; and

encodes, at the first priority, the first subset of tiles at the first resolution.

9. The method of claim 1 , wherein the identifying the first subset of tiles to be transmitted to the computing device at the first resolution is further based on a status of the computing device receiving the subset of tiles.

10. A system comprising:

input/output circuitry configured to:

receive a spherical media content item comprising a plurality of tiles;

processing circuitry configured to:

determine a user preference for a scene type in the spherical media content item, wherein the user preference is based on a plurality of users;

identify, based on the user preference, a subset of the plurality of tiles;

predict, based on the identified subset of tiles, a viewport to be generated for display at a computing device;

identify, based on the predicted viewport to be generated for display, a first subset of tiles to be transmitted to the computing device at a first resolution;

encode, at a first priority, the first subset of tiles at the first resolution, wherein tiles that are not included in the first subset of tiles are encoded at a second priority, and wherein the second priority is lower than the first priority; and

transmit, to the computing device, the first subset of tiles at the first resolution.

11. The system of claim 10 , wherein the processing circuitry is further configured to:

identify, based on the predicted viewport to be generated for display, a second subset of tiles to be received at the computing device at a second resolution, wherein the first resolution is higher than the second resolution; and

receive at the computing device, the second subset of tiles at the second resolution.

12. The system of claim 10 , wherein the control circuitry is further configured to:

determine a user preference for a character in the spherical media content item; and

assign each tile that depicts the character as a tile of interest wherein the assigning is based at least in part on using facial recognition to track the character throughout the spherical media content item.

13. The system of claim 10 , wherein:

metadata is associated with the spherical media content item; and

the processing circuitry configured to identify the subset of the plurality of tiles is further configured to identify the subset of the plurality of tiles based on the metadata associated with the spherical media content item.

14. The system of claim 10 , wherein the processing circuitry is further configured to:

identify an advertisement;

associate the advertisement with the first tile;

transmit, to the computing device, the advertisement;

generate, at the computing device, the advertisement for display; and

determine, based on input from a sensor of the computing device, an effectiveness of the advertisement.

15. The system of claim 10 , wherein the processing circuitry is further configured to:

associate the determined user preference for the scene type with the computing device;

add the computing device to a group of computing devices, wherein the group is based on the determined user preference for the scene type associated with the computing device; and wherein:

the processing circuitry configured to transmit the first subset of tiles at the first resolution is further configured to transmit the first subset of tiles to the computing devices of the group of computing devices.

16. The system of claim 10 , wherein the processing circuitry is further configured to:

identify, based on the predicted viewport, another subset of the plurality of tiles of the spherical media content;

transmit the another subset of the plurality of tiles of the spherical media content to the computing device; and

identify at least one incomplete viewport comprising a tile not transmitted to the computing device; and, if the predicted viewport is within a threshold number of tiles of the incomplete viewport:

generate a notification for display.

17. The system of claim 10 , wherein, in response to a request from a streaming server, the processing circuitry is further configured to:

determine, at a viewport prediction server, the user preference for the scene type;

transmit, from the viewport prediction server to an encoder, the user preference for the scene type;

identify, via the encoder, the subset of the plurality of tiles;

predict, via the encoder and based on the identified subset of the plurality tiles, the viewport to be generated for display;

identify, via the encoder and based on the predicted viewport to be generated for display, the first subset of tiles to be transmitted at the first resolution; and

encode, at the encoder and at the first priority, the first subset of tiles at the first resolution.

Assignments (2)

Continuity (2)

References Cited (21)