IP Library Granted Patent US 11,025,993
Granted Patent B2
US 11,025,993 · App. 16/618,793 · Granted Jun 1, 2021

360-degree video delivery over next generation network

Inventors: Yong He (San Diego, CA); Yan Ye (San Diego, CA)
Assignee: VID SCALE, Inc.
H04N21/816H04L65/60H04L65/80H04L67/02H04N21/21805H04N21/44H04N21/472H04N21/6587H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,025,993
App. No.
16/618,793
Granted
Jun 1, 2021
Kind
B2
Abstract

Systems, methods, and instrumentalities are disclosed for a 360-degree video streaming. A video streaming device may receive a 360-degree video stream from a network node. The video streaming device may determine a viewport associated with the video streaming device and/or the 360-degree video stream. The video streaming device may determine (e.g., based on the viewport} to request in advance a first segment and a second segment of the 360-degree video stream. The video streaming device may determine a relative priority order for the first segment and the second segment. The video streaming device may generate an anticipated requests message. The anticipated requests message may indicate the determined relative priority order, for example, by listing the first segment and the second segment in decreasing relative priority based on the determined relative priority order. The video streaming device may send the anticipated requests message to the network node.

Claims (44)

1. A video streaming device comprising:

a memory; and

a processor configured to:

receive, from a network node, a 360-degree video stream;

determine a viewport associated with the video streaming device and the 360-degree video stream;

determine, based on the viewport, to request in advance a first segment of the 360-degree video stream and a second segment of the 360-degree video stream;

determine a relative priority order for the first segment and the second segment;

generate an anticipated requests message that indicates the determined relative priority order by listing the first segment and the second segment in decreasing relative priority based on the determined relative priority order; and

send, to the network node, the anticipated requests message.

2. The video streaming device of claim 1 , wherein the relative priority order is determined by determining a first priority for the first segment and a second priority for the second segment based on one or more of a time preference, a quality preference, or a location relative to the viewport.

3. The video streaming device of claim 1 , wherein the viewport is a spatial region of the 360-degree video stream that is being presented to a user of the video streaming device.

4. The video streaming device of claim 1 , wherein the viewport is determined based on an orientation of the video streaming device.

5. The video streaming device of claim 1 , wherein the 360-degree video stream comprises a plurality of temporal frames, wherein each temporal frame of the 360-degree video stream is partitioned into a plurality of tiles.

6. The video streaming device of claim 5 , wherein the first segment is a first tile of a frame of the plurality of temporal frames of the 360-degree video stream and the second segment is a second tile of the frame of the plurality of temporal frames of the 360-degree video stream.

7. The video streaming device of claim 1 , wherein the processor is further configured to determine to request in advance a third segment of the 360-degree video stream and a fourth segment of the 360-degree video stream, wherein the determined relative priority order is determined for the first segment, the second segment, the third segment, and the fourth segment, and wherein the anticipated requests message indicates the determined relative priority order by listing the first segment, the second segment, the third segment, and the fourth segment in decreasing relative priority based on the determined relative priority order.

8. The video streaming device of claim 1 , wherein the anticipated requests message indicates the determined relative priority order by listing a first anticipated request for the first segment and a second anticipated request for the second segment in decreasing relative priority based on the determined relative priority order.

9. The video streaming device of claim 1 , wherein the network node is a network attachment point (NAP).

10. A method associated with receiving a 360-degree video stream at a video streaming device, the method comprising:

receiving, from a network node, a 360-degree video stream;

determining a viewport associated with the video streaming device and the 360-degree video stream;

determining, based on the viewport, to request in advance a first segment of the 360-degree video stream and a second segment of the 360-degree video stream;

determining a relative priority order for the first segment and the second segment;

generating an anticipated requests message that indicates the determined relative priority order by listing the first segment and the second segment in decreasing relative priority based on the determined relative priority order; and

sending, to the network node, the anticipated requests message.

11. The method of claim 10 , wherein the relative priority order is determined by determining a first priority for the first segment and a second priority for the second segment based on one or more of a time preference, a quality preference, or a location relative to the viewport.

12. The method of claim 10 , wherein the viewport is a spatial region of the 360-degree video stream that is being presented to a user of the video streaming device.

13. The method of claim 10 , wherein the viewport is determined based on an orientation of the video streaming device.

14. The method of claim 10 , wherein the 360-degree video stream comprises a plurality of temporal frames, wherein each temporal frame of the 360-degree video stream is partitioned into a plurality of tiles.

15. The method of claim 14 , wherein the first segment is a first tile of a frame of the plurality of temporal frames of the 360-degree video stream and the second segment is a second tile of the frame of the plurality of temporal frames of the 360-degree video stream.

16. The method of claim 10 , further comprising determining to request in advance a third segment of the 360-degree video stream and a fourth segment of the 360-degree video stream, wherein the determined relative priority order is determined for the first segment, the second segment, the third segment, and the fourth segment, and wherein the anticipated requests message indicates the determined relative priority order by listing the first segment, the second segment, the third segment, and the fourth segment in decreasing relative priority based on the determined relative priority order.

17. The method of claim 10 , wherein the anticipated requests message indicates the determined relative priority order by listing a first anticipated request for the first segment and a second anticipated request for the second segment in decreasing relative priority based on the determined relative priority order.

18. A network node comprising:

a memory; and

a processor configured to:

receive, from a first video streaming device, a first anticipated requests message that indicates a first plurality of segments in a first relative priority order;

receive, from a second video streaming device, a second anticipated requests message that indicates a second plurality of segments in a second relative priority order;

determine a priority associated with each of the first plurality of segments based on the first relative priority order and each of the second plurality of segments based on the second relative priority order;

determine that a common segment is indicated in the first anticipated requests message and the second anticipated requests message;

determine a first priority value for the common segment as indicated by the first anticipated requests message and a second priority value for the common segment as indicated by the second anticipated requests message;

send, to a server, a request for the common segment;

receive the common segment from the server; and

on a condition that that the first priority value and the second priority value are the same, multicast the common segment to the first video streaming device and the second video streaming device.

19. The network node of claim 18 , wherein the processor is further configured to, on a condition that the first priority value and the second priority value are different, unicast the common segment to the first video streaming device and the second video streaming device.

20. The network node of claim 18 , wherein the common segment represents a same video segment within a time window.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →