IP Library Granted Patent US 10,841,566
Granted Patent B2
US 10,841,566 · App. 16/304,443 · Granted Nov 17, 2020

Methods and apparatus of viewport adaptive 360 degree video delivery

Inventors: Yong He (San Diego, CA); Yan Ye (San Diego, CA); Srinivas Gudumasu (San Diego, CA); Eduardo Asbun (Santa Clara, CA); Ahmed Hamza (Montreal, CA)
Assignee: VID SCALE, Inc.
H04N13/282H04N13/117H04N13/354H04N19/597H04N19/70H04N21/23439H04N21/234327H04N21/234345H04N21/4728H04N21/816H04N21/8456H04N21/8543
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,841,566
App. No.
16/304,443
Granted
Nov 17, 2020
Kind
B2
Abstract

Systems, methods, and instrumentalities are disclosed for client centric service quality control. A first viewport of a 360 degree video may be determined. The 360 degree video may comprise one or more of an equirectangular, a cube-map, a cylindrical, a pyramidal, and/or a spherical projection mapping. The first viewport may be associated with a spatial region of the 360 degree video. An adjacent area that extends around the spatial region may be determined. A second viewport of the 360 degree video may be determined. A bitstream associated with the 360 degree video may be received. One or more enhanced regions may be included in the bitstream. The one or more enhanced regions may correspond to the first and/or second viewport, A high coding bitrate may be associated with the first viewport and/or the second viewport.

Claims (39)

1. An apparatus comprising:

a processor configured to:

receive a media presentation description (MPD) file associated with a 360 degree video;

request a first video layer in a first quality representation based on the received MPD file, the first video layer comprising the 360 degree video;

identify a first viewport of a user;

determine that the first viewport of the user is available;

on a condition that the first viewport of the user is available:

request content from a second video layer in a second quality representation based on the received MPD file, wherein the requested content is associated with the first viewport and the requested content is a first spatial subset of the 360 degree video, and

display the requested content overlaid onto the first video layer; and

on a condition that the first viewport of the user is unavailable, display the first video layer.

2. The apparatus of claim 1 , wherein the processor is configured to:

determine that the user has changed the first viewport to a second viewport;

request content from a third video layer in a third quality representation based on the received MPD file, wherein the requested content is associated with the second viewport and the requested content is a second spatial subset of the 360 degree video; and

display the requested content overlaid onto the first video layer.

3. The apparatus of claim 1 , wherein the processor is configured to:

request the first video layer in the first quality representation for a first segment length and request the content from the second video layer in the second quality representation for a second segment length, wherein the first segment length is longer than the second segment length.

4. The apparatus of claim 1 , wherein the 360 degree video comprises a scalable 360 degree video.

5. The apparatus of claim 4 , wherein the first video layer comprises a scalable base video layer associated with the scalable 360 degree video and the second video layer comprises a scalable enhanced video layer associated with the scalable 360 degree video.

6. The apparatus of claim 1 , wherein the second quality representation has higher quality than the first quality representation.

7. The apparatus of claim 1 , wherein the second video layer is coded with a higher bitrate, a higher resolution, or a higher frame rate than the first video layer.

8. A method comprising:

receiving a media presentation description (MPD) file associated with a 360 degree video;

requesting a first video layer in a first quality representation based on received MPD file, the first video layer comprising the 360 degree video

identifying a first viewport of a user,

determining that the first viewport of the user is available;

on a condition that the first viewport of the user is available:

requesting content from a second video layer in a second quality representation based on the received MPD file, wherein the requested content is associated with the first viewport and the requested content is a first spatial subset of the 360 degree video, and

displaying the requested content overlaid onto the first video layer and

on a condition that the first viewport of the user is unavailable, displaying the first video layer.

9. The method of claim 8 , comprising:

determining that the user has changed the first viewport to a second viewport;

requesting content from a third video layer in a third quality representation based on the received MPD file, wherein the requested content is associated with the second viewport and the requested content is a second spatial subset of the 360 degree video; and

displaying the requested content overlaid onto the first video layer.

10. The method of claim 8 , wherein the method comprises:

requesting the first video layer in the first quality representation for a first segment length and request the content from the second video layer in the second quality representation for a second segment length, wherein the first segment length is longer than the second segment length.

11. The method of claim 8 , wherein the 360 degree video comprises a scalable 360 degree video.

12. The method of claim 11 , wherein the first video layer comprises a scalable base video layer associated with the 360 degree video and the second video layer comprises a scalable enhanced video layer associated with the 360 degree video.

13. The method of claim 8 , wherein the second video layer is coded with a higher bitrate, a higher resolution, or a higher frame rate than the first video layer.

14. The method of claim 8 , wherein the second quality representation has higher quality than the first quality representation.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2019
From: HE, YONG; YE, YAN; GUDUMASU, SRINIVAS; ASBUN, EDUARDO; HAMZA, AHMED
To: VID SCALE, INC.
Reel/Frame 050593/0544 →
Cited By (9)
US 12,256,083 US 12,289,483 US 12,323,644 US 12,363,309 US 12,368,830 US 12,432,356 US 12,464,146 US 12,474,769 US 12,664,763