IP Library Granted Patent US 11,284,089
Granted Patent B2
US 11,284,089 · App. 16/329,674 · Granted Mar 22, 2022

Method and system for signaling of 360-degree video information

Inventors: Philippe Hanhart (San Diego, CA); Yuwen He (San Diego, CA); Yan Ye (San Diego, CA)
Assignee: VID SCALE, INC.
H04N19/167H04N19/184H04N19/597H04N19/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,284,089
App. No.
16/329,674
Granted
Mar 22, 2022
Kind
B2
Abstract

Coding techniques for 360-degree video. An encoder selects a projection format and maps the 360-degree video to a 2D planar video using the selected projection format. The encoder encodes the 2D planar video in a bitstream and further signals, in the bitstream, parameters identifying the projection format. The parameters identifying the projection format may be signaled in a video parameter set, sequence parameter set, and/or picture parameter set of the bitstream. Different projection formats that may be signaled include formats using geometries such as equirectangular, cubemap, equal-area, octahedron, icosahedron, cylinder, and user-specified polygon. Other parameters that may be signaled include different arrangements of geometric faces or different encoding quality for different faces. Corresponding decoders. Projection parameters may further include relative geometry rotation parameters that define an orientation of the projection geometry.

Claims (27)

1. A method of decoding 360-degree video data, the method comprising:

identifying a frame packing configuration for a current picture based on frame packing information associated with the current picture, the frame packing information indicating at least one of a face layout or a face rotation;

identifying a frame packing configuration for a reference picture of the current picture;

determining whether to convert the reference picture to match the frame packing configuration for the current picture based on a comparison of the frame packing configuration for the current picture and the frame packing configuration for the reference picture, wherein the reference picture is converted to match the frame packing configuration for the current picture in response to a determination that the frame packing configuration for the current picture and the frame packing configuration for the reference picture are different; and

predicting the current picture based on the converted reference picture.

2. The method of claim 1 , further comprising mapping the current picture to a 360-degree video using the frame packing information associated with the current picture.

3. The method of claim 1 , wherein predicting the current picture is performed using temporal motion compensated prediction.

4. The method of claim 1 , wherein predicting the current picture is performed using inter-layer prediction.

5. The method of claim 1 , wherein the frame packing information associated with the current picture is included in a picture parameter set associated with the current picture, and wherein the frame packing configuration of the reference picture is indicated in a picture parameter set associated with the reference picture.

6. A method of encoding 360-degree video data, the method comprising:

identifying a frame packing configuration for a current picture based on frame packing information associated with the current picture, the frame packing information indicating at least one of a face layout or a face rotation;

identifying a frame packing configuration for a reference picture of the current picture;

determining whether to convert the reference picture to match the frame packing configuration for the current picture based on a comparison of the frame packing configuration for the current picture and the frame packing configuration for the reference picture, wherein the reference picture is converted to match the frame packing configuration for the current picture in response to a determination that the frame packing configuration for the current picture and the frame packing configuration for the reference picture are different; and

predicting the current picture based on the converted reference picture.

7. The method of claim 6 , further comprising mapping the current picture to a 360-degree video using the frame packing information associated with the current picture.

8. The method of claim 6 , wherein predicting the current picture is performed using temporal motion compensated prediction.

9. The method of claim 6 , wherein predicting the current picture is performed using inter-layer prediction.

10. The method of claim 6 , wherein the frame packing information associated with the current picture is included in a picture parameter set associated with the current picture, and wherein the frame packing configuration of the reference picture is indicated in a picture parameter set associated with the reference picture.

11. An apparatus comprising a processor configured to perform at least:

identifying a frame packing configuration for a current picture based on frame packing information associated with the current picture, the frame packing information indicating at least one of a face layout or a face rotation;

identifying a frame packing configuration for a reference picture of the current picture;

determining whether to convert the reference picture to match the frame packing configuration for the current picture based on a comparison of the frame packing configuration for the current picture and the frame packing configuration for the reference picture, wherein the reference picture is converted to match the frame packing configuration for the current picture in response to a determination that the frame packing configuration for the current picture and the frame packing configuration for the reference picture are different; and

predicting the current picture based on the converted reference picture.

12. The apparatus of claim 11 , wherein the processor is further configured to perform mapping the current picture to a 360-degree video using the frame packing information associated with the current picture.

13. The apparatus of claim 11 , wherein predicting the current picture is performed using temporal motion compensated prediction.

14. The apparatus of claim 11 , wherein predicting the current picture is performed using inter-layer prediction.

15. The apparatus of claim 11 , wherein the frame packing information associated with the current picture is included in a picture parameter set associated with the current picture, and wherein the frame packing configuration of the reference picture is indicated in a picture parameter set associated with the reference picture.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2019
From: HANHART, PHILIPPE; HE, YUWEN; YE, YAN
To: VID SCALE, INC.
Reel/Frame 050721/0231 →
Continuity (3)
Provisional Application 62407337 · Oct 12, 2016
Provisional Application 62383367 · Sep 2, 2016
Related Publication 20190200023A1 · Jun 27, 2019
Cited By (1)
US 12,506,852