IP Library Granted Patent US 11,190,801
Granted Patent B2
US 11,190,801 · App. 16/899,575 · Granted Nov 30, 2021

Video encoding method with syntax element signaling of mapping function employed by cube-based projection and associated video decoding method

Inventors: Ya-Hsuan Lee (Hsinchu, TW); Jian-Liang Lin (Hsinchu, TW)
Assignee: MEDIATEK INC.
H04N19/597G06T3/0062G06T3/0087H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,190,801
App. No.
16/899,575
Granted
Nov 30, 2021
Kind
B2
Abstract

A video encoding method includes: encoding a projection-based frame to generate a part of a bitstream, wherein at least a portion of a 360-degree content of a sphere is mapped to projection faces via cube-based projection, and the projection-based frame has the projection faces packed in a cube-based projection layout; and signaling at least one syntax element via the bitstream, wherein said at least one syntax element is associated with a mapping function that is employed by the cube-based projection to determine sample locations for each of the projection faces.

Claims (157)

1. A video encoding method comprising:

encoding a projection-based frame to generate a part of a bitstream, wherein at least a portion of a 360-degree content of a sphere is mapped to projection faces via cube-based projection, and the projection-based frame has the projection faces packed in a cube-based projection layout; and

signaling at least one syntax element via the bitstream, wherein said at least one syntax element is associated with a mapping function that is employed by the cube-based projection to determine sample locations for each of the projection faces;

wherein the mapping function is a parameterized mapping function employed by the cube-based projection to adjust sample locations for said each of the projection faces, said at least one syntax element signaled via the bitstream comprises a plurality of syntax elements that specify at least coefficients of the parameterized mapping function, and for said each of the projection faces, the plurality of syntax elements comprise:

a first syntax element, arranged to specify a coefficient used in the parameterized mapping function of a first axis; and

a second syntax element, arranged to indicate whether the parameterized mapping function of the first axis refers to a position value of a second axis, wherein when the second syntax element is set by a first logic value, an output of the parameterized mapping function of the first axis is determined by jointly considering a position value of the first axis and the position value of the second axis; and when the second syntax element is set by a second logic value, the output of the parameterized mapping function of the first axis is determined by considering only one of the position value of the first axis and the position value of the second axis.

2. The video encoding method of claim 1 , wherein said at least one syntax element signaled via the bitstream further comprises:

a third syntax element, arranged to specify that the parameterized mapping function is employed by the cube-based projection.

3. The video encoding method of claim 1 , wherein for said each of the projection faces, the plurality of syntax elements further comprise:

a third syntax element, arranged to specify a coefficient used in the parameterized mapping function of a second axis.

4. The video encoding method of claim 3 , wherein for said each of the projection faces, the plurality of syntax elements further comprise:

a fourth syntax element, arranged to indicate whether the parameterized mapping function of the second axis refers to the position value of the first axis, wherein when the fourth syntax element is set by the first logic value, an output of the parameterized mapping function of the second axis is determined by jointly considering the position value of the second axis and the position value of the first axis; and when the fourth syntax element is set by the second logic value, the output of the parameterized mapping function of the second axis is determined by considering only one of the position value of the first axis and the position value of the second axis.

5. The video encoding method of claim 1 , wherein an adjusted sample location (f x (u, v), f y (u, v)) is obtained from applying the parameterized mapping function to a target sample location (u, v) on one of the projection faces, and the parameterized mapping function is expressed by:

{

f

x

(

u

,

v

)

=

u

1

+

a

u

(

1

-

b

u

v

2

)

(

1

-

u

2

)

f

y

(

u

,

v

)

=

v

1

+

a

v

(

1

-

b

v

u

2

)

(

1

-

v

2

)

,

where coefficients a u , b u , a v , and b v of the parameterized mapping function are specified by the plurality of syntax elements signaled via the bitstream.

6. A video decoding method comprising:

decoding a part of a bitstream to generate a decoded frame, wherein the decoded frame is a projection-based frame that has projection faces packed in a cube-based projection layout, and at least a portion of a 360-degree content of a sphere is mapped to the projection faces via cube-based projection; and

parsing at least one syntax element from the bitstream, wherein said at least one syntax element is associated with a mapping function that is employed by the cube-based projection to determine sample locations for each of the projection faces;

wherein the mapping function is a parameterized mapping function employed by the cube-based projection to adjust sample locations for said each of the projection faces, said at least one syntax element parsed from the bitstream comprises a plurality of syntax elements that specify coefficients of the parameterized mapping function, and for said each of the projection faces, the plurality of syntax elements comprise:

a first syntax element, arranged to specify a coefficient used in the parameterized mapping function of a first axis; and

a second syntax element, arranged to indicate whether the parameterized mapping function of the first axis refers to a position value of a second axis, wherein when the second syntax element is set by a first logic value, an output of the parameterized mapping function of the first axis is determined by jointly considering a position value of the first axis and the position value of the second axis; and when the second syntax element is set by a second logic value, the output of the parameterized mapping function of the first axis is determined by considering only one of the position value of the first axis and the position value of the second axis.

7. The video decoding method of claim 6 , wherein said at least one syntax element parsed from the bitstream further comprises:

a third syntax element, arranged to specify that the parameterized mapping function is employed by the cube-based projection.

8. The video decoding method of claim 6 , wherein for said each of the projection faces, the plurality of syntax elements further comprise:

a third syntax element, arranged to specify a coefficient used in the parameterized mapping function of a second axis.

9. The video decoding method of claim 8 , wherein for said each of the projection faces, the plurality of syntax elements further comprise:

a fourth syntax element, arranged to indicate whether the parameterized mapping function of the second axis refers to the position value of the first axis,

wherein when the fourth syntax element is set by the first logic value, an output of the parameterized mapping function of the second axis is determined by jointly considering the position value of the second axis and the position value of the first axis; and when the fourth syntax element is set by the second logic value, the output of the parameterized mapping function of the second axis is determined by considering only one of the position value of the first axis and the position value of the second axis.

10. The video decoding method of claim 6 , wherein an adjusted sample location (f x (u, v), f y (u, v)) is obtained from applying the parameterized mapping function to a target sample location (u, v) on one of the projection faces, and the parameterized mapping function is expressed by:

{

f

x

(

u

,

v

)

=

u

1

+

a

u

(

1

-

b

u

v

2

)

(

1

-

u

2

)

f

y

(

u

,

v

)

=

v

1

+

a

v

(

1

-

b

v

u

2

)

(

1

-

v

2

)

,

where coefficients a u , b u , a v , and b v of the parameterized mapping function are specified by the plurality of syntax elements parsed from the bitstream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2020
From: LEE, YA-HSUAN; LIN, JIAN-LIANG
To: MEDIATEK INC.
Reel/Frame 052920/0586 →
Continuity (4)
Provisional Application 62903056 · Sep 20, 2019
Provisional Application 62871840 · Jul 9, 2019
Provisional Application 62869627 · Jul 2, 2019
Related Publication 20210006832A1 · Jan 7, 2021