IP Library Patent Application 16338476
Patent Application
App. No. 16/338,476

METHOD AND APPARATUS FOR CODING/DECODING A LARGE FIELD OF VIEW VIDEO

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/338,476
Abstract

A method is proposed for coding a large field of view video into a bitstream, at least one picture of the omnidirectional video being represented as a surface, the surface being projected onto at least one 2D picture using a projection function. Such method comprises, for at least one current block of the at least one 2D picture: adapting (S 2400 ) a size of the at least one current block as a function of a pixel density function determined according to the projection function; and encoding (S 2410 ) the at least one current block into the bitstream using the adapted size.

Claims (52)

1 . A method for coding a large field video into a bitstream, at least one picture of said video being represented as a surface, said surface being projected onto at least one 2D picture using a projection function, said method comprising:

delivering at least one subblock associated with at least one current block of said at least one 2D picture by splitting said at least one current block according to a criterion function of a pixel density function determined according to said projection function; and

encoding said at least one current block into said bitstream by encoding the at least one subblock associated with said at least one current block;

wherein said criterion function depends on either:

a ratio of an average value of a horizontal, respectively vertical, component of said pixel density function over an average value of the vertical, respectively horizontal, component of said pixel density function; or

a ratio of a maximum value of the horizontal, respectively vertical, component of said pixel density function over a maximum value of the vertical, respectively horizontal, component of said pixel density function; or

a ratio of a minimum value of the horizontal, respectively vertical, component of said pixel density function over a minimum value of the vertical, respectively horizontal, component of said pixel density function.

2 . The method of claim 1 , wherein the method further comprises adapting a size of a transform to be applied to said current block or subblock; and wherein encoding comprises applying said transform of adapted size to said at least one current block or subblock.

3 . The method of claim 2 , wherein applying said transform of adapted size to said at least one current block or subblock comprises:

determining a maximum pixel density value along a direction, in the whole spatial area covered by said current subblock;

determining a maximum number of non-zero coefficients that can be generated by a 1D transform according to a criterion function of the pixel density function; and

computing the 1D transform, by calculating transform coefficients only for a number of lowest frequency coefficients equals to a said maximum number of non-zero coefficients, and setting other transform coefficients to zero.

4 . A method for decoding a bitstream representative of a large field video, at least one picture of said video being represented as a surface, said surface being projected onto at least one 2D picture using a projection function, said method comprising:

delivering at least one subblock associated with at least one current block of said at least one 2D picture by splitting said at least one current block according to a criterion function of a pixel density function determined according to said projection function; and

decoding from said bitstream said at least one current block by decoding the at least one subblock associated with said at least one current block;

wherein said criterion function depends on either:

a ratio of an average value of a horizontal, respectively vertical, component of said pixel density function over an average value of the vertical, respectively horizontal, component of said pixel density function; or

a ratio of a maximum value of the horizontal, respectively vertical, component of said pixel density function over a maximum value of the vertical, respectively horizontal, component of said pixel density function; or

a ratio of a minimum value of the horizontal, respectively vertical, component of said pixel density function over a minimum value of the vertical, respectively horizontal, component of said pixel density function.

5 . The method for decoding of claim 4 , wherein the method further comprises adapting a size of an inverse transform to be applied to said at least one current block or subblock; and wherein encoding comprises applying said inverse transform of adapted size to said current block or subblock.

6 . The method of claim 5 , wherein applying said inverse transform of adapted size to said at least one current block or subblock comprises:

determining a maximum pixel density value along a direction, in the whole spatial area covered by said current subblock;

determining a maximum number of non-zero coefficients that can be generated by a 1D inverse transform according to a criterion function of the pixel density function; and

computing the 1D inverse transform, by calculating inverse transform coefficients only for a number of lowest frequency coefficients equals to said maximum number of non-zero coefficients, and setting other inverse transform coefficients to zero.

7 . The method of claim 1 , wherein the method further comprises delivering at least one current block of adapted size, and wherein said adapted size is derived from a nominal size divided by an average value, or a median value, of said pixel density function computed for at least one pixel of said at least one current block.

8 . The method of claim 1 , wherein the method further comprises determining a width, respectively a height, of said at least one current block as a function of an average value, or a median value, of a horizontal, respectively vertical, component of said pixel density function computed for at least one pixel of said at least one current block.

9 . The method of claim 1 , wherein said splitting of at least one current block is signaled in said bitstream.

10 . An apparatus for coding a large field video into a bitstream, at least one picture of said video being represented as a surface, said surface being projected onto at least one 2D picture using a projection function, said apparatus comprising at least one processor configured to:

deliver at least one subblock associated with at least one current block of said at least one 2D picture by splitting said at least one current block according to a criterion function of a pixel density function determined according to said projection function; and

encode said at least one current block into said bitstream by encoding the at least one subblock associated with said at least one current block;

wherein said criterion function depends on either:

a ratio of an average value of a horizontal, respectively vertical, component of said pixel density function over an average value of the vertical, respectively horizontal, component of said pixel density function; or

a ratio of a maximum value of the horizontal, respectively vertical, component of said pixel density function over a maximum value of the vertical, respectively horizontal, component of said pixel density function; or

a ratio of a minimum value of the horizontal, respectively vertical, component of said pixel density function over a minimum value of the vertical, respectively horizontal, component of said pixel density function.

11 . An apparatus for decoding ( 700 ) a bitstream representative of a large field video, at least one picture of said video being represented as a surface, said surface being projected onto at least one 2D picture using a projection function, said apparatus comprising at least one processor configured to:

deliver at least one subblock associated with at least one current block of said at least one 2D picture by splitting said at least one current block according to a criterion function of a pixel density function determined according to said projection function; and

decode from said bitstream said at least one current block by decoding the at least one subblock associated with said at least one current block;

wherein said criterion function depends on either:

a ratio of an average value of a horizontal, respectively vertical, component of said pixel density function over an average value of the vertical, respectively horizontal, component of said pixel density function; or

a ratio of a maximum value of the horizontal, respectively vertical, component of said pixel density function over a maximum value of the vertical, respectively horizontal, component of said pixel density function; or

a ratio of a minimum value of the horizontal, respectively vertical, component of said pixel density function over a minimum value of the vertical, respectively horizontal, component of said pixel density function.

12 . (canceled)

13 . A non-transitory computer-readable medium comprising: a coded large field video, at least one picture of said video being represented as a surface, said surface being projected onto at least one 2D picture using a projection function;

coded data representative of at least one current block of said 2D picture; and

an information indicating that said at least one current block has been encoded using a size adapted as a function of a pixel density function determined according to said projection function.

14 . An immersive rendering device comprising an apparatus for decoding a bitstream representative of a large field video according to claim 13 .

15 . A system for immersive rendering of a large field video encoded into a bistream, comprising at least:

a network interface for receiving said bistream from a data network,

an apparatus for decoding said bitstream according to claim 11 ,

an immersive rendering device.

16 . The method of claim 4 , wherein the method further comprises delivering at least one current block of adapted size, and wherein said adapted size is derived from a nominal size divided by an average value, or a median value, of said pixel density function computed for at least one pixel of said at least one current block.

17 . The method of claim 4 , wherein the method further comprises determining a width, respectively a height, of said at least one current block as a function of an average value, or a median value, of a horizontal, respectively vertical, component of said pixel density function computed for at least one pixel of said at least one current block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2019
From: THOMSON LICENSING SAS
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 050763/0488 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2019
From: URBAN, FABRICE; LELEANNEC, FABRICE; VIELLARD, THIERRY
To: THOMSON LICENSING
Reel/Frame 050289/0618 →